-- Logs begin at Wed 2022-10-26 10:16:53 UTC, end at Wed 2022-10-26 11:28:45 UTC. -- Oct 26 10:49:05.140809 dv-cinder-862679-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 26 10:49:05.150015 dv-cinder-862679-1-smb devstack@keystone.service[81611]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 26 10:49:05.152075 dv-cinder-862679-1-smb devstack@keystone.service[81611]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 26 10:49:05 2022] *** Oct 26 10:49:05.152075 dv-cinder-862679-1-smb devstack@keystone.service[81611]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 26 10:49:05.152075 dv-cinder-862679-1-smb devstack@keystone.service[81611]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 26 10:49:05.152075 dv-cinder-862679-1-smb devstack@keystone.service[81611]: nodename: dv-cinder-862679-1-smb Oct 26 10:49:05.152075 dv-cinder-862679-1-smb devstack@keystone.service[81611]: machine: x86_64 Oct 26 10:49:05.152075 dv-cinder-862679-1-smb devstack@keystone.service[81611]: clock source: unix Oct 26 10:49:05.152075 dv-cinder-862679-1-smb devstack@keystone.service[81611]: pcre jit disabled Oct 26 10:49:05.152075 dv-cinder-862679-1-smb devstack@keystone.service[81611]: detected number of CPU cores: 4 Oct 26 10:49:05.152075 dv-cinder-862679-1-smb devstack@keystone.service[81611]: current working directory: / Oct 26 10:49:05.152075 dv-cinder-862679-1-smb devstack@keystone.service[81611]: detected binary path: /usr/bin/uwsgi-core Oct 26 10:49:05.152731 dv-cinder-862679-1-smb devstack@keystone.service[81611]: your processes number limit is 47680 Oct 26 10:49:05.152731 dv-cinder-862679-1-smb devstack@keystone.service[81611]: your memory page size is 4096 bytes Oct 26 10:49:05.152731 dv-cinder-862679-1-smb devstack@keystone.service[81611]: detected max file descriptor number: 2048 Oct 26 10:49:05.152731 dv-cinder-862679-1-smb devstack@keystone.service[81611]: lock engine: pthread robust mutexes Oct 26 10:49:05.152731 dv-cinder-862679-1-smb devstack@keystone.service[81611]: thunder lock: enabled Oct 26 10:49:05.152731 dv-cinder-862679-1-smb devstack@keystone.service[81611]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 26 10:49:05.152731 dv-cinder-862679-1-smb devstack@keystone.service[81611]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 26 10:49:05.191374 dv-cinder-862679-1-smb devstack@keystone.service[81611]: Python main interpreter initialized at 0x56005f0139c0 Oct 26 10:49:05.191374 dv-cinder-862679-1-smb devstack@keystone.service[81611]: python threads support enabled Oct 26 10:49:05.191374 dv-cinder-862679-1-smb devstack@keystone.service[81611]: your server socket listen backlog is limited to 100 connections Oct 26 10:49:05.191374 dv-cinder-862679-1-smb devstack@keystone.service[81611]: your mercy for graceful operations on workers is 90 seconds Oct 26 10:49:05.191695 dv-cinder-862679-1-smb devstack@keystone.service[81611]: mapped 403077 bytes (393 KB) for 2 cores Oct 26 10:49:05.191770 dv-cinder-862679-1-smb devstack@keystone.service[81611]: *** Operational MODE: preforking *** Oct 26 10:49:05.192074 dv-cinder-862679-1-smb devstack@keystone.service[81611]: *** uWSGI is running in multiple interpreter mode *** Oct 26 10:49:05.192074 dv-cinder-862679-1-smb devstack@keystone.service[81611]: spawned uWSGI master process (pid: 81611) Oct 26 10:49:05.192264 dv-cinder-862679-1-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 26 10:49:05.193330 dv-cinder-862679-1-smb devstack@keystone.service[81611]: spawned uWSGI worker 1 (pid: 81622, cores: 1) Oct 26 10:49:05.193330 dv-cinder-862679-1-smb devstack@keystone.service[81611]: spawned uWSGI worker 2 (pid: 81623, cores: 1) Oct 26 10:49:05.193330 dv-cinder-862679-1-smb devstack@keystone.service[81611]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 26 10:49:09.525230 dv-cinder-862679-1-smb devstack@keystone.service[81622]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 26 10:49:09.525230 dv-cinder-862679-1-smb devstack@keystone.service[81622]: from cryptography.utils import int_from_bytes Oct 26 10:49:09.526013 dv-cinder-862679-1-smb devstack@keystone.service[81622]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 26 10:49:09.526013 dv-cinder-862679-1-smb devstack@keystone.service[81622]: from cryptography.utils import int_from_bytes Oct 26 10:49:09.526160 dv-cinder-862679-1-smb devstack@keystone.service[81623]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 26 10:49:09.526160 dv-cinder-862679-1-smb devstack@keystone.service[81623]: from cryptography.utils import int_from_bytes Oct 26 10:49:09.526160 dv-cinder-862679-1-smb devstack@keystone.service[81623]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 26 10:49:09.526160 dv-cinder-862679-1-smb devstack@keystone.service[81623]: from cryptography.utils import int_from_bytes Oct 26 10:49:09.575573 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 26 10:49:09.575763 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 26 10:49:09.575901 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 26 10:49:09.575993 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] command line args: [] {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 26 10:49:09.576111 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 26 10:49:09.576239 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 26 10:49:09.576325 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] command line args: [] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 26 10:49:09.576405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ================================================================================ {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 26 10:49:09.576569 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 26 10:49:09.576649 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] admin_token = **** {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.576753 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ================================================================================ {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 26 10:49:09.576893 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] config_dir = [] {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.577012 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] admin_token = **** {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.577098 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.577252 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] config_source = [] {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.577334 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] config_dir = [] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.577434 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] debug = True {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.577518 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.577601 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] config_source = [] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.577673 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.577931 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] debug = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.578038 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.578169 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.578169 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.578359 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.578359 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.578539 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.578637 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.578742 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.578867 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.578978 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] list_limit = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.579073 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] log_config_append = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.579177 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] list_limit = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.579272 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.579370 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] log_config_append = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.579472 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] log_dir = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.579572 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.579672 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] log_file = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.579772 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] log_dir = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.579866 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.579963 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] log_file = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.580121 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.580200 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.580315 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.580389 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.580507 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.580590 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.580707 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.580826 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.580908 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.581029 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.581105 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.581225 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.581307 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.581380 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.581521 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.581607 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.581757 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.581848 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.581993 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.582075 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.582228 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.582349 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.582467 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.582560 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.582716 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.582798 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.582967 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.583050 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.583249 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.583472 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.583655 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] publish_errors = False {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.583731 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.583898 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.583981 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] publish_errors = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.584168 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.584258 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.584408 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.584492 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.584591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.584673 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.584846 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.584933 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.585087 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.585170 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] standard_threads = False {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.585333 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] standard_threads = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.585410 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.585572 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.586162 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.586286 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.586436 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.586509 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] use_journal = False {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.586621 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.586697 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] use_json = False {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.586778 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] use_stderr = False {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.586849 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] use_journal = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.586970 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] use_syslog = False {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.587046 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] use_json = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.587137 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] use_stderr = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.587213 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.587360 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] use_syslog = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.587434 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.587542 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:49:09.587652 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.587805 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.587921 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.588053 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.588190 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.588347 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.588434 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.588594 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.588670 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.588851 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.588929 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.589097 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.589174 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.589352 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.589428 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.589594 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.589675 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.589850 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.589933 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.590087 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.590162 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.590338 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.590416 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.590616 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.590705 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.590826 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.590907 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.591068 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.591151 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.591305 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.591381 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.591565 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.591650 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.591805 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.591881 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.592076 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.592155 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.592324 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.592413 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.592581 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.592658 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.592823 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.592899 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.593084 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.593243 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.593324 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.593394 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.593555 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.593633 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.593791 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.593876 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.594026 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.594109 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.594267 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.594345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.594514 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.594598 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.594759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.594836 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.594990 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.595067 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.595224 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.595309 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.595476 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.595559 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.595713 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.595789 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.595951 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.596084 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.596229 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.596312 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.596465 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.596542 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.596704 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.596792 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.596942 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.597025 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.597177 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.597288 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.597412 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.597498 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.597645 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.597723 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.597878 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.597982 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.598114 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.598228 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.598352 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.598462 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.598584 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.598687 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.598839 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.598962 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.599098 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.599182 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.599303 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.599379 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.599494 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.599568 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.599746 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.599831 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.599980 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.600082 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.600246 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.600332 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.600484 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.600561 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.600722 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.600838 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.600963 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.601039 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.601201 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.601281 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.602000 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.602087 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.602247 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.602334 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.602486 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.602564 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.602725 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.602806 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.602962 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.603052 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.603203 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.603289 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.603444 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.603531 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.603679 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.603803 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.603919 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.604013 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.604185 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.604266 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.604427 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.604508 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.604672 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.604752 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.604923 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.604999 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.605172 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.605250 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.605397 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.605472 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.605637 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.605715 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.605874 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.605952 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.606122 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.606200 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.606358 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.606435 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.606596 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.606679 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.606839 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.606929 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.607075 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.607151 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.607320 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.607397 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.607556 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.607643 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.607793 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.607873 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.608036 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.608174 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.608298 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.608389 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.608536 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.608614 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.608774 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.608851 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.609015 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.609101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.609270 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.609386 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.609513 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.609616 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.609752 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.609844 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.609994 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.610073 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.610231 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.610309 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.610469 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.610555 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.610706 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.610785 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.610938 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.611016 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.611171 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.611256 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.611405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.611483 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.611637 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.611714 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.611868 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.611953 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.612127 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.612210 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.612366 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.612443 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.612612 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.612702 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.612848 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.612925 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.613100 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.613178 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.613343 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.613469 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.613586 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.613663 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.613821 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] auth.external = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.613929 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.614053 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.614133 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.614313 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] auth.external = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.614401 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.614549 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.614628 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.614792 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] auth.password = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.614869 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.615025 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] auth.token = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.615112 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.615266 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.615345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] auth.password = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.615503 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.615581 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] auth.token = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.615751 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.615837 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.615985 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.616106 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.616261 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.616341 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.616496 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.616587 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.616730 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.616808 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.616992 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] credential.caching = True {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.617070 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.617239 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.617326 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.617481 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] credential.caching = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.617560 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.617727 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.617810 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.617979 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.618064 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.618223 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.618300 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.618459 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.618538 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.618708 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.618795 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.618946 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.619030 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.619190 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.619267 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.619444 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.619526 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.619683 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.619762 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.619941 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.620020 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.620235 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.620316 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.620480 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.620561 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.620738 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.620825 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.620976 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] federation.caching = True {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.621056 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.621216 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.621295 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.621464 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] federation.caching = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.621545 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.621707 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.621794 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.621939 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.622016 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.622188 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.622268 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.622422 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.622501 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.622676 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.622755 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.622911 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.622988 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.623167 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.623252 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.623405 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.623488 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.623650 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.623729 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.623888 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] identity.caching = True {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.623968 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.624160 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.624242 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.624403 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity.caching = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.624482 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.624640 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.624720 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.624877 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.624955 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.625128 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.625205 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.625359 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.625437 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.625598 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.625677 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.625837 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.625915 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.626080 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.626160 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.626309 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.626386 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.626541 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.626620 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.626773 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.626853 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.627020 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.627098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.627250 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.627373 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.627500 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.627586 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.627751 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.627832 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.628002 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.628093 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.628289 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.628369 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.628527 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.628611 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.628767 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.628855 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.629001 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.629082 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.629241 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.629320 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.629474 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.629561 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.629713 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.629793 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.629947 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.630025 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.630188 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.630273 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.630433 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.630511 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.630665 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.630743 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.630916 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.631003 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.631152 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.631230 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.631390 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.631467 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.631638 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.631725 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.631876 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.631955 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.632130 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.632213 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.632372 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.632463 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.633127 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.633210 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.633449 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.633539 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.633612 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.633692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.633833 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.633952 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.634077 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.634200 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.634324 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.634444 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.634568 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.634700 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.634916 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.634994 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.635175 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.635265 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.635410 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.635490 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.635660 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.635738 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.635899 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.635986 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.636163 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.636246 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.636407 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.636488 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.636647 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.636736 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.636881 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.user = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.636961 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.637121 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.637199 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.637361 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.637448 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.637602 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.637680 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.637854 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.637933 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.638090 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.638176 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.638342 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.638420 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.638587 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.638666 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.638821 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.638907 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.639057 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.639137 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.639292 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.639370 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.639527 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.639613 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.639761 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.639840 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.639999 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.640127 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.640261 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.640350 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.640509 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.640587 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.640758 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.640837 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.641006 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.641093 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.641239 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.641318 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.641489 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.641568 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.641723 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.641799 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.641961 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.642029 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.642199 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.642278 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.642437 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.642525 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.642676 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.642761 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.642918 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.642997 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.643153 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.643308 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.643409 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.643487 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.643639 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.643717 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.643885 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.643973 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.644144 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.644226 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.644382 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.644460 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.644621 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.644702 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.644859 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.644937 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.645102 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.645181 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.645333 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.645418 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.645578 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.645684 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.645819 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] resource.caching = True {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.645911 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.646056 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.646136 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.646305 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] resource.caching = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.646384 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.646539 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.646617 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.646791 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.646871 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.647030 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.647108 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.647269 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.647346 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.647517 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.647597 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.647754 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.647833 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.647995 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.648114 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.648805 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] role.caching = True {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.648897 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.649066 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] role.driver = sql {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.649145 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.649300 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.649379 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] role.caching = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.649551 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.649633 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] role.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.649798 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.649877 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.650046 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.650124 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.650293 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.650374 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.650541 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.650620 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.650789 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.650868 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.651034 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.651114 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.651284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.651362 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.651516 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.651594 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.651764 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.651845 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.652000 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.652115 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.652279 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.652358 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.652532 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.652613 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.652785 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.652926 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.653037 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.653166 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.653418 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.653496 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.653668 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.653747 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.653917 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.654003 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.654167 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.654247 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.654403 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.654736 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.654918 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.655005 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.655157 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.655235 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.655401 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.655479 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.655635 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.655722 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.655869 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.655948 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.656124 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.656207 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.656374 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.656464 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.656613 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.656692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.656865 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.656943 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.657106 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.657194 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.657343 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.657423 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.657576 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.657654 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.657811 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] token.caching = True {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.657898 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.658045 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.658123 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.658288 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] token.caching = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.658368 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.658524 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.658610 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.658775 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.658853 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.659016 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.659151 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.659254 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.659344 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.659499 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.659578 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.659742 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.659820 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.659987 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.660088 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.660260 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.660339 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.660502 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.660581 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.660742 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.660832 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.660987 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.661066 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.661231 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.661309 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.661483 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.661572 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.661729 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.661810 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.661985 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.662071 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.662234 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.662314 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] database.connection = **** {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.662476 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.662554 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.662725 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.662806 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.connection = **** {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.662965 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.663043 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.663206 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.663286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.663430 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.663526 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.663668 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.663748 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.663929 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.664010 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.664192 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.664275 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.664434 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.664512 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.664668 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.664746 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.664912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.664995 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.665149 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.665228 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.665393 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.665470 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.665627 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.665706 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.665872 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.665950 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.666102 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.666189 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.666342 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.666421 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.666575 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.666653 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.666726 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 26 10:49:09.666805 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.667045 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:49:09.667219 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 26 10:49:09.696565 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81622) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:09.696800 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81622) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:09.696882 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:09.697031 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81622) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:09.697116 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:09.697259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:09.705368 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81622) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:09.705642 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:09.734975 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81622) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:09.735207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81622) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:09.735668 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:09.735906 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:09.787491 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81622) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:09.787876 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:09.835941 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81622) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:09.836198 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81622) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:09.836718 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:09.836967 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:09.999037 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81622) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:09.999204 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81622) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:09.999275 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:09.999409 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81622) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:09.999494 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:09.999632 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81622) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:09.999731 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:09.999851 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81622) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:09.999934 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:10.000092 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81622) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:10.000177 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:10.000357 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:10.023408 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81622) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:10.023646 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81622) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:10.023796 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:10.023881 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81622) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:10.024041 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:10.024144 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81622) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:10.024303 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:10.024388 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81622) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:10.024534 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81622) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:10.024615 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:10.024751 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81622) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:10.024835 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:10.024972 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:10.025196 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:10.036158 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81622) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:10.036450 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:10.048986 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81622) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:10.049218 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81622) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:10.049301 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:10.049447 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81622) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:10.049639 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:10.049726 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81622) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:10.049803 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:10.049877 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81622) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:10.049945 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:10.050089 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81622) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:10.050173 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:10.050307 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81622) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:10.050390 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:10.050563 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:49:10.076856 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.076988 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.077068 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 26 10:49:10.077142 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 26 10:49:10.077395 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.077476 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.077599 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 26 10:49:10.077682 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 26 10:49:10.077878 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.077958 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.078147 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.078227 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.078662 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.078744 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.078928 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.079050 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.088307 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.088416 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.088594 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.088677 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.088869 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.088950 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.089157 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.089249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.096128 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81622) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:49:10.096216 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:49:10.099016 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81622) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:49:10.106397 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:49:10.106509 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.106593 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.106658 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.106735 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.106808 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.106890 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.106966 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.107040 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.107113 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.107186 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.107259 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.107340 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.107415 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.107488 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.107561 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.107635 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.107715 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.107791 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.107864 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.107937 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.124862 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.124976 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.126317 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81622) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:49:10.126406 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:49:10.126608 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.126690 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.133608 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81622) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:49:10.133789 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:49:10.133917 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.134042 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.134170 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.134315 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.140550 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81622) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:49:10.140798 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:49:10.140934 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.141060 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.145036 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81622) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:49:10.145137 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:49:10.145331 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.145413 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.145617 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.145722 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.145902 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.145993 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.146189 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.146270 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.146469 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.146549 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.146755 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.146838 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.147034 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.147113 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.162894 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.163079 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.163187 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.163309 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.167166 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:49:10.167265 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81622) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:49:10.170408 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.176708 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.176813 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.176898 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.176977 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81622) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:49:10.177054 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:49:10.178034 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81622) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:49:10.178129 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:49:10.181773 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.181871 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.182079 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.182178 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.182370 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.182464 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.182674 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.182767 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.182967 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.183051 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.183252 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.183336 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.199120 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:49:10.199218 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81622) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:49:10.199413 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.199497 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.199689 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.199786 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.199964 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.200050 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.206863 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.206967 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.208444 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.211353 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.211353 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.211492 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.211567 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.211641 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.213558 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81622) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:49:10.213647 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:49:10.213853 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.213952 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.214245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.214338 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.214534 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.214618 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.214825 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.214909 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.226006 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:49:10.226118 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81622) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:49:10.226294 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.226431 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.227222 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.227309 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.227512 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.227612 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.227817 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.227983 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.228132 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.228288 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.228422 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.228554 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.243800 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:49:10.243941 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81622) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:49:10.246725 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81622) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:49:10.246877 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:49:10.249703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.249842 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.251105 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.251253 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.252752 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:49:10.252891 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81622) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:49:10.253043 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.253169 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.253333 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.253504 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.259747 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.259892 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.261239 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81622) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:49:10.261345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:49:10.264274 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.264365 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.264568 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.264649 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.264854 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.264947 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.265135 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.265215 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.272978 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81622) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:49:10.273079 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:49:10.274309 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.274441 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.274521 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.274595 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.282150 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:49:10.282244 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81622) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:49:10.282438 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.282519 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.282726 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.282807 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.283006 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.283094 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.283283 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.283363 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.283559 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.283640 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.283835 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.283923 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.284153 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.284237 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.284441 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.284521 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.284715 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.284798 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.284988 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.285068 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.285278 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.285436 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.285575 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.285654 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.285844 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81622) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.285928 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:49:10.319324 dv-cinder-862679-1-smb devstack@keystone.service[81622]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56005f0139c0 pid: 81622 (default app) Oct 26 10:49:10.319430 dv-cinder-862679-1-smb devstack@keystone.service[81623]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56005f0139c0 pid: 81623 (default app) Oct 26 10:49:10.322681 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72cc56-ded4-4cf6-b687-6e2e092a9054 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:10.322976 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72cc56-ded4-4cf6-b687-6e2e092a9054 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:10.323254 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72cc56-ded4-4cf6-b687-6e2e092a9054 None None] PATH_INFO: `/v3` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:10.327496 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 791 bytes} [Wed Oct 26 10:49:10 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:18.192350 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274bb80-1d7f-4dbd-88b3-40a48d2c924a None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:18.192919 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274bb80-1d7f-4dbd-88b3-40a48d2c924a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:18.192919 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274bb80-1d7f-4dbd-88b3-40a48d2c924a None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:18.197206 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1/2] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:49:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:49:18.202321 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfffa77-4c05-4731-9771-a128385f6c3d None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:18.202845 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfffa77-4c05-4731-9771-a128385f6c3d None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:18.202946 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfffa77-4c05-4731-9771-a128385f6c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:18.273545 dv-cinder-862679-1-smb devstack@keystone.service[81622]: INFO dbcounter [None req-fdfffa77-4c05-4731-9771-a128385f6c3d None None] Registered counter for database keystone Oct 26 10:49:18.295838 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG oslo_db.sqlalchemy.engines [None req-fdfffa77-4c05-4731-9771-a128385f6c3d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81622) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 10:49:18.302071 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writer thread running {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 10:49:18.480158 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG passlib.handlers.bcrypt [None req-fdfffa77-4c05-4731-9771-a128385f6c3d None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81622) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 26 10:49:18.480470 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG passlib.handlers.bcrypt [None req-fdfffa77-4c05-4731-9771-a128385f6c3d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81622) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 26 10:49:18.538742 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-fdfffa77-4c05-4731-9771-a128385f6c3d None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:49:18.540398 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-fdfffa77-4c05-4731-9771-a128385f6c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:49:18.676052 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 2/3] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:49:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 26 10:49:19.174601 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274bb80-1d7f-4dbd-88b3-40a48d2c924a None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:19.244193 dv-cinder-862679-1-smb devstack@keystone.service[81623]: INFO dbcounter [None req-d274bb80-1d7f-4dbd-88b3-40a48d2c924a None None] Registered counter for database keystone Oct 26 10:49:19.263091 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG oslo_db.sqlalchemy.engines [None req-d274bb80-1d7f-4dbd-88b3-40a48d2c924a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81623) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 10:49:19.269290 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writer thread running {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 10:49:19.388209 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274bb80-1d7f-4dbd-88b3-40a48d2c924a None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:19.392492 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601fa96-50a3-4dc5-8f5c-103f8fc9d13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:19.393119 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601fa96-50a3-4dc5-8f5c-103f8fc9d13f admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:19.393400 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601fa96-50a3-4dc5-8f5c-103f8fc9d13f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:19.393676 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601fa96-50a3-4dc5-8f5c-103f8fc9d13f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:19.401839 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601fa96-50a3-4dc5-8f5c-103f8fc9d13f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:19.453347 dv-cinder-862679-1-smb devstack@keystone.service[81623]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d601fa96-50a3-4dc5-8f5c-103f8fc9d13f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 26 10:49:19.453638 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601fa96-50a3-4dc5-8f5c-103f8fc9d13f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:19.462987 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 2/4] 10.222.0.45 () {58 vars in 1324 bytes} [Wed Oct 26 10:49:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 26 10:49:19.468954 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfffa77-4c05-4731-9771-a128385f6c3d None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:19.485920 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfffa77-4c05-4731-9771-a128385f6c3d None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:19.490240 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ab66a-0b80-4f55-b11a-00229d1a5c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:19.491343 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ab66a-0b80-4f55-b11a-00229d1a5c7f admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:19.491622 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ab66a-0b80-4f55-b11a-00229d1a5c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:19.491900 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ab66a-0b80-4f55-b11a-00229d1a5c7f admin admin] PATH_INFO: `/v3/projects/f4a9b4bb2dba420f8a4e538ebab67142` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:19.495662 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ab66a-0b80-4f55-b11a-00229d1a5c7f admin admin] RBAC: Authorizing `identity:get_project(project_id=f4a9b4bb2dba420f8a4e538ebab67142)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:19.546317 dv-cinder-862679-1-smb devstack@keystone.service[81622]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d26ab66a-0b80-4f55-b11a-00229d1a5c7f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 26 10:49:19.546661 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ab66a-0b80-4f55-b11a-00229d1a5c7f admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:19.551164 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 3/5] 10.222.0.45 () {56 vars in 1207 bytes} [Wed Oct 26 10:49:19 2022] GET /identity/v3/projects/f4a9b4bb2dba420f8a4e538ebab67142 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:21.660948 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d1fda-0d16-437f-b05e-7623ab8a0bd1 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:21.661438 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d1fda-0d16-437f-b05e-7623ab8a0bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:21.661438 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d1fda-0d16-437f-b05e-7623ab8a0bd1 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:21.665539 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 3/6] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:49:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:49:21.671416 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e632aba-7fb8-4d55-a892-2fb1cd6207a9 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:21.671851 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e632aba-7fb8-4d55-a892-2fb1cd6207a9 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:21.671973 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e632aba-7fb8-4d55-a892-2fb1cd6207a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:21.692342 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-6e632aba-7fb8-4d55-a892-2fb1cd6207a9 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:49:21.693862 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-6e632aba-7fb8-4d55-a892-2fb1cd6207a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:49:21.701621 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 4/7] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:49:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 26 10:49:21.966751 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d1fda-0d16-437f-b05e-7623ab8a0bd1 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:21.978771 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d1fda-0d16-437f-b05e-7623ab8a0bd1 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:21.983556 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6dceaf-763b-407d-b159-d8d3a3c3d2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:21.984189 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6dceaf-763b-407d-b159-d8d3a3c3d2f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:21.984474 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6dceaf-763b-407d-b159-d8d3a3c3d2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:21.984752 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6dceaf-763b-407d-b159-d8d3a3c3d2f6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:21.992307 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6dceaf-763b-407d-b159-d8d3a3c3d2f6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:21.994088 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6dceaf-763b-407d-b159-d8d3a3c3d2f6 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:22.002743 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 4/8] 10.222.0.45 () {58 vars in 1324 bytes} [Wed Oct 26 10:49:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 26 10:49:22.007842 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e632aba-7fb8-4d55-a892-2fb1cd6207a9 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:22.016877 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e632aba-7fb8-4d55-a892-2fb1cd6207a9 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:22.021151 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde58bf-dd6f-4e1b-811f-363c8cbac9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:22.021776 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde58bf-dd6f-4e1b-811f-363c8cbac9b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:22.022060 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde58bf-dd6f-4e1b-811f-363c8cbac9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:22.022335 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde58bf-dd6f-4e1b-811f-363c8cbac9b8 admin admin] PATH_INFO: `/v3/users/90057424199c4a248fcb33009a849d0d` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:22.023632 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbde58bf-dd6f-4e1b-811f-363c8cbac9b8 admin admin] RBAC: Authorizing `identity:get_user(user_id=90057424199c4a248fcb33009a849d0d)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:22.025465 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbde58bf-dd6f-4e1b-811f-363c8cbac9b8 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:22.026961 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 5/9] 10.222.0.45 () {56 vars in 1198 bytes} [Wed Oct 26 10:49:22 2022] GET /identity/v3/users/90057424199c4a248fcb33009a849d0d => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:49:24.196793 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaaca36-0526-45ad-bdcc-d61a03192e89 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:24.197327 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaaca36-0526-45ad-bdcc-d61a03192e89 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:24.197327 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaaca36-0526-45ad-bdcc-d61a03192e89 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:24.198681 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 5/10] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:49:24.203863 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cc413-0d2d-4fe3-98db-15d5eb48405f None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:24.204325 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cc413-0d2d-4fe3-98db-15d5eb48405f None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:24.204458 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cc413-0d2d-4fe3-98db-15d5eb48405f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:24.222687 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-db8cc413-0d2d-4fe3-98db-15d5eb48405f None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:49:24.223861 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-db8cc413-0d2d-4fe3-98db-15d5eb48405f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:49:24.264637 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb317c-f644-410c-83ed-3f58e7ca56bc None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:24.264921 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb317c-f644-410c-83ed-3f58e7ca56bc None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:24.265205 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb317c-f644-410c-83ed-3f58e7ca56bc None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:24.266531 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 6/11] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:49:24.271730 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13b8f1-1373-49df-9259-893a3bd24b38 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:24.272016 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13b8f1-1373-49df-9259-893a3bd24b38 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:24.272319 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13b8f1-1373-49df-9259-893a3bd24b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:24.306322 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 6/12] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:49:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:49:24.314936 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG passlib.handlers.bcrypt [None req-9b13b8f1-1373-49df-9259-893a3bd24b38 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81623) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 26 10:49:24.315336 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG passlib.handlers.bcrypt [None req-9b13b8f1-1373-49df-9259-893a3bd24b38 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81623) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 26 10:49:24.364693 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-9b13b8f1-1373-49df-9259-893a3bd24b38 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:49:24.366298 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9b13b8f1-1373-49df-9259-893a3bd24b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:49:24.463187 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 7/13] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:49:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:49:24.583520 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8cc413-0d2d-4fe3-98db-15d5eb48405f None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:24.609533 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:24.689688 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8cc413-0d2d-4fe3-98db-15d5eb48405f None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:24.723036 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f040737-719b-4068-b11b-5a49a6b6e700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:24.723613 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f040737-719b-4068-b11b-5a49a6b6e700 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:24.723900 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f040737-719b-4068-b11b-5a49a6b6e700 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:24.724215 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f040737-719b-4068-b11b-5a49a6b6e700 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:24.730886 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13b8f1-1373-49df-9259-893a3bd24b38 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:24.735365 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f040737-719b-4068-b11b-5a49a6b6e700 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:49:24.744261 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-7f040737-719b-4068-b11b-5a49a6b6e700 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:49:24.744261 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:49:24.744261 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:49:24.744261 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:49:24.744261 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:49:24.744261 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:49:24.744261 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:49:24.744261 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:49:24.744261 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:49:24.744261 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:49:24.744261 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:49:24.744261 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:49:24.744261 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:49:24.744261 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:49:24.744261 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:49:24.744261 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:49:24.745249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:49:24.745249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:49:24.745249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:49:24.745249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:49:24.745249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:49:24.745249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:49:24.745249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:49:24.745249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:49:24.745249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:49:24.745249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:49:24.745249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:49:24.745249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:49:24.745249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:49:24.745249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:49:24.745249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:49:24.745249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:49:24.746087 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:49:24.746087 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:49:24.746087 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:49:24.746087 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:49:24.746087 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:49:24.746087 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:49:24.746087 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:49:24.746087 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:49:24.746087 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:49:24.746087 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:49:24.746087 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:49:24.746087 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:49:24.746087 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 7/14] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 26 10:49:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:49:24.751121 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f040737-719b-4068-b11b-5a49a6b6e700 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:24.831319 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:24.833471 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13b8f1-1373-49df-9259-893a3bd24b38 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:24.835725 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:24.848979 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f040737-719b-4068-b11b-5a49a6b6e700 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:24.870012 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e74de-bd08-4f61-aa5b-890210d22338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:24.870893 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e74de-bd08-4f61-aa5b-890210d22338 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:24.871179 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e74de-bd08-4f61-aa5b-890210d22338 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:24.871458 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e74de-bd08-4f61-aa5b-890210d22338 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:24.872521 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e74de-bd08-4f61-aa5b-890210d22338 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:24.873974 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e74de-bd08-4f61-aa5b-890210d22338 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:24.883150 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df2ccc-2886-48a3-a5da-ef17782b2ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:24.883763 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df2ccc-2886-48a3-a5da-ef17782b2ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:24.884046 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df2ccc-2886-48a3-a5da-ef17782b2ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:24.884346 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df2ccc-2886-48a3-a5da-ef17782b2ac5 None admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:24.885008 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df2ccc-2886-48a3-a5da-ef17782b2ac5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:49:24.885311 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df2ccc-2886-48a3-a5da-ef17782b2ac5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:24.886684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df2ccc-2886-48a3-a5da-ef17782b2ac5 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:24.898735 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 8/15] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 26 10:49:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:24.904948 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df2ccc-2886-48a3-a5da-ef17782b2ac5 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:24.934588 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.sql.core [None req-377e74de-bd08-4f61-aa5b-890210d22338 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 26 10:49:24.934588 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 26 10:49:24.934588 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [parameters: {'id': '39b7dcafba6f4bfb978f039129612940', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 26 10:49:24.934588 dv-cinder-862679-1-smb devstack@keystone.service[81623]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81623) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 26 10:49:24.953834 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-377e74de-bd08-4f61-aa5b-890210d22338 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 26 10:49:24.953834 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:49:24.953834 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 26 10:49:24.953834 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 26 10:49:24.953834 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 26 10:49:24.953834 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 26 10:49:24.953834 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 26 10:49:24.953834 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application result = self._query(query) Oct 26 10:49:24.953834 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 26 10:49:24.953834 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application conn.query(q) Oct 26 10:49:24.953834 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 26 10:49:24.953834 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 26 10:49:24.953834 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 26 10:49:24.953834 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application result.read() Oct 26 10:49:24.954655 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 26 10:49:24.954655 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 26 10:49:24.954655 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 26 10:49:24.954655 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 26 10:49:24.954655 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 26 10:49:24.954655 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 26 10:49:24.954655 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 26 10:49:24.954655 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 26 10:49:24.954655 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 26 10:49:24.954655 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:49:24.954655 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 26 10:49:24.954655 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:49:24.954655 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:49:24.954655 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 26 10:49:24.954655 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 26 10:49:24.954655 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 26 10:49:24.954655 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 26 10:49:24.954655 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 26 10:49:24.955537 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application next(self.gen) Oct 26 10:49:24.955537 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 26 10:49:24.955537 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application yield resource Oct 26 10:49:24.955537 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 26 10:49:24.955537 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application next(self.gen) Oct 26 10:49:24.955537 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 26 10:49:24.955537 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.session.rollback() Oct 26 10:49:24.955537 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 10:49:24.955537 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.force_reraise() Oct 26 10:49:24.955537 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 10:49:24.955537 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise self.value Oct 26 10:49:24.955537 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 26 10:49:24.955537 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 26 10:49:24.955537 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 26 10:49:24.955537 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application session.commit() Oct 26 10:49:24.955537 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 26 10:49:24.955537 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 26 10:49:24.956423 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 26 10:49:24.956423 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._prepare_impl() Oct 26 10:49:24.956423 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 26 10:49:24.956423 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.session.flush() Oct 26 10:49:24.956423 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 26 10:49:24.956423 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._flush(objects) Oct 26 10:49:24.956423 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 26 10:49:24.956423 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 26 10:49:24.956423 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 26 10:49:24.956423 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application compat.raise_( Oct 26 10:49:24.956423 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 26 10:49:24.956423 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception Oct 26 10:49:24.956423 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 26 10:49:24.956423 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application flush_context.execute() Oct 26 10:49:24.956423 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 26 10:49:24.956423 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rec.execute(self) Oct 26 10:49:24.956423 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 26 10:49:24.957403 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 26 10:49:24.957403 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 26 10:49:24.957403 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 26 10:49:24.957403 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 26 10:49:24.957403 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 26 10:49:24.957403 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 26 10:49:24.957403 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 26 10:49:24.957403 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 26 10:49:24.957403 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 26 10:49:24.957403 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 26 10:49:24.957403 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 26 10:49:24.957403 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 26 10:49:24.957403 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 26 10:49:24.957403 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 26 10:49:24.957403 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 26 10:49:24.958175 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 26 10:49:24.958175 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception Oct 26 10:49:24.958175 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 26 10:49:24.958175 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 26 10:49:24.958175 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 26 10:49:24.958175 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 26 10:49:24.958175 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 26 10:49:24.958175 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application result = self._query(query) Oct 26 10:49:24.958175 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 26 10:49:24.958175 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application conn.query(q) Oct 26 10:49:24.958175 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 26 10:49:24.958175 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 26 10:49:24.958175 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 26 10:49:24.958175 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application result.read() Oct 26 10:49:24.958175 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 26 10:49:24.958175 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 26 10:49:24.958175 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 26 10:49:24.958983 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 26 10:49:24.958983 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 26 10:49:24.958983 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 26 10:49:24.958983 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 26 10:49:24.958983 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 26 10:49:24.958983 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 26 10:49:24.958983 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 26 10:49:24.958983 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [parameters: {'id': '39b7dcafba6f4bfb978f039129612940', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 26 10:49:24.958983 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 26 10:49:24.958983 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:49:24.958983 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:49:24.958983 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:49:24.958983 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:49:24.958983 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 26 10:49:24.958983 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 26 10:49:24.959727 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 26 10:49:24.959727 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 26 10:49:24.959727 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 26 10:49:24.959727 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:49:24.959727 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:49:24.959727 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:49:24.959727 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:49:24.959727 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:49:24.959727 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:49:24.959727 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:49:24.959727 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:49:24.959727 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:49:24.959727 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:49:24.959727 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:49:24.959727 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:49:24.959727 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:49:24.959727 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:49:24.961303 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 26 10:49:24.961303 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 26 10:49:24.961303 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:49:24.961303 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:49:24.961303 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 26 10:49:24.961303 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 26 10:49:24.961303 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:49:24.961303 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:49:24.961303 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 26 10:49:24.961303 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 26 10:49:24.961303 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 26 10:49:24.961303 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:49:24.961303 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 8/16] 10.222.0.45 () {60 vars in 1137 bytes} [Wed Oct 26 10:49:24 2022] POST /identity/v3/domains => generated 190 bytes in 225 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:49:24.962069 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e74de-bd08-4f61-aa5b-890210d22338 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:25.005406 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df2ccc-2886-48a3-a5da-ef17782b2ac5 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:25.039026 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21452880-5cdf-45f1-8f1c-718810165b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:25.039658 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21452880-5cdf-45f1-8f1c-718810165b0f None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:25.039940 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21452880-5cdf-45f1-8f1c-718810165b0f None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:25.040244 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21452880-5cdf-45f1-8f1c-718810165b0f None admin] PATH_INFO: `/v3/users/90057424199c4a248fcb33009a849d0d` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:25.041365 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21452880-5cdf-45f1-8f1c-718810165b0f None admin] RBAC: Authorizing `identity:get_user(user_id=90057424199c4a248fcb33009a849d0d)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:25.042807 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21452880-5cdf-45f1-8f1c-718810165b0f None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:25.044412 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 9/17] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 26 10:49:24 2022] GET /identity/v3/users/90057424199c4a248fcb33009a849d0d => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:49:25.049767 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21452880-5cdf-45f1-8f1c-718810165b0f None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:25.065627 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:25.065764 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e74de-bd08-4f61-aa5b-890210d22338 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:25.099374 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a5615-fe98-4227-b5db-15734572e2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:25.100261 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a5615-fe98-4227-b5db-15734572e2e2 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:25.100540 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a5615-fe98-4227-b5db-15734572e2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:25.100806 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a5615-fe98-4227-b5db-15734572e2e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:25.118353 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3a5615-fe98-4227-b5db-15734572e2e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:25.119824 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3a5615-fe98-4227-b5db-15734572e2e2 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:25.141583 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-2b3a5615-fe98-4227-b5db-15734572e2e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:49:25.141583 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:49:25.141583 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:49:25.141583 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:49:25.141583 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:49:25.141583 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:49:25.141583 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:49:25.141583 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:49:25.141583 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:49:25.141583 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:49:25.141583 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:49:25.141583 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:49:25.141583 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:49:25.141583 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:49:25.141583 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:49:25.141583 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:49:25.142498 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:49:25.142498 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:49:25.142498 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:49:25.142498 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:49:25.142498 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:49:25.142498 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:49:25.142498 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:49:25.142498 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:49:25.142498 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:49:25.142498 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:49:25.142498 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:49:25.142498 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:49:25.142498 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:49:25.142498 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:49:25.142498 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:49:25.142498 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:49:25.142498 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:49:25.143311 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:49:25.143311 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:49:25.143311 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:49:25.143311 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 9/18] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:49:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:49:25.148567 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a5615-fe98-4227-b5db-15734572e2e2 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:25.150711 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21452880-5cdf-45f1-8f1c-718810165b0f None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:25.169784 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:25.183455 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b680bf-ae02-4c5d-afa2-0ac73103a4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:25.185843 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b680bf-ae02-4c5d-afa2-0ac73103a4e1 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:25.185843 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b680bf-ae02-4c5d-afa2-0ac73103a4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:25.185843 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b680bf-ae02-4c5d-afa2-0ac73103a4e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:25.186270 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b680bf-ae02-4c5d-afa2-0ac73103a4e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:25.187771 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b680bf-ae02-4c5d-afa2-0ac73103a4e1 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:25.189354 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 10/19] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:49:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:49:25.194933 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b680bf-ae02-4c5d-afa2-0ac73103a4e1 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:25.248621 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a5615-fe98-4227-b5db-15734572e2e2 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:25.274267 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:25.282014 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a85f7f-3cc0-417a-98c1-861ed7b822b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:25.282886 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a85f7f-3cc0-417a-98c1-861ed7b822b6 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:25.283173 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a85f7f-3cc0-417a-98c1-861ed7b822b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:25.283459 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a85f7f-3cc0-417a-98c1-861ed7b822b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:25.287348 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a85f7f-3cc0-417a-98c1-861ed7b822b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:49:25.287348 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a85f7f-3cc0-417a-98c1-861ed7b822b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:25.287348 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a85f7f-3cc0-417a-98c1-861ed7b822b6 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:25.293813 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b680bf-ae02-4c5d-afa2-0ac73103a4e1 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:25.303110 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 10/20] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:49:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:49:25.330617 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a38e6d0-fb3c-43e3-abd2-334a54001bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:25.331326 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38e6d0-fb3c-43e3-abd2-334a54001bd7 None admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:25.331614 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38e6d0-fb3c-43e3-abd2-334a54001bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:25.331897 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38e6d0-fb3c-43e3-abd2-334a54001bd7 None admin] PATH_INFO: `/v3/domains/default/users/90057424199c4a248fcb33009a849d0d/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:25.334038 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a38e6d0-fb3c-43e3-abd2-334a54001bd7 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=90057424199c4a248fcb33009a849d0d, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:25.335515 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a38e6d0-fb3c-43e3-abd2-334a54001bd7 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:25.544288 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 11/21] 10.222.0.45 () {58 vars in 1361 bytes} [Wed Oct 26 10:49:25 2022] PUT /identity/v3/domains/default/users/90057424199c4a248fcb33009a849d0d/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 10:49:27.913973 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdd826-57be-46b4-b02f-41a4a6deeb35 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:27.914507 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdd826-57be-46b4-b02f-41a4a6deeb35 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:27.914507 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdd826-57be-46b4-b02f-41a4a6deeb35 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:27.916086 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 11/22] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:49:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:49:27.922218 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761298e1-b760-419c-9871-10c7f2833056 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:27.922622 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761298e1-b760-419c-9871-10c7f2833056 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:27.922800 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761298e1-b760-419c-9871-10c7f2833056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:27.950530 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-761298e1-b760-419c-9871-10c7f2833056 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:49:27.954057 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-761298e1-b760-419c-9871-10c7f2833056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:49:27.998743 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cf27c-930a-4f1d-bd48-962867eb4946 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:27.999442 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cf27c-930a-4f1d-bd48-962867eb4946 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:28.000014 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cf27c-930a-4f1d-bd48-962867eb4946 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:28.001870 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 12/23] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:49:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:49:28.012766 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92a26b-30ea-41cb-9991-17fae1f248f2 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:28.013062 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92a26b-30ea-41cb-9991-17fae1f248f2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:28.013350 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92a26b-30ea-41cb-9991-17fae1f248f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:28.053157 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-0a92a26b-30ea-41cb-9991-17fae1f248f2 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:49:28.054396 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0a92a26b-30ea-41cb-9991-17fae1f248f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:49:28.061877 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 12/24] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:49:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:49:28.100667 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25420ac3-e157-402c-a3a0-454f735a3b38 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:28.100950 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25420ac3-e157-402c-a3a0-454f735a3b38 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:28.101235 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25420ac3-e157-402c-a3a0-454f735a3b38 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:28.105374 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 13/25] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:49:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:49:28.114232 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32741011-eaf5-491c-9ee9-4deb5b956563 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:28.114232 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32741011-eaf5-491c-9ee9-4deb5b956563 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:28.114232 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32741011-eaf5-491c-9ee9-4deb5b956563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:28.132155 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-32741011-eaf5-491c-9ee9-4deb5b956563 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:49:28.134074 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-32741011-eaf5-491c-9ee9-4deb5b956563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:49:28.182371 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 13/26] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:49:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:49:28.207017 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:28.212053 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 14/27] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:49:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:49:28.457820 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92a26b-30ea-41cb-9991-17fae1f248f2 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:28.470996 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:28.581400 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32741011-eaf5-491c-9ee9-4deb5b956563 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:28.590353 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92a26b-30ea-41cb-9991-17fae1f248f2 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:28.654514 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6dbcc-e18b-428f-b3e1-d0b08c13d9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:28.655599 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6dbcc-e18b-428f-b3e1-d0b08c13d9a6 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:28.656107 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6dbcc-e18b-428f-b3e1-d0b08c13d9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:28.656621 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6dbcc-e18b-428f-b3e1-d0b08c13d9a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:28.677502 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6dbcc-e18b-428f-b3e1-d0b08c13d9a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:28.679318 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6dbcc-e18b-428f-b3e1-d0b08c13d9a6 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:28.704452 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-39e6dbcc-e18b-428f-b3e1-d0b08c13d9a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:49:28.704452 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:49:28.704452 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:49:28.704452 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:49:28.704452 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:49:28.704452 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:49:28.704452 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:49:28.704452 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:49:28.704452 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:49:28.704452 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:49:28.704452 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:49:28.704452 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:49:28.704452 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:49:28.704452 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:49:28.704452 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:49:28.704452 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:49:28.705348 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:49:28.705348 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:49:28.705348 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:49:28.705348 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:49:28.705348 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:49:28.705348 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:49:28.705348 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:49:28.705348 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:49:28.705348 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:49:28.705348 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:49:28.705348 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:49:28.705348 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:49:28.705348 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:49:28.705348 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:49:28.705348 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:49:28.705348 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:49:28.705348 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:49:28.706159 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:49:28.706159 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:49:28.706159 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:49:28.708358 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 14/28] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:49:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:49:28.714569 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6dbcc-e18b-428f-b3e1-d0b08c13d9a6 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:28.786352 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32741011-eaf5-491c-9ee9-4deb5b956563 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:28.827174 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:28.869242 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6dbcc-e18b-428f-b3e1-d0b08c13d9a6 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:28.873745 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894e85d-1af3-4cf8-9049-32509bed9aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:28.874387 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894e85d-1af3-4cf8-9049-32509bed9aed None admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:28.874676 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894e85d-1af3-4cf8-9049-32509bed9aed None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:28.874954 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894e85d-1af3-4cf8-9049-32509bed9aed None admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:28.875652 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8894e85d-1af3-4cf8-9049-32509bed9aed None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:28.877217 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8894e85d-1af3-4cf8-9049-32509bed9aed None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:28.908247 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc74223-a584-4f6c-bbd4-fb7c13a4aa4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:28.909279 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc74223-a584-4f6c-bbd4-fb7c13a4aa4b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:28.909752 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc74223-a584-4f6c-bbd4-fb7c13a4aa4b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:28.910215 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc74223-a584-4f6c-bbd4-fb7c13a4aa4b None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:28.911151 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc74223-a584-4f6c-bbd4-fb7c13a4aa4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:49:28.911648 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc74223-a584-4f6c-bbd4-fb7c13a4aa4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:28.913361 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc74223-a584-4f6c-bbd4-fb7c13a4aa4b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:28.925818 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 15/29] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:49:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:28.927524 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc74223-a584-4f6c-bbd4-fb7c13a4aa4b None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:28.998527 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 15/30] 10.222.0.45 () {60 vars in 1131 bytes} [Wed Oct 26 10:49:28 2022] POST /identity/v3/roles => generated 219 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 10:49:29.009850 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894e85d-1af3-4cf8-9049-32509bed9aed None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:29.045526 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc74223-a584-4f6c-bbd4-fb7c13a4aa4b None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:29.076958 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:29.088834 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca4911-e1e6-4516-8de3-46f52fac51f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:29.089854 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca4911-e1e6-4516-8de3-46f52fac51f9 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:29.090346 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca4911-e1e6-4516-8de3-46f52fac51f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:29.090869 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca4911-e1e6-4516-8de3-46f52fac51f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:29.112419 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:29.114214 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca4911-e1e6-4516-8de3-46f52fac51f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:49:29.120948 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-deca4911-e1e6-4516-8de3-46f52fac51f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:49:29.120948 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:49:29.120948 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:49:29.120948 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:49:29.120948 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:49:29.120948 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:49:29.120948 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:49:29.120948 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:49:29.120948 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:49:29.120948 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:49:29.120948 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:49:29.120948 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:49:29.120948 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:49:29.120948 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:49:29.120948 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:49:29.120948 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:49:29.121875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:49:29.121875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:49:29.121875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:49:29.121875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:49:29.121875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:49:29.121875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:49:29.121875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:49:29.121875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:49:29.121875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:49:29.121875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:49:29.121875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:49:29.121875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:49:29.121875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:49:29.121875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:49:29.121875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:49:29.121875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:49:29.122636 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:49:29.122636 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:49:29.122636 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:49:29.122636 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:49:29.122636 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:49:29.122636 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:49:29.122636 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:49:29.122636 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:49:29.122636 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:49:29.122636 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:49:29.122636 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:49:29.122636 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:49:29.125561 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 16/31] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 26 10:49:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:49:29.127058 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a139514-69b8-43fa-aa9f-5a80a10fb857 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:29.127857 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a139514-69b8-43fa-aa9f-5a80a10fb857 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:29.128347 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a139514-69b8-43fa-aa9f-5a80a10fb857 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:29.130109 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 17/32] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:49:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:49:29.135836 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a139514-69b8-43fa-aa9f-5a80a10fb857 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:29.193975 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894e85d-1af3-4cf8-9049-32509bed9aed None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:29.246067 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a139514-69b8-43fa-aa9f-5a80a10fb857 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:29.264202 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27366a6e-9b56-4106-9649-2a766c28d0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:29.264762 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27366a6e-9b56-4106-9649-2a766c28d0da None admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:29.265045 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27366a6e-9b56-4106-9649-2a766c28d0da None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:29.265320 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27366a6e-9b56-4106-9649-2a766c28d0da None admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:29.265987 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27366a6e-9b56-4106-9649-2a766c28d0da None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:29.267572 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27366a6e-9b56-4106-9649-2a766c28d0da None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:29.285908 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10bd514-63d6-4aa7-a620-ab5fcce5d1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:29.286934 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bd514-63d6-4aa7-a620-ab5fcce5d1b9 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:29.287431 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bd514-63d6-4aa7-a620-ab5fcce5d1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:29.287949 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bd514-63d6-4aa7-a620-ab5fcce5d1b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:29.288871 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10bd514-63d6-4aa7-a620-ab5fcce5d1b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:49:29.289373 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10bd514-63d6-4aa7-a620-ab5fcce5d1b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:29.291181 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10bd514-63d6-4aa7-a620-ab5fcce5d1b9 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:29.306530 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 18/33] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 26 10:49:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:29.308313 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d7fab-4476-4859-a0f8-78aa54e78f2a None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:29.308825 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d7fab-4476-4859-a0f8-78aa54e78f2a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:29.309293 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d7fab-4476-4859-a0f8-78aa54e78f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:29.331162 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-5e8d7fab-4476-4859-a0f8-78aa54e78f2a None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:49:29.336240 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5e8d7fab-4476-4859-a0f8-78aa54e78f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:49:29.382243 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:29.411053 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 19/34] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:49:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:49:29.411726 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d7fab-4476-4859-a0f8-78aa54e78f2a None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:29.449176 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 16/35] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Oct 26 10:49:28 2022] POST /identity/v3/projects => generated 301 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:49:29.456739 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5621e-49e4-48b5-b7f0-13870623e033 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:29.457028 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5621e-49e4-48b5-b7f0-13870623e033 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:29.457305 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5621e-49e4-48b5-b7f0-13870623e033 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:29.458684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 17/36] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:49:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:49:29.473919 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f91291-83f9-4fa0-94ac-c4c03d49b87f None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:29.474214 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f91291-83f9-4fa0-94ac-c4c03d49b87f None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:29.474502 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f91291-83f9-4fa0-94ac-c4c03d49b87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:29.513569 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-b1f91291-83f9-4fa0-94ac-c4c03d49b87f None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:49:29.517234 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-b1f91291-83f9-4fa0-94ac-c4c03d49b87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:49:29.595606 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d7fab-4476-4859-a0f8-78aa54e78f2a None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:29.638260 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3e7a2-4669-4bb9-a107-d3b4a675b884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:29.639388 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3e7a2-4669-4bb9-a107-d3b4a675b884 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:29.639892 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3e7a2-4669-4bb9-a107-d3b4a675b884 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:29.640290 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 18/37] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:49:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:49:29.644422 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5bb1b-bdb6-4cd9-9feb-493666db7fe3 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:29.644422 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5bb1b-bdb6-4cd9-9feb-493666db7fe3 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:29.644422 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5bb1b-bdb6-4cd9-9feb-493666db7fe3 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:29.644422 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 19/38] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:49:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:49:29.644722 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3e7a2-4669-4bb9-a107-d3b4a675b884 None admin] PATH_INFO: `/v3/users/90057424199c4a248fcb33009a849d0d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:29.653421 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3e7a2-4669-4bb9-a107-d3b4a675b884 None admin] RBAC: Authorizing `identity:get_user(user_id=90057424199c4a248fcb33009a849d0d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:29.653421 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3e7a2-4669-4bb9-a107-d3b4a675b884 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:29.655573 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 20/39] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 26 10:49:29 2022] GET /identity/v3/users/90057424199c4a248fcb33009a849d0d => generated 247 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:29.656304 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac15ca-0dea-4bfb-b52b-aceb83b3d127 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:29.656790 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac15ca-0dea-4bfb-b52b-aceb83b3d127 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:29.657251 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac15ca-0dea-4bfb-b52b-aceb83b3d127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:29.661239 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3e7a2-4669-4bb9-a107-d3b4a675b884 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:29.682700 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-3dac15ca-0dea-4bfb-b52b-aceb83b3d127 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:49:29.683918 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-3dac15ca-0dea-4bfb-b52b-aceb83b3d127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:49:29.716098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:29.726006 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:29.765335 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 20/40] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:49:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:49:29.765965 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac15ca-0dea-4bfb-b52b-aceb83b3d127 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:29.799301 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3e7a2-4669-4bb9-a107-d3b4a675b884 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:29.846442 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646eab0-e501-4f35-bc63-20697694753c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:29.847318 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646eab0-e501-4f35-bc63-20697694753c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:29.848222 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646eab0-e501-4f35-bc63-20697694753c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:29.848649 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646eab0-e501-4f35-bc63-20697694753c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:29.850273 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4646eab0-e501-4f35-bc63-20697694753c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:29.851929 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4646eab0-e501-4f35-bc63-20697694753c None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:29.853868 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 21/41] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:49:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:29.863485 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646eab0-e501-4f35-bc63-20697694753c None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:29.910708 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac15ca-0dea-4bfb-b52b-aceb83b3d127 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:29.948687 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87faf826-b44e-474b-af7c-92f67ff55972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:29.949309 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87faf826-b44e-474b-af7c-92f67ff55972 None admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:29.949657 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87faf826-b44e-474b-af7c-92f67ff55972 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:29.949943 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87faf826-b44e-474b-af7c-92f67ff55972 None admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:29.950615 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87faf826-b44e-474b-af7c-92f67ff55972 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:29.952035 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87faf826-b44e-474b-af7c-92f67ff55972 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:29.974375 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646eab0-e501-4f35-bc63-20697694753c None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:29.985086 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:30.007828 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b7d01-1609-4f99-995f-137825b5d704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:30.008477 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b7d01-1609-4f99-995f-137825b5d704 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:30.008766 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b7d01-1609-4f99-995f-137825b5d704 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:30.009069 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b7d01-1609-4f99-995f-137825b5d704 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:30.009892 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b7d01-1609-4f99-995f-137825b5d704 None admin] RBAC: Adding query filter params (role.id=d6876897d7c548b7900d4e01cb45a007, scope.domain.id=default, user.id=90057424199c4a248fcb33009a849d0d) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:49:30.010209 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b7d01-1609-4f99-995f-137825b5d704 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:30.011654 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b7d01-1609-4f99-995f-137825b5d704 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:30.020820 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 22/42] 10.222.0.45 () {56 vars in 1322 bytes} [Wed Oct 26 10:49:29 2022] GET /identity/v3/role_assignments?user.id=90057424199c4a248fcb33009a849d0d&scope.domain.id=default&role.id=d6876897d7c548b7900d4e01cb45a007 => generated 530 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:30.021412 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b7d01-1609-4f99-995f-137825b5d704 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:30.038441 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 21/43] 10.222.0.45 () {60 vars in 1131 bytes} [Wed Oct 26 10:49:29 2022] POST /identity/v3/roles => generated 225 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:49:30.042187 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87faf826-b44e-474b-af7c-92f67ff55972 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:30.085174 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:30.162719 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b7d01-1609-4f99-995f-137825b5d704 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:30.214689 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85ae91-d9dc-4a7a-a782-52039bcf8d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:30.215810 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85ae91-d9dc-4a7a-a782-52039bcf8d6a None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:30.216381 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85ae91-d9dc-4a7a-a782-52039bcf8d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:30.217666 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85ae91-d9dc-4a7a-a782-52039bcf8d6a None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:30.218677 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85ae91-d9dc-4a7a-a782-52039bcf8d6a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:30.220712 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85ae91-d9dc-4a7a-a782-52039bcf8d6a None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:30.299644 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87faf826-b44e-474b-af7c-92f67ff55972 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:30.338824 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7e5db-c92f-498e-a198-c771367f305d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:30.338824 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7e5db-c92f-498e-a198-c771367f305d None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:30.338824 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7e5db-c92f-498e-a198-c771367f305d None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:30.338824 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7e5db-c92f-498e-a198-c771367f305d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:30.339181 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db7e5db-c92f-498e-a198-c771367f305d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:30.339472 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db7e5db-c92f-498e-a198-c771367f305d None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:30.341082 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 22/44] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:49:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:49:30.347232 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7e5db-c92f-498e-a198-c771367f305d None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:30.442087 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 23/45] 10.222.0.45 () {60 vars in 1131 bytes} [Wed Oct 26 10:49:30 2022] POST /identity/v3/roles => generated 223 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:49:30.443990 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:30.446785 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7e5db-c92f-498e-a198-c771367f305d None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:30.484750 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b4895-1d2f-417a-8271-6dd9565b2a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:30.485383 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b4895-1d2f-417a-8271-6dd9565b2a18 None admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:30.485671 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b4895-1d2f-417a-8271-6dd9565b2a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:30.485950 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b4895-1d2f-417a-8271-6dd9565b2a18 None admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:30.486625 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b4895-1d2f-417a-8271-6dd9565b2a18 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:30.488124 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b4895-1d2f-417a-8271-6dd9565b2a18 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:30.577748 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 23/46] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Oct 26 10:49:30 2022] POST /identity/v3/projects => generated 312 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 10:49:32.718341 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632381e-dc63-420e-aee7-55297f703010 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:32.718843 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632381e-dc63-420e-aee7-55297f703010 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:32.718843 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632381e-dc63-420e-aee7-55297f703010 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:32.720208 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 24/47] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:49:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:49:32.725404 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0258fce-d949-4a33-b382-24851a49c17a None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:32.725829 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0258fce-d949-4a33-b382-24851a49c17a None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:32.725970 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0258fce-d949-4a33-b382-24851a49c17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:32.743841 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-d0258fce-d949-4a33-b382-24851a49c17a None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:49:32.745068 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-d0258fce-d949-4a33-b382-24851a49c17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:49:32.812943 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 24/48] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:49:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:49:33.080785 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8632381e-dc63-420e-aee7-55297f703010 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:33.220275 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:33.286436 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8632381e-dc63-420e-aee7-55297f703010 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:33.320074 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22901eed-78cb-4031-a5c1-1e10915f545b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:33.320718 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22901eed-78cb-4031-a5c1-1e10915f545b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:33.321007 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22901eed-78cb-4031-a5c1-1e10915f545b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:33.321287 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22901eed-78cb-4031-a5c1-1e10915f545b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:33.322496 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22901eed-78cb-4031-a5c1-1e10915f545b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:33.324089 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22901eed-78cb-4031-a5c1-1e10915f545b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:33.325655 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 25/49] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:49:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:33.331887 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0258fce-d949-4a33-b382-24851a49c17a None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:33.410712 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:33.427880 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0258fce-d949-4a33-b382-24851a49c17a None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:33.461722 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0767b154-406c-49df-8be3-ac1b02caa3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:33.462329 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767b154-406c-49df-8be3-ac1b02caa3be None admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:33.462615 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767b154-406c-49df-8be3-ac1b02caa3be None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:33.462893 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767b154-406c-49df-8be3-ac1b02caa3be None admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:33.463560 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0767b154-406c-49df-8be3-ac1b02caa3be None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:33.465022 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0767b154-406c-49df-8be3-ac1b02caa3be None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:33.544871 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 25/50] 10.222.0.45 () {60 vars in 1140 bytes} [Wed Oct 26 10:49:33 2022] POST /identity/v3/projects => generated 298 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:49:35.657253 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c347a83-aa6d-41c0-8501-9aa3fb79cda5 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:35.657740 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c347a83-aa6d-41c0-8501-9aa3fb79cda5 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:35.657740 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c347a83-aa6d-41c0-8501-9aa3fb79cda5 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:35.659325 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 26/51] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:49:35.664505 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddccffa-b61e-4cd1-a107-ce8e883568b3 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:35.664933 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddccffa-b61e-4cd1-a107-ce8e883568b3 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:35.665064 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddccffa-b61e-4cd1-a107-ce8e883568b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:35.683277 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-bddccffa-b61e-4cd1-a107-ce8e883568b3 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:49:35.684485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-bddccffa-b61e-4cd1-a107-ce8e883568b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:49:35.747480 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 26/52] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:49:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:49:36.016161 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c347a83-aa6d-41c0-8501-9aa3fb79cda5 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:36.114396 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c347a83-aa6d-41c0-8501-9aa3fb79cda5 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:36.115870 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:36.147539 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15214a7-1fa4-45a1-8d20-bc5e1f39bc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:36.148193 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15214a7-1fa4-45a1-8d20-bc5e1f39bc25 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:36.148481 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15214a7-1fa4-45a1-8d20-bc5e1f39bc25 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:36.148760 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15214a7-1fa4-45a1-8d20-bc5e1f39bc25 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:36.149864 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15214a7-1fa4-45a1-8d20-bc5e1f39bc25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:36.151328 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15214a7-1fa4-45a1-8d20-bc5e1f39bc25 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:36.152907 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 27/53] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:49:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:36.159163 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddccffa-b61e-4cd1-a107-ce8e883568b3 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:36.219026 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:36.256203 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddccffa-b61e-4cd1-a107-ce8e883568b3 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:36.289787 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f0baef-714b-4543-a323-6f7c9005a385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:36.290399 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0baef-714b-4543-a323-6f7c9005a385 None admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:36.290690 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0baef-714b-4543-a323-6f7c9005a385 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:36.290974 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0baef-714b-4543-a323-6f7c9005a385 None admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:36.291644 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f0baef-714b-4543-a323-6f7c9005a385 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:36.293117 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f0baef-714b-4543-a323-6f7c9005a385 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:36.381968 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 27/54] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Oct 26 10:49:36 2022] POST /identity/v3/users => generated 275 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:49:39.453536 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b03ab-4386-4ecb-aabf-90ea1ccb1054 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:39.454572 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b03ab-4386-4ecb-aabf-90ea1ccb1054 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:39.455082 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b03ab-4386-4ecb-aabf-90ea1ccb1054 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:39.456708 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 28/55] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:49:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:49:39.462276 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbb77c-7b67-422c-b3b9-33bc4e10f624 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:39.463124 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbb77c-7b67-422c-b3b9-33bc4e10f624 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:39.463641 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbb77c-7b67-422c-b3b9-33bc4e10f624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:39.488992 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-fabbb77c-7b67-422c-b3b9-33bc4e10f624 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:49:39.490544 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-fabbb77c-7b67-422c-b3b9-33bc4e10f624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:49:39.576091 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 28/56] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:49:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:49:39.799811 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8ae16-b5e9-4067-9f48-f756f27303e1 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:39.800518 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8ae16-b5e9-4067-9f48-f756f27303e1 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:39.801008 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8ae16-b5e9-4067-9f48-f756f27303e1 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:39.802566 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 29/57] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:49:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:49:39.807833 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4a4b1-13a0-421f-944e-964ace3048fe None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:39.808357 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4a4b1-13a0-421f-944e-964ace3048fe None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:39.808843 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4a4b1-13a0-421f-944e-964ace3048fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:39.834301 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-74e4a4b1-13a0-421f-944e-964ace3048fe None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:49:39.835809 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-74e4a4b1-13a0-421f-944e-964ace3048fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:49:39.887708 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d21c93-45a3-4583-b561-0c8e82b23c8d None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:39.888365 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d21c93-45a3-4583-b561-0c8e82b23c8d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:39.888845 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d21c93-45a3-4583-b561-0c8e82b23c8d None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:39.891160 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 30/58] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:49:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:49:39.896289 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338f103-8fad-4af1-bda3-3998e50a3e36 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:39.896812 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338f103-8fad-4af1-bda3-3998e50a3e36 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:39.897289 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338f103-8fad-4af1-bda3-3998e50a3e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:39.901392 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:39.919149 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-5338f103-8fad-4af1-bda3-3998e50a3e36 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:49:39.922311 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5338f103-8fad-4af1-bda3-3998e50a3e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:49:39.926652 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 29/59] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:49:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:49:39.927641 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e4a4b1-13a0-421f-944e-964ace3048fe None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:40.021214 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 31/60] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:49:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:49:40.077166 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e484e2-3b14-4482-b437-3158d5e76696 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:40.077820 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e484e2-3b14-4482-b437-3158d5e76696 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:40.078314 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e484e2-3b14-4482-b437-3158d5e76696 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:40.079899 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 32/61] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:49:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:49:40.084757 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7c7b2-de67-4a97-bf1d-5b60d05398a0 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:40.085260 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7c7b2-de67-4a97-bf1d-5b60d05398a0 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:40.085735 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7c7b2-de67-4a97-bf1d-5b60d05398a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:40.095815 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e4a4b1-13a0-421f-944e-964ace3048fe None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:40.125614 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-3bb7c7b2-de67-4a97-bf1d-5b60d05398a0 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:49:40.126816 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3bb7c7b2-de67-4a97-bf1d-5b60d05398a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:49:40.139399 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a6b68-0298-4b58-a891-3a7b2e33cb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:40.140455 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a6b68-0298-4b58-a891-3a7b2e33cb70 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:40.140939 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a6b68-0298-4b58-a891-3a7b2e33cb70 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:40.141462 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a6b68-0298-4b58-a891-3a7b2e33cb70 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:40.152975 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a6b68-0298-4b58-a891-3a7b2e33cb70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:49:40.158905 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-bf5a6b68-0298-4b58-a891-3a7b2e33cb70 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:49:40.158905 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:49:40.158905 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:49:40.158905 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:49:40.158905 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:49:40.158905 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:49:40.158905 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:49:40.158905 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:49:40.158905 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:49:40.158905 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:49:40.158905 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:49:40.158905 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:49:40.158905 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:49:40.158905 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:49:40.158905 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:49:40.158905 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:49:40.160030 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:49:40.160030 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:49:40.160030 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:49:40.160030 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:49:40.160030 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:49:40.160030 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:49:40.160030 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:49:40.160030 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:49:40.160030 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:49:40.160030 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:49:40.160030 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:49:40.160030 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:49:40.160030 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:49:40.160030 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:49:40.160030 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:49:40.160030 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:49:40.160926 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:49:40.160926 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:49:40.160926 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:49:40.160926 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:49:40.160926 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:49:40.160926 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:49:40.160926 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:49:40.160926 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:49:40.160926 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:49:40.160926 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:49:40.160926 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:49:40.160926 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:49:40.163213 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 30/62] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 26 10:49:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:49:40.169359 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a6b68-0298-4b58-a891-3a7b2e33cb70 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:40.219549 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:40.259233 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 33/63] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:49:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:49:40.260130 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb7c7b2-de67-4a97-bf1d-5b60d05398a0 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:40.292226 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:40.302288 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a6b68-0298-4b58-a891-3a7b2e33cb70 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:40.404584 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4ddd9-6a73-48fd-9504-bcf1646287fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:40.404584 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4ddd9-6a73-48fd-9504-bcf1646287fa None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:40.404584 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4ddd9-6a73-48fd-9504-bcf1646287fa None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:40.404584 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4ddd9-6a73-48fd-9504-bcf1646287fa None admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:40.405556 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed4ddd9-6a73-48fd-9504-bcf1646287fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:49:40.405556 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed4ddd9-6a73-48fd-9504-bcf1646287fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:40.405556 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed4ddd9-6a73-48fd-9504-bcf1646287fa None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:40.405762 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb7c7b2-de67-4a97-bf1d-5b60d05398a0 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:40.405838 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 31/64] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 26 10:49:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:49:40.405838 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4ddd9-6a73-48fd-9504-bcf1646287fa None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:40.414996 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef100c-5fa6-44e0-9536-394560910104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:40.416089 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef100c-5fa6-44e0-9536-394560910104 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:40.416920 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef100c-5fa6-44e0-9536-394560910104 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:40.417847 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef100c-5fa6-44e0-9536-394560910104 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:40.433127 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef100c-5fa6-44e0-9536-394560910104 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:49:40.440559 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-a7ef100c-5fa6-44e0-9536-394560910104 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 26 10:49:40.440559 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:49:40.440559 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:49:40.440559 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:49:40.440559 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:49:40.440559 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:49:40.440559 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:49:40.440559 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:49:40.440559 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:49:40.440559 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:49:40.440559 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:49:40.440559 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:49:40.440559 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:49:40.440559 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:49:40.440559 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:49:40.440559 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:49:40.441466 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:49:40.441466 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:49:40.441466 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:49:40.441466 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:49:40.441466 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:49:40.441466 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:49:40.441466 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:49:40.441466 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:49:40.441466 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:49:40.441466 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:49:40.441466 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:49:40.441466 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:49:40.441466 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:49:40.441466 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:49:40.441466 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:49:40.441466 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:49:40.442257 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:49:40.442257 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:49:40.442257 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:49:40.442257 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:49:40.442257 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:49:40.442257 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:49:40.442257 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:49:40.442257 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:49:40.442257 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:49:40.442257 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:49:40.442257 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 26 10:49:40.442257 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:49:40.445041 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 34/65] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Oct 26 10:49:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:49:40.446044 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef100c-5fa6-44e0-9536-394560910104 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:40.501405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4ddd9-6a73-48fd-9504-bcf1646287fa None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:40.503082 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:40.539918 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d460279-7eb0-4ed1-b399-033d7f15712c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:40.541189 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d460279-7eb0-4ed1-b399-033d7f15712c None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:40.541700 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d460279-7eb0-4ed1-b399-033d7f15712c None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:40.542709 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d460279-7eb0-4ed1-b399-033d7f15712c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:40.556487 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d460279-7eb0-4ed1-b399-033d7f15712c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:49:40.561751 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-6d460279-7eb0-4ed1-b399-033d7f15712c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:49:40.561751 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:49:40.561751 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:49:40.561751 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:49:40.561751 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:49:40.561751 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:49:40.561751 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:49:40.561751 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:49:40.561751 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:49:40.561751 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:49:40.561751 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:49:40.561751 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:49:40.561751 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:49:40.561751 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:49:40.561751 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:49:40.561751 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:49:40.562614 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:49:40.562614 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:49:40.562614 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:49:40.562614 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:49:40.562614 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:49:40.562614 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:49:40.562614 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:49:40.562614 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:49:40.562614 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:49:40.562614 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:49:40.562614 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:49:40.562614 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:49:40.562614 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:49:40.562614 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:49:40.562614 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:49:40.562614 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:49:40.563756 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:49:40.563756 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:49:40.563756 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:49:40.563756 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:49:40.563756 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:49:40.563756 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:49:40.563756 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:49:40.563756 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:49:40.563756 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:49:40.563756 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:49:40.563756 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:49:40.563756 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:49:40.563756 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 32/66] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 26 10:49:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:49:40.563756 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d460279-7eb0-4ed1-b399-033d7f15712c None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:40.570288 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:40.580964 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef100c-5fa6-44e0-9536-394560910104 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:40.617940 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5bd1a-86e8-4c99-8574-945f4b9e6ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:40.618584 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5bd1a-86e8-4c99-8574-945f4b9e6ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:40.618871 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5bd1a-86e8-4c99-8574-945f4b9e6ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:40.619147 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5bd1a-86e8-4c99-8574-945f4b9e6ba8 None admin] PATH_INFO: `/v3/users/90057424199c4a248fcb33009a849d0d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:40.620329 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5bd1a-86e8-4c99-8574-945f4b9e6ba8 None admin] RBAC: Authorizing `identity:get_user(user_id=90057424199c4a248fcb33009a849d0d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:40.621801 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5bd1a-86e8-4c99-8574-945f4b9e6ba8 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:40.627999 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 35/67] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 26 10:49:40 2022] GET /identity/v3/users/90057424199c4a248fcb33009a849d0d => generated 247 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:40.627999 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5bd1a-86e8-4c99-8574-945f4b9e6ba8 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:40.682688 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d460279-7eb0-4ed1-b399-033d7f15712c None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:40.724080 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956b953-b7b6-41d5-a079-31b102529d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:40.724730 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956b953-b7b6-41d5-a079-31b102529d54 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:40.725016 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956b953-b7b6-41d5-a079-31b102529d54 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:40.725290 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956b953-b7b6-41d5-a079-31b102529d54 None admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:40.725953 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956b953-b7b6-41d5-a079-31b102529d54 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:49:40.726246 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956b953-b7b6-41d5-a079-31b102529d54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:40.727618 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956b953-b7b6-41d5-a079-31b102529d54 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:40.735956 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 33/68] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 26 10:49:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:40.736782 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956b953-b7b6-41d5-a079-31b102529d54 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:40.746232 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5bd1a-86e8-4c99-8574-945f4b9e6ba8 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:40.763284 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:40.792561 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6e08e-df99-4bb0-b3e7-a23a3aa68e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:40.793245 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6e08e-df99-4bb0-b3e7-a23a3aa68e03 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:40.793527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6e08e-df99-4bb0-b3e7-a23a3aa68e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:40.793812 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6e08e-df99-4bb0-b3e7-a23a3aa68e03 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:40.804731 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6e08e-df99-4bb0-b3e7-a23a3aa68e03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:49:40.809713 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-1af6e08e-df99-4bb0-b3e7-a23a3aa68e03 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:49:40.809713 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:49:40.809713 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:49:40.809713 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:49:40.809713 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:49:40.809713 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:49:40.809713 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:49:40.809713 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:49:40.809713 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:49:40.809713 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:49:40.809713 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:49:40.809713 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:49:40.809713 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:49:40.809713 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:49:40.809713 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:49:40.809713 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:49:40.810724 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:49:40.810724 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:49:40.810724 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:49:40.810724 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:49:40.810724 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:49:40.810724 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:49:40.810724 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:49:40.810724 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:49:40.810724 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:49:40.810724 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:49:40.810724 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:49:40.810724 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:49:40.810724 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:49:40.810724 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:49:40.810724 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:49:40.810724 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:49:40.811483 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:49:40.811483 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:49:40.811483 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:49:40.811483 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:49:40.811483 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:49:40.811483 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:49:40.811483 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:49:40.811483 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:49:40.811483 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:49:40.811483 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:49:40.811483 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:49:40.811483 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:49:40.811483 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 36/69] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 26 10:49:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:49:40.812693 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6e08e-df99-4bb0-b3e7-a23a3aa68e03 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:40.831208 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:40.841234 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956b953-b7b6-41d5-a079-31b102529d54 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:40.874139 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eaa9cb-9cb8-4077-902a-c0ccce32e1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:40.875270 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eaa9cb-9cb8-4077-902a-c0ccce32e1e3 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:40.875554 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eaa9cb-9cb8-4077-902a-c0ccce32e1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:40.875872 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eaa9cb-9cb8-4077-902a-c0ccce32e1e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:40.876578 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eaa9cb-9cb8-4077-902a-c0ccce32e1e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:49:40.876889 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eaa9cb-9cb8-4077-902a-c0ccce32e1e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:40.878269 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eaa9cb-9cb8-4077-902a-c0ccce32e1e3 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:40.886272 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 34/70] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Oct 26 10:49:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:40.887068 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eaa9cb-9cb8-4077-902a-c0ccce32e1e3 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:40.913360 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6e08e-df99-4bb0-b3e7-a23a3aa68e03 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:40.947422 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d815e8c-e239-476e-8c1e-97dd75478ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:40.947995 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d815e8c-e239-476e-8c1e-97dd75478ebe None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:40.948307 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d815e8c-e239-476e-8c1e-97dd75478ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:40.948586 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d815e8c-e239-476e-8c1e-97dd75478ebe None admin] PATH_INFO: `/v3/projects/d161ac8d78bd458891d682168cd22b97` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:40.949718 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d815e8c-e239-476e-8c1e-97dd75478ebe None admin] RBAC: Authorizing `identity:get_project(project_id=d161ac8d78bd458891d682168cd22b97)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:40.951181 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d815e8c-e239-476e-8c1e-97dd75478ebe None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:40.953027 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 37/71] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 26 10:49:40 2022] GET /identity/v3/projects/d161ac8d78bd458891d682168cd22b97 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:40.954007 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360df7a-592c-40db-a353-acc10ad30f48 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:40.954298 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360df7a-592c-40db-a353-acc10ad30f48 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:40.954579 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360df7a-592c-40db-a353-acc10ad30f48 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:40.955780 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 38/72] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:49:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:49:40.956509 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360df7a-592c-40db-a353-acc10ad30f48 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:40.975796 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:40.989913 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eaa9cb-9cb8-4077-902a-c0ccce32e1e3 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:41.023500 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e50dba-0e79-4237-9e27-fe77b93bc412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:41.024166 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e50dba-0e79-4237-9e27-fe77b93bc412 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:41.024451 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e50dba-0e79-4237-9e27-fe77b93bc412 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:41.024730 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e50dba-0e79-4237-9e27-fe77b93bc412 None admin] PATH_INFO: `/v3/users/dbe8c1627cd14ceeb40d3289822f740c` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:41.038540 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e50dba-0e79-4237-9e27-fe77b93bc412 None admin] RBAC: Authorizing `identity:get_user(user_id=dbe8c1627cd14ceeb40d3289822f740c)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:41.040008 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e50dba-0e79-4237-9e27-fe77b93bc412 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:41.041627 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 35/73] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 26 10:49:40 2022] GET /identity/v3/users/dbe8c1627cd14ceeb40d3289822f740c => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:41.042173 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:41.042389 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e50dba-0e79-4237-9e27-fe77b93bc412 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:41.063384 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360df7a-592c-40db-a353-acc10ad30f48 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:41.097889 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f69d9-fb56-4417-adf7-8b735235face None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:41.098503 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f69d9-fb56-4417-adf7-8b735235face None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:41.098785 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f69d9-fb56-4417-adf7-8b735235face None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:41.099070 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f69d9-fb56-4417-adf7-8b735235face None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:41.099738 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f69d9-fb56-4417-adf7-8b735235face None admin] RBAC: Adding query filter params (name=member) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:49:41.100046 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f69d9-fb56-4417-adf7-8b735235face None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:41.101456 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f69d9-fb56-4417-adf7-8b735235face None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:41.110004 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 39/74] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Oct 26 10:49:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:41.110773 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f69d9-fb56-4417-adf7-8b735235face None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:41.144714 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e50dba-0e79-4237-9e27-fe77b93bc412 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:41.179356 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c34ea6-cc40-43a3-97df-9fff97306787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:41.179987 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c34ea6-cc40-43a3-97df-9fff97306787 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:41.180297 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c34ea6-cc40-43a3-97df-9fff97306787 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:41.180573 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c34ea6-cc40-43a3-97df-9fff97306787 None admin] PATH_INFO: `/v3/users/dbe8c1627cd14ceeb40d3289822f740c` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:41.181690 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c34ea6-cc40-43a3-97df-9fff97306787 None admin] RBAC: Authorizing `identity:get_user(user_id=dbe8c1627cd14ceeb40d3289822f740c)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:41.183124 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c34ea6-cc40-43a3-97df-9fff97306787 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:41.184921 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 36/75] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 26 10:49:41 2022] GET /identity/v3/users/dbe8c1627cd14ceeb40d3289822f740c => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:41.185969 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2297b-f4d8-4540-b466-aefa0ccf8e42 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:41.186257 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2297b-f4d8-4540-b466-aefa0ccf8e42 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:41.186533 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2297b-f4d8-4540-b466-aefa0ccf8e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:41.204105 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-68e2297b-f4d8-4540-b466-aefa0ccf8e42 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:49:41.205597 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-68e2297b-f4d8-4540-b466-aefa0ccf8e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:49:41.212790 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:41.212954 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f69d9-fb56-4417-adf7-8b735235face None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:41.247429 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbabe93-c174-42e1-8772-db1d9417d4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:41.248122 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbabe93-c174-42e1-8772-db1d9417d4f0 None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:41.248409 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbabe93-c174-42e1-8772-db1d9417d4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:41.248687 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbabe93-c174-42e1-8772-db1d9417d4f0 None admin] PATH_INFO: `/v3/projects/d161ac8d78bd458891d682168cd22b97/users/90057424199c4a248fcb33009a849d0d/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:41.250656 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbabe93-c174-42e1-8772-db1d9417d4f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=d161ac8d78bd458891d682168cd22b97, user_id=90057424199c4a248fcb33009a849d0d, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:41.252121 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbabe93-c174-42e1-8772-db1d9417d4f0 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:41.271246 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 37/76] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:49:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:49:41.272190 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e2297b-f4d8-4540-b466-aefa0ccf8e42 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:41.323034 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 40/77] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 26 10:49:41 2022] PUT /identity/v3/projects/d161ac8d78bd458891d682168cd22b97/users/90057424199c4a248fcb33009a849d0d/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:49:41.324207 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbabe93-c174-42e1-8772-db1d9417d4f0 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:41.348677 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:41.389363 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e2297b-f4d8-4540-b466-aefa0ccf8e42 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:41.431718 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9af2c0-23f6-4dfe-9d20-36bd752a6e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:41.432874 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9af2c0-23f6-4dfe-9d20-36bd752a6e45 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:41.433364 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9af2c0-23f6-4dfe-9d20-36bd752a6e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:41.433853 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9af2c0-23f6-4dfe-9d20-36bd752a6e45 None admin] PATH_INFO: `/v3/projects/d161ac8d78bd458891d682168cd22b97` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:41.435509 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9af2c0-23f6-4dfe-9d20-36bd752a6e45 None admin] RBAC: Authorizing `identity:get_project(project_id=d161ac8d78bd458891d682168cd22b97)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:41.438058 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9af2c0-23f6-4dfe-9d20-36bd752a6e45 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:41.440241 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 38/78] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 26 10:49:41 2022] GET /identity/v3/projects/d161ac8d78bd458891d682168cd22b97 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:41.441025 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9af2c0-23f6-4dfe-9d20-36bd752a6e45 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:41.469081 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:41.470884 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbabe93-c174-42e1-8772-db1d9417d4f0 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:41.515036 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96362806-b9f9-4135-b4af-f24f796a773d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:41.516724 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96362806-b9f9-4135-b4af-f24f796a773d None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:41.517156 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96362806-b9f9-4135-b4af-f24f796a773d None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:41.517645 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96362806-b9f9-4135-b4af-f24f796a773d None admin] PATH_INFO: `/v3/users/dbe8c1627cd14ceeb40d3289822f740c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:41.519394 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96362806-b9f9-4135-b4af-f24f796a773d None admin] RBAC: Authorizing `identity:get_user(user_id=dbe8c1627cd14ceeb40d3289822f740c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:41.521238 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96362806-b9f9-4135-b4af-f24f796a773d None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:41.523604 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 41/79] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 26 10:49:41 2022] GET /identity/v3/users/dbe8c1627cd14ceeb40d3289822f740c => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:41.525081 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96362806-b9f9-4135-b4af-f24f796a773d None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:41.569598 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9af2c0-23f6-4dfe-9d20-36bd752a6e45 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:41.604266 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c069bd6-5b22-4c0c-ab7d-317863a2bef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:41.604907 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c069bd6-5b22-4c0c-ab7d-317863a2bef6 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:41.605198 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c069bd6-5b22-4c0c-ab7d-317863a2bef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:41.605477 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c069bd6-5b22-4c0c-ab7d-317863a2bef6 None admin] PATH_INFO: `/v3/projects/d161ac8d78bd458891d682168cd22b97` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:41.606584 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c069bd6-5b22-4c0c-ab7d-317863a2bef6 None admin] RBAC: Authorizing `identity:get_project(project_id=d161ac8d78bd458891d682168cd22b97)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:41.608018 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c069bd6-5b22-4c0c-ab7d-317863a2bef6 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:41.610478 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 39/80] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 26 10:49:41 2022] GET /identity/v3/projects/d161ac8d78bd458891d682168cd22b97 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:41.611164 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c069bd6-5b22-4c0c-ab7d-317863a2bef6 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:41.632345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:41.656747 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96362806-b9f9-4135-b4af-f24f796a773d None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:41.693361 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80390771-54c5-42f4-a7a9-7dd6a6e33364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:41.694034 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80390771-54c5-42f4-a7a9-7dd6a6e33364 None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:41.694344 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80390771-54c5-42f4-a7a9-7dd6a6e33364 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:41.694602 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80390771-54c5-42f4-a7a9-7dd6a6e33364 None admin] PATH_INFO: `/v3/projects/d161ac8d78bd458891d682168cd22b97/users/dbe8c1627cd14ceeb40d3289822f740c/roles/a29ce5d75abc411488ef339c191e6d05` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:41.696981 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80390771-54c5-42f4-a7a9-7dd6a6e33364 None admin] RBAC: Authorizing `identity:create_grant(project_id=d161ac8d78bd458891d682168cd22b97, user_id=dbe8c1627cd14ceeb40d3289822f740c, role_id=a29ce5d75abc411488ef339c191e6d05)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:41.697085 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:41.698453 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80390771-54c5-42f4-a7a9-7dd6a6e33364 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:41.719598 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c069bd6-5b22-4c0c-ab7d-317863a2bef6 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:41.753352 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39e426-44f9-4914-8295-5a34e7689871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:41.753982 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39e426-44f9-4914-8295-5a34e7689871 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:41.754263 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39e426-44f9-4914-8295-5a34e7689871 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:41.754535 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39e426-44f9-4914-8295-5a34e7689871 None admin] PATH_INFO: `/v3/projects/6b801626292e4924a3f632686ec48fff` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:41.755644 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39e426-44f9-4914-8295-5a34e7689871 None admin] RBAC: Authorizing `identity:get_project(project_id=6b801626292e4924a3f632686ec48fff)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:41.757121 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39e426-44f9-4914-8295-5a34e7689871 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:41.758739 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 40/81] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 26 10:49:41 2022] GET /identity/v3/projects/6b801626292e4924a3f632686ec48fff => generated 312 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:41.759595 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39e426-44f9-4914-8295-5a34e7689871 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:41.812786 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 42/82] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 26 10:49:41 2022] PUT /identity/v3/projects/d161ac8d78bd458891d682168cd22b97/users/dbe8c1627cd14ceeb40d3289822f740c/roles/a29ce5d75abc411488ef339c191e6d05 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:49:41.813628 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80390771-54c5-42f4-a7a9-7dd6a6e33364 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:41.876372 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39e426-44f9-4914-8295-5a34e7689871 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:41.915903 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd5348-c46d-46cb-82d3-e95e3d1909ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:41.916589 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd5348-c46d-46cb-82d3-e95e3d1909ca None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:41.916873 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd5348-c46d-46cb-82d3-e95e3d1909ca None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:41.917151 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd5348-c46d-46cb-82d3-e95e3d1909ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:41.918313 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd5348-c46d-46cb-82d3-e95e3d1909ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:41.919786 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd5348-c46d-46cb-82d3-e95e3d1909ca None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:41.922174 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 41/83] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:49:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:41.922856 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd5348-c46d-46cb-82d3-e95e3d1909ca None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:41.951162 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:41.955965 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80390771-54c5-42f4-a7a9-7dd6a6e33364 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:41.997915 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d0e1a-9973-45c1-a339-a4512024f769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:41.998540 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d0e1a-9973-45c1-a339-a4512024f769 None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:41.999093 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d0e1a-9973-45c1-a339-a4512024f769 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:41.999407 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d0e1a-9973-45c1-a339-a4512024f769 None admin] PATH_INFO: `/v3/projects/d161ac8d78bd458891d682168cd22b97/users/dbe8c1627cd14ceeb40d3289822f740c/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:42.002213 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d0e1a-9973-45c1-a339-a4512024f769 None admin] RBAC: Authorizing `identity:create_grant(project_id=d161ac8d78bd458891d682168cd22b97, user_id=dbe8c1627cd14ceeb40d3289822f740c, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:42.003816 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d0e1a-9973-45c1-a339-a4512024f769 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:42.008477 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:42.059285 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd5348-c46d-46cb-82d3-e95e3d1909ca None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:42.079847 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 43/84] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 26 10:49:41 2022] PUT /identity/v3/projects/d161ac8d78bd458891d682168cd22b97/users/dbe8c1627cd14ceeb40d3289822f740c/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:49:42.088250 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d0e1a-9973-45c1-a339-a4512024f769 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:42.122770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45771f-1ca5-4f05-a6fa-6afea7d73372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:42.124992 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45771f-1ca5-4f05-a6fa-6afea7d73372 None admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:42.126193 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45771f-1ca5-4f05-a6fa-6afea7d73372 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:42.126771 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45771f-1ca5-4f05-a6fa-6afea7d73372 None admin] PATH_INFO: `/v3/projects/6b801626292e4924a3f632686ec48fff/users/dbe8c1627cd14ceeb40d3289822f740c/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:42.131704 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45771f-1ca5-4f05-a6fa-6afea7d73372 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b801626292e4924a3f632686ec48fff, user_id=dbe8c1627cd14ceeb40d3289822f740c, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:42.136363 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45771f-1ca5-4f05-a6fa-6afea7d73372 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:42.239101 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d0e1a-9973-45c1-a339-a4512024f769 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:42.260928 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 42/85] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 26 10:49:41 2022] PUT /identity/v3/projects/6b801626292e4924a3f632686ec48fff/users/dbe8c1627cd14ceeb40d3289822f740c/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:49:42.289381 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d008a-6a29-4c45-8e3d-dca86c003e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:42.290112 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d008a-6a29-4c45-8e3d-dca86c003e80 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:42.290457 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d008a-6a29-4c45-8e3d-dca86c003e80 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:42.290744 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d008a-6a29-4c45-8e3d-dca86c003e80 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:42.291511 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d008a-6a29-4c45-8e3d-dca86c003e80 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:42.293212 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d008a-6a29-4c45-8e3d-dca86c003e80 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:42.414569 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 44/86] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Oct 26 10:49:42 2022] POST /identity/v3/users => generated 289 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:49:43.715396 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676212e-1e71-4132-b9ac-816feea8c55b None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:43.715884 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676212e-1e71-4132-b9ac-816feea8c55b None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:43.715884 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676212e-1e71-4132-b9ac-816feea8c55b None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:43.717395 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 43/87] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:49:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:49:43.723159 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af73f9-ec61-4bd3-b052-4fb5292daebd None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:43.723600 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af73f9-ec61-4bd3-b052-4fb5292daebd None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:43.723789 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af73f9-ec61-4bd3-b052-4fb5292daebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:43.744999 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-f2af73f9-ec61-4bd3-b052-4fb5292daebd None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:49:43.746219 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f2af73f9-ec61-4bd3-b052-4fb5292daebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:49:43.811860 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:43.837459 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 45/88] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:49:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:49:44.323841 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676212e-1e71-4132-b9ac-816feea8c55b None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:44.426664 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:44.462896 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676212e-1e71-4132-b9ac-816feea8c55b None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:44.467734 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008eb1ea-5274-4a33-acf1-98d026c7f712 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:44.468029 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008eb1ea-5274-4a33-acf1-98d026c7f712 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:44.468335 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008eb1ea-5274-4a33-acf1-98d026c7f712 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:44.470273 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 46/89] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:49:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:49:44.483537 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8815d1-4b46-4060-b72b-b01384e1e7cf None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:44.483835 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8815d1-4b46-4060-b72b-b01384e1e7cf None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:44.484185 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8815d1-4b46-4060-b72b-b01384e1e7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:44.515855 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46ebbc-a2cc-4dda-af6e-a781c6d85e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:44.516553 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46ebbc-a2cc-4dda-af6e-a781c6d85e4b None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:44.516845 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46ebbc-a2cc-4dda-af6e-a781c6d85e4b None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:44.517126 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46ebbc-a2cc-4dda-af6e-a781c6d85e4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:44.522582 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-cc8815d1-4b46-4060-b72b-b01384e1e7cf None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:49:44.523810 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-cc8815d1-4b46-4060-b72b-b01384e1e7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:49:44.536257 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca46ebbc-a2cc-4dda-af6e-a781c6d85e4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:49:44.541207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-ca46ebbc-a2cc-4dda-af6e-a781c6d85e4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:49:44.541207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:49:44.541207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:49:44.541207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:49:44.541207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:49:44.541207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:49:44.541207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:49:44.541207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:49:44.541207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:49:44.541207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:49:44.541207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:49:44.541207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:49:44.541207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:49:44.541207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:49:44.541207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:49:44.541207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:49:44.542086 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:49:44.542086 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:49:44.542086 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:49:44.542086 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:49:44.542086 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:49:44.542086 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:49:44.542086 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:49:44.542086 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:49:44.542086 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:49:44.542086 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:49:44.542086 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:49:44.542086 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:49:44.542086 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:49:44.542086 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:49:44.542086 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:49:44.542086 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:49:44.542846 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:49:44.542846 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:49:44.542846 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:49:44.542846 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:49:44.542846 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:49:44.542846 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:49:44.542846 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:49:44.542846 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:49:44.542846 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:49:44.542846 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:49:44.542846 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:49:44.542846 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:49:44.542846 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 44/90] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 26 10:49:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:49:44.549621 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46ebbc-a2cc-4dda-af6e-a781c6d85e4b None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:44.694424 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 47/91] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:49:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:49:44.739595 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46ebbc-a2cc-4dda-af6e-a781c6d85e4b None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:44.757528 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236f347-b51c-49af-bcdb-258baee8351f None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:44.757993 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236f347-b51c-49af-bcdb-258baee8351f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:44.758098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236f347-b51c-49af-bcdb-258baee8351f None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:44.759423 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 48/92] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:49:44.783952 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4456c-13a5-4776-a906-78e26b984dfc None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:44.784358 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4456c-13a5-4776-a906-78e26b984dfc None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:44.784615 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4456c-13a5-4776-a906-78e26b984dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:44.786233 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c01fd5-50b3-44df-aad3-b72201fee9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:44.790763 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c01fd5-50b3-44df-aad3-b72201fee9b9 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:44.790763 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c01fd5-50b3-44df-aad3-b72201fee9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:44.790763 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c01fd5-50b3-44df-aad3-b72201fee9b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:44.790763 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c01fd5-50b3-44df-aad3-b72201fee9b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:49:44.790763 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c01fd5-50b3-44df-aad3-b72201fee9b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:44.790763 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c01fd5-50b3-44df-aad3-b72201fee9b9 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:44.795333 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:44.806443 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 45/93] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 26 10:49:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:49:44.819507 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c01fd5-50b3-44df-aad3-b72201fee9b9 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:44.821844 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-c0f4456c-13a5-4776-a906-78e26b984dfc None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:49:44.823916 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c0f4456c-13a5-4776-a906-78e26b984dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:49:44.994721 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c01fd5-50b3-44df-aad3-b72201fee9b9 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:45.013939 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 49/94] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:49:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:49:45.063622 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682de96-1f0e-465a-9bc1-12650beddbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:45.064305 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682de96-1f0e-465a-9bc1-12650beddbd0 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:45.064596 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682de96-1f0e-465a-9bc1-12650beddbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:45.064879 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682de96-1f0e-465a-9bc1-12650beddbd0 None admin] PATH_INFO: `/v3/users/90057424199c4a248fcb33009a849d0d` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:45.066046 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2682de96-1f0e-465a-9bc1-12650beddbd0 None admin] RBAC: Authorizing `identity:get_user(user_id=90057424199c4a248fcb33009a849d0d)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:45.067504 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2682de96-1f0e-465a-9bc1-12650beddbd0 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:45.069434 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 46/95] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 26 10:49:44 2022] GET /identity/v3/users/90057424199c4a248fcb33009a849d0d => generated 247 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:49:45.074795 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f4456c-13a5-4776-a906-78e26b984dfc None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:45.120296 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee54329-af66-4e57-9d3b-34827d817c47 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:45.120609 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee54329-af66-4e57-9d3b-34827d817c47 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:45.120867 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee54329-af66-4e57-9d3b-34827d817c47 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:45.122365 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 47/96] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:49:45.130715 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee54329-af66-4e57-9d3b-34827d817c47 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:45.144293 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:45.239872 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f4456c-13a5-4776-a906-78e26b984dfc None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:45.256138 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:45.301374 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e8569-ebc0-4af8-be69-6aa533c50c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:45.302771 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e8569-ebc0-4af8-be69-6aa533c50c45 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:45.303063 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e8569-ebc0-4af8-be69-6aa533c50c45 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:45.303346 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e8569-ebc0-4af8-be69-6aa533c50c45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:45.318848 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee54329-af66-4e57-9d3b-34827d817c47 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:45.383984 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066e220-9add-4b94-9148-22a32668bd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:45.384985 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066e220-9add-4b94-9148-22a32668bd1d None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:45.385443 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066e220-9add-4b94-9148-22a32668bd1d None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:45.386429 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066e220-9add-4b94-9148-22a32668bd1d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:45.400552 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5066e220-9add-4b94-9148-22a32668bd1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:49:45.405946 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-5066e220-9add-4b94-9148-22a32668bd1d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 26 10:49:45.405946 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:49:45.405946 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:49:45.405946 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:49:45.405946 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:49:45.405946 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:49:45.405946 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:49:45.405946 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:49:45.405946 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:49:45.405946 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:49:45.405946 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:49:45.405946 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:49:45.405946 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:49:45.405946 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:49:45.405946 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:49:45.405946 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:49:45.407385 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:49:45.407385 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:49:45.407385 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:49:45.407385 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:49:45.407385 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:49:45.407385 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:49:45.407385 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:49:45.407385 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:49:45.407385 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:49:45.407385 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:49:45.407385 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:49:45.407385 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:49:45.407385 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:49:45.407385 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:49:45.407385 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:49:45.407385 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:49:45.408186 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:49:45.408186 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:49:45.408186 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:49:45.408186 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:49:45.408186 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:49:45.408186 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:49:45.408186 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:49:45.408186 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:49:45.408186 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:49:45.408186 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:49:45.408186 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 26 10:49:45.408186 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:49:45.408186 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 48/97] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Oct 26 10:49:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:49:45.409294 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58fe14-c256-40e9-9317-930021c4c076 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:45.409294 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58fe14-c256-40e9-9317-930021c4c076 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:45.409475 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58fe14-c256-40e9-9317-930021c4c076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:45.424499 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e8569-ebc0-4af8-be69-6aa533c50c45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:45.426262 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e8569-ebc0-4af8-be69-6aa533c50c45 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:45.427666 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-9d58fe14-c256-40e9-9317-930021c4c076 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:49:45.428891 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-9d58fe14-c256-40e9-9317-930021c4c076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:49:45.478733 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:45.516123 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 49/98] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:49:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:49:45.517017 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58fe14-c256-40e9-9317-930021c4c076 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:45.580281 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 50/99] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 26 10:49:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 26 10:49:45.581041 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e8569-ebc0-4af8-be69-6aa533c50c45 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:45.584364 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:45.637126 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58fe14-c256-40e9-9317-930021c4c076 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:45.683847 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d6ba4-dd95-4ea3-866d-59e3f82aa94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:45.684907 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d6ba4-dd95-4ea3-866d-59e3f82aa94d None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:45.685389 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d6ba4-dd95-4ea3-866d-59e3f82aa94d None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:45.685954 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d6ba4-dd95-4ea3-866d-59e3f82aa94d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:45.697432 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d6ba4-dd95-4ea3-866d-59e3f82aa94d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:49:45.702775 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-640d6ba4-dd95-4ea3-866d-59e3f82aa94d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:49:45.702775 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:49:45.702775 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:49:45.702775 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:49:45.702775 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:49:45.702775 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:49:45.702775 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:49:45.702775 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:49:45.702775 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:49:45.702775 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:49:45.702775 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:49:45.702775 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:49:45.702775 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:49:45.702775 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:49:45.702775 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:49:45.702775 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:49:45.704435 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:49:45.704435 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:49:45.704435 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:49:45.704435 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:49:45.704435 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:49:45.704435 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:49:45.704435 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:49:45.704435 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:49:45.704435 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:49:45.704435 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:49:45.704435 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:49:45.704435 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:49:45.704435 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:49:45.704435 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:49:45.704435 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:49:45.704435 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:49:45.705198 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:49:45.705198 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:49:45.705198 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:49:45.705198 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:49:45.705198 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:49:45.705198 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:49:45.705198 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:49:45.705198 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:49:45.705198 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:49:45.705198 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:49:45.705198 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:49:45.705198 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:49:45.707244 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 50/100] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 26 10:49:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:49:45.708255 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d6ba4-dd95-4ea3-866d-59e3f82aa94d None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:45.750191 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e8569-ebc0-4af8-be69-6aa533c50c45 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:45.833127 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d6ba4-dd95-4ea3-866d-59e3f82aa94d None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:45.834324 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610c7bb-d796-4c63-88a4-52ae862fc926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:45.835167 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610c7bb-d796-4c63-88a4-52ae862fc926 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:45.835487 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610c7bb-d796-4c63-88a4-52ae862fc926 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:45.835770 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610c7bb-d796-4c63-88a4-52ae862fc926 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:45.836570 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610c7bb-d796-4c63-88a4-52ae862fc926 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:49:45.836771 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610c7bb-d796-4c63-88a4-52ae862fc926 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:45.838451 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610c7bb-d796-4c63-88a4-52ae862fc926 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:45.850954 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:45.856562 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 51/101] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 26 10:49:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:45.857273 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610c7bb-d796-4c63-88a4-52ae862fc926 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:45.863629 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:45.876884 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084bd1a-524b-4770-b8c1-96be45d76fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:45.882521 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084bd1a-524b-4770-b8c1-96be45d76fc0 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:45.882521 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084bd1a-524b-4770-b8c1-96be45d76fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:45.882521 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084bd1a-524b-4770-b8c1-96be45d76fc0 None admin] PATH_INFO: `/v3/projects/d161ac8d78bd458891d682168cd22b97` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:45.882521 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084bd1a-524b-4770-b8c1-96be45d76fc0 None admin] RBAC: Authorizing `identity:get_project(project_id=d161ac8d78bd458891d682168cd22b97)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:45.882521 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084bd1a-524b-4770-b8c1-96be45d76fc0 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:45.882521 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 51/102] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 26 10:49:45 2022] GET /identity/v3/projects/d161ac8d78bd458891d682168cd22b97 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:45.883194 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084bd1a-524b-4770-b8c1-96be45d76fc0 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:45.990385 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610c7bb-d796-4c63-88a4-52ae862fc926 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:46.029955 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084bd1a-524b-4770-b8c1-96be45d76fc0 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:46.037254 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e95886-2b7f-4902-895e-69c636875432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:46.037907 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e95886-2b7f-4902-895e-69c636875432 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:46.038246 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e95886-2b7f-4902-895e-69c636875432 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:46.038534 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e95886-2b7f-4902-895e-69c636875432 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:46.039906 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e95886-2b7f-4902-895e-69c636875432 None admin] RBAC: Adding query filter params (name=member) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:49:46.040251 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e95886-2b7f-4902-895e-69c636875432 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:46.042303 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e95886-2b7f-4902-895e-69c636875432 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:46.053549 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 52/103] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Oct 26 10:49:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:46.055073 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e95886-2b7f-4902-895e-69c636875432 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:46.070950 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb8f21-7b34-422d-b69a-5b9db9db8c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:46.071608 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb8f21-7b34-422d-b69a-5b9db9db8c41 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:46.071890 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb8f21-7b34-422d-b69a-5b9db9db8c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:46.072215 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb8f21-7b34-422d-b69a-5b9db9db8c41 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:46.083392 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb8f21-7b34-422d-b69a-5b9db9db8c41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:49:46.088704 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-34cb8f21-7b34-422d-b69a-5b9db9db8c41 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:49:46.088704 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:49:46.088704 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:49:46.088704 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:49:46.088704 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:49:46.088704 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:49:46.088704 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:49:46.088704 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:49:46.088704 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:49:46.088704 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:49:46.088704 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:49:46.088704 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:49:46.088704 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:49:46.088704 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:49:46.088704 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:49:46.088704 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:49:46.089548 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:49:46.089548 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:49:46.089548 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:49:46.089548 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:49:46.089548 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:49:46.089548 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:49:46.089548 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:49:46.089548 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:49:46.089548 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:49:46.089548 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:49:46.089548 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:49:46.089548 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:49:46.089548 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:49:46.089548 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:49:46.089548 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:49:46.089548 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:49:46.090298 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:49:46.090298 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:49:46.090298 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:49:46.090298 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:49:46.090298 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:49:46.090298 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:49:46.090298 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:49:46.090298 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:49:46.090298 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:49:46.090298 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:49:46.090298 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:49:46.090298 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:49:46.095214 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 52/104] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 26 10:49:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:49:46.096084 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb8f21-7b34-422d-b69a-5b9db9db8c41 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:46.138516 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:46.140840 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:46.179963 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e95886-2b7f-4902-895e-69c636875432 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:46.204041 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb8f21-7b34-422d-b69a-5b9db9db8c41 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:46.219066 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f8bfa-7d21-495b-9f4f-e8c70451316b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:46.219719 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f8bfa-7d21-495b-9f4f-e8c70451316b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:46.220004 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f8bfa-7d21-495b-9f4f-e8c70451316b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:46.220385 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f8bfa-7d21-495b-9f4f-e8c70451316b None admin] PATH_INFO: `/v3/users/dbe8c1627cd14ceeb40d3289822f740c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:46.221706 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f8bfa-7d21-495b-9f4f-e8c70451316b None admin] RBAC: Authorizing `identity:get_user(user_id=dbe8c1627cd14ceeb40d3289822f740c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:46.222880 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f8bfa-7d21-495b-9f4f-e8c70451316b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:46.224656 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 53/105] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 26 10:49:46 2022] GET /identity/v3/users/dbe8c1627cd14ceeb40d3289822f740c => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:46.225352 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f8bfa-7d21-495b-9f4f-e8c70451316b None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:46.245019 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e58bf-89c2-4203-9e88-9936f045137e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:46.245637 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e58bf-89c2-4203-9e88-9936f045137e None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:46.245923 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e58bf-89c2-4203-9e88-9936f045137e None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:46.246199 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e58bf-89c2-4203-9e88-9936f045137e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:46.246933 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e58bf-89c2-4203-9e88-9936f045137e None admin] RBAC: Adding query filter params (role.id=d6876897d7c548b7900d4e01cb45a007, scope.project.id=d161ac8d78bd458891d682168cd22b97, user.id=90057424199c4a248fcb33009a849d0d) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:49:46.247244 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e58bf-89c2-4203-9e88-9936f045137e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:46.248788 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e58bf-89c2-4203-9e88-9936f045137e None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:46.256983 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 53/106] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 26 10:49:46 2022] GET /identity/v3/role_assignments?user.id=90057424199c4a248fcb33009a849d0d&scope.project.id=d161ac8d78bd458891d682168cd22b97&role.id=d6876897d7c548b7900d4e01cb45a007 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:46.257787 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e58bf-89c2-4203-9e88-9936f045137e None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:46.362494 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f8bfa-7d21-495b-9f4f-e8c70451316b None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:46.380202 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e58bf-89c2-4203-9e88-9936f045137e None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:46.389140 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:46.401244 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f50646-bd86-43d5-bb4e-ff96cf4e6579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:46.401903 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f50646-bd86-43d5-bb4e-ff96cf4e6579 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:46.402181 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f50646-bd86-43d5-bb4e-ff96cf4e6579 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:46.402468 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f50646-bd86-43d5-bb4e-ff96cf4e6579 None admin] PATH_INFO: `/v3/users/dbe8c1627cd14ceeb40d3289822f740c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:46.403784 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f50646-bd86-43d5-bb4e-ff96cf4e6579 None admin] RBAC: Authorizing `identity:get_user(user_id=dbe8c1627cd14ceeb40d3289822f740c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:46.405320 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f50646-bd86-43d5-bb4e-ff96cf4e6579 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:46.407375 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 54/107] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 26 10:49:46 2022] GET /identity/v3/users/dbe8c1627cd14ceeb40d3289822f740c => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:46.408764 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6230e4-2626-4969-bc60-80e606b966aa None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:46.409055 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6230e4-2626-4969-bc60-80e606b966aa None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:46.409334 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6230e4-2626-4969-bc60-80e606b966aa None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:46.411209 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 55/108] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:49:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:49:46.411919 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6230e4-2626-4969-bc60-80e606b966aa None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:46.414834 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:46.428390 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb401d-3311-49ab-8489-9ed093f72bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:46.429245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb401d-3311-49ab-8489-9ed093f72bb1 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:46.431435 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb401d-3311-49ab-8489-9ed093f72bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:46.431435 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb401d-3311-49ab-8489-9ed093f72bb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:46.431435 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb401d-3311-49ab-8489-9ed093f72bb1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:49:46.431435 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb401d-3311-49ab-8489-9ed093f72bb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:46.432476 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb401d-3311-49ab-8489-9ed093f72bb1 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:46.442536 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 54/109] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Oct 26 10:49:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:46.448457 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803ef33-63a7-4048-8995-85add92914f5 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:46.448753 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803ef33-63a7-4048-8995-85add92914f5 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:46.449149 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803ef33-63a7-4048-8995-85add92914f5 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:46.450325 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 55/110] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:49:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:49:46.454491 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803ef33-63a7-4048-8995-85add92914f5 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:46.535814 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6230e4-2626-4969-bc60-80e606b966aa None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:46.556764 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803ef33-63a7-4048-8995-85add92914f5 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:46.569971 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12c8a5-235b-4203-8ec1-c602a0e56c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:46.570582 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12c8a5-235b-4203-8ec1-c602a0e56c92 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:46.570866 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12c8a5-235b-4203-8ec1-c602a0e56c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:46.571143 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12c8a5-235b-4203-8ec1-c602a0e56c92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:46.589563 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049fae76-842d-42ee-b3e3-07fdc25a0fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:46.590166 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fae76-842d-42ee-b3e3-07fdc25a0fbd None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:46.590447 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fae76-842d-42ee-b3e3-07fdc25a0fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:46.590722 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fae76-842d-42ee-b3e3-07fdc25a0fbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:46.625753 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:46.639197 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12c8a5-235b-4203-8ec1-c602a0e56c92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:46.641220 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12c8a5-235b-4203-8ec1-c602a0e56c92 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:46.642981 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:46.658658 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049fae76-842d-42ee-b3e3-07fdc25a0fbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:46.660127 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049fae76-842d-42ee-b3e3-07fdc25a0fbd None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:46.740523 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 56/111] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 26 10:49:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 26 10:49:46.741967 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96240a7-ce42-4c82-a4c6-452b7522696b None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:46.742570 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96240a7-ce42-4c82-a4c6-452b7522696b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:46.742861 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96240a7-ce42-4c82-a4c6-452b7522696b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:46.759056 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 56/112] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 26 10:49:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 26 10:49:46.765386 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049fae76-842d-42ee-b3e3-07fdc25a0fbd None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:46.766368 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-c96240a7-ce42-4c82-a4c6-452b7522696b None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:49:46.767596 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c96240a7-ce42-4c82-a4c6-452b7522696b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:49:46.833165 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:46.839832 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 57/113] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:49:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:49:46.841261 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce4576-a472-467e-950b-bd81222aca02 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:46.841510 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce4576-a472-467e-950b-bd81222aca02 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:46.841849 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce4576-a472-467e-950b-bd81222aca02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:46.866109 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-7cce4576-a472-467e-950b-bd81222aca02 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:49:46.872594 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7cce4576-a472-467e-950b-bd81222aca02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:49:46.872718 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049fae76-842d-42ee-b3e3-07fdc25a0fbd None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:46.895271 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:46.904259 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d507a74-46b6-4c48-99b0-e4c01a41d1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:46.904900 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d507a74-46b6-4c48-99b0-e4c01a41d1e6 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:46.905187 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d507a74-46b6-4c48-99b0-e4c01a41d1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:46.905468 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d507a74-46b6-4c48-99b0-e4c01a41d1e6 None admin] PATH_INFO: `/v3/users/dbe8c1627cd14ceeb40d3289822f740c` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:46.907097 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d507a74-46b6-4c48-99b0-e4c01a41d1e6 None admin] RBAC: Authorizing `identity:get_user(user_id=dbe8c1627cd14ceeb40d3289822f740c)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:46.908664 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d507a74-46b6-4c48-99b0-e4c01a41d1e6 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:46.914841 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 57/114] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 26 10:49:46 2022] GET /identity/v3/users/dbe8c1627cd14ceeb40d3289822f740c => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:46.914841 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d507a74-46b6-4c48-99b0-e4c01a41d1e6 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:46.942589 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 58/115] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:49:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:49:46.943619 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce4576-a472-467e-950b-bd81222aca02 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:47.046893 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d507a74-46b6-4c48-99b0-e4c01a41d1e6 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:47.053752 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce4576-a472-467e-950b-bd81222aca02 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:47.089308 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad5cfd-225e-49a1-b3ad-d27f24c177bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:47.090038 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad5cfd-225e-49a1-b3ad-d27f24c177bc None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:47.090401 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad5cfd-225e-49a1-b3ad-d27f24c177bc None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:47.090755 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad5cfd-225e-49a1-b3ad-d27f24c177bc None admin] PATH_INFO: `/v3/projects/d161ac8d78bd458891d682168cd22b97` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:47.091950 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad5cfd-225e-49a1-b3ad-d27f24c177bc None admin] RBAC: Authorizing `identity:get_project(project_id=d161ac8d78bd458891d682168cd22b97)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:47.093139 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de0671-e650-457e-b9f9-40ab8a05f247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:47.093586 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad5cfd-225e-49a1-b3ad-d27f24c177bc None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:47.094733 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de0671-e650-457e-b9f9-40ab8a05f247 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:47.095199 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de0671-e650-457e-b9f9-40ab8a05f247 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:47.095717 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de0671-e650-457e-b9f9-40ab8a05f247 None admin] PATH_INFO: `/v3/projects/d161ac8d78bd458891d682168cd22b97` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:47.096152 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 59/116] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 26 10:49:46 2022] GET /identity/v3/projects/d161ac8d78bd458891d682168cd22b97 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:47.097062 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad5cfd-225e-49a1-b3ad-d27f24c177bc None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:47.097780 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de0671-e650-457e-b9f9-40ab8a05f247 None admin] RBAC: Authorizing `identity:get_project(project_id=d161ac8d78bd458891d682168cd22b97)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:47.099859 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de0671-e650-457e-b9f9-40ab8a05f247 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:47.102779 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 58/117] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 26 10:49:46 2022] GET /identity/v3/projects/d161ac8d78bd458891d682168cd22b97 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:47.103879 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de0671-e650-457e-b9f9-40ab8a05f247 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:47.108467 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:47.130012 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:47.201494 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad5cfd-225e-49a1-b3ad-d27f24c177bc None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:47.231414 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de0671-e650-457e-b9f9-40ab8a05f247 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:47.236190 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df3abd-73d3-4e61-8f8d-bbdb92b14d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:47.236810 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df3abd-73d3-4e61-8f8d-bbdb92b14d80 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:47.237099 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df3abd-73d3-4e61-8f8d-bbdb92b14d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:47.237378 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df3abd-73d3-4e61-8f8d-bbdb92b14d80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:47.267012 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ae4e8-848c-4ed6-a056-ce410d730562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:47.267633 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ae4e8-848c-4ed6-a056-ce410d730562 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:47.267917 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ae4e8-848c-4ed6-a056-ce410d730562 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:47.268226 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ae4e8-848c-4ed6-a056-ce410d730562 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:47.268956 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9ae4e8-848c-4ed6-a056-ce410d730562 None admin] RBAC: Adding query filter params (role.id=5d5a8bcef7c8455c9bb6b49e113e74c7, scope.project.id=d161ac8d78bd458891d682168cd22b97, user.id=dbe8c1627cd14ceeb40d3289822f740c) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:49:47.269268 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9ae4e8-848c-4ed6-a056-ce410d730562 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:47.270726 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9ae4e8-848c-4ed6-a056-ce410d730562 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:47.276411 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 59/118] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 26 10:49:47 2022] GET /identity/v3/role_assignments?user.id=dbe8c1627cd14ceeb40d3289822f740c&scope.project.id=d161ac8d78bd458891d682168cd22b97&role.id=5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:47.276411 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ae4e8-848c-4ed6-a056-ce410d730562 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:47.315119 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df3abd-73d3-4e61-8f8d-bbdb92b14d80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:47.316717 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df3abd-73d3-4e61-8f8d-bbdb92b14d80 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:47.355944 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:47.362546 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:47.397423 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ae4e8-848c-4ed6-a056-ce410d730562 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:47.435132 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c43b32-94f9-4b95-b6d1-f4d9d8164258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:47.435758 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c43b32-94f9-4b95-b6d1-f4d9d8164258 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:47.436042 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c43b32-94f9-4b95-b6d1-f4d9d8164258 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:47.436348 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c43b32-94f9-4b95-b6d1-f4d9d8164258 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:47.437089 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c43b32-94f9-4b95-b6d1-f4d9d8164258 None admin] RBAC: Adding query filter params (role.id=a29ce5d75abc411488ef339c191e6d05, scope.project.id=d161ac8d78bd458891d682168cd22b97, user.id=dbe8c1627cd14ceeb40d3289822f740c) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:49:47.437401 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c43b32-94f9-4b95-b6d1-f4d9d8164258 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:47.439506 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c43b32-94f9-4b95-b6d1-f4d9d8164258 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:47.440916 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 60/119] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 26 10:49:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 26 10:49:47.441641 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df3abd-73d3-4e61-8f8d-bbdb92b14d80 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:47.446776 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 60/120] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 26 10:49:47 2022] GET /identity/v3/role_assignments?user.id=dbe8c1627cd14ceeb40d3289822f740c&scope.project.id=d161ac8d78bd458891d682168cd22b97&role.id=a29ce5d75abc411488ef339c191e6d05 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:47.447505 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c43b32-94f9-4b95-b6d1-f4d9d8164258 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:47.579146 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c43b32-94f9-4b95-b6d1-f4d9d8164258 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:47.588745 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df3abd-73d3-4e61-8f8d-bbdb92b14d80 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:47.620314 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:47.622311 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:47.627178 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5b1fe-c34f-4809-983e-c6d853f58031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:47.627332 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6dc0a-a6e2-4001-a443-000cc8e5b046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:47.627669 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5b1fe-c34f-4809-983e-c6d853f58031 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:47.627871 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6dc0a-a6e2-4001-a443-000cc8e5b046 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:47.627980 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5b1fe-c34f-4809-983e-c6d853f58031 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:47.628183 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6dc0a-a6e2-4001-a443-000cc8e5b046 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:47.628348 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5b1fe-c34f-4809-983e-c6d853f58031 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:47.628493 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6dc0a-a6e2-4001-a443-000cc8e5b046 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:47.630121 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6dc0a-a6e2-4001-a443-000cc8e5b046 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:47.630988 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6dc0a-a6e2-4001-a443-000cc8e5b046 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:47.632890 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 61/121] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:49:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:47.633674 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6dc0a-a6e2-4001-a443-000cc8e5b046 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:47.640305 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf5b1fe-c34f-4809-983e-c6d853f58031 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:49:47.646562 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-ddf5b1fe-c34f-4809-983e-c6d853f58031 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 26 10:49:47.646562 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:49:47.646562 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:49:47.646562 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:49:47.646562 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:49:47.646562 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:49:47.646562 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:49:47.646562 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:49:47.646562 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:49:47.646562 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:49:47.646562 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:49:47.646562 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:49:47.646562 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:49:47.646562 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:49:47.646562 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:49:47.646562 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:49:47.647474 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:49:47.647474 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:49:47.647474 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:49:47.647474 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:49:47.647474 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:49:47.647474 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:49:47.647474 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:49:47.647474 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:49:47.647474 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:49:47.647474 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:49:47.647474 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:49:47.647474 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:49:47.647474 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:49:47.647474 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:49:47.647474 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:49:47.647474 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:49:47.648741 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:49:47.648741 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:49:47.648741 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:49:47.648741 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:49:47.648741 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:49:47.648741 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:49:47.648741 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:49:47.648741 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:49:47.648741 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:49:47.648741 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:49:47.648741 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 26 10:49:47.648741 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:49:47.648741 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 61/122] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 26 10:49:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:49:47.649587 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5b1fe-c34f-4809-983e-c6d853f58031 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:47.742969 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6dc0a-a6e2-4001-a443-000cc8e5b046 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:47.759272 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5b1fe-c34f-4809-983e-c6d853f58031 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:47.776156 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6814dc-238f-4789-aa87-d8fc5e0557ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:47.776799 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6814dc-238f-4789-aa87-d8fc5e0557ab None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:47.777076 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6814dc-238f-4789-aa87-d8fc5e0557ab None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:47.777350 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6814dc-238f-4789-aa87-d8fc5e0557ab None admin] PATH_INFO: `/v3/projects/6b801626292e4924a3f632686ec48fff` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:47.778450 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6814dc-238f-4789-aa87-d8fc5e0557ab None admin] RBAC: Authorizing `identity:get_project(project_id=6b801626292e4924a3f632686ec48fff)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:47.779894 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6814dc-238f-4789-aa87-d8fc5e0557ab None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:47.781547 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 62/123] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 26 10:49:47 2022] GET /identity/v3/projects/6b801626292e4924a3f632686ec48fff => generated 312 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:47.782304 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6814dc-238f-4789-aa87-d8fc5e0557ab None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:47.799746 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a417ed-d671-4b2f-b2fb-9ff0c2ebbbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:47.800395 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a417ed-d671-4b2f-b2fb-9ff0c2ebbbef None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:47.800682 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a417ed-d671-4b2f-b2fb-9ff0c2ebbbef None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:47.800970 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a417ed-d671-4b2f-b2fb-9ff0c2ebbbef None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:47.801627 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a417ed-d671-4b2f-b2fb-9ff0c2ebbbef None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:47.803114 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a417ed-d671-4b2f-b2fb-9ff0c2ebbbef None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:47.846644 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:47.878816 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6814dc-238f-4789-aa87-d8fc5e0557ab None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:47.898349 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 62/124] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Oct 26 10:49:47 2022] POST /identity/v3/projects => generated 302 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:49:47.899175 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a417ed-d671-4b2f-b2fb-9ff0c2ebbbef None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:47.926868 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f39eb-cf03-4877-beab-44a3df4929ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:47.927584 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f39eb-cf03-4877-beab-44a3df4929ae None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:47.927869 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f39eb-cf03-4877-beab-44a3df4929ae None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:47.928175 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f39eb-cf03-4877-beab-44a3df4929ae None admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:47.928863 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f39eb-cf03-4877-beab-44a3df4929ae None admin] RBAC: Adding query filter params (name=reader) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:49:47.929174 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f39eb-cf03-4877-beab-44a3df4929ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:47.930741 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f39eb-cf03-4877-beab-44a3df4929ae None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:47.941199 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 63/125] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Oct 26 10:49:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:47.946824 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f39eb-cf03-4877-beab-44a3df4929ae None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:47.955858 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:48.020423 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a417ed-d671-4b2f-b2fb-9ff0c2ebbbef None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:48.060227 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32709801-fda1-4a2d-944a-a0b853aff34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:48.061169 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32709801-fda1-4a2d-944a-a0b853aff34f None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:48.061630 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32709801-fda1-4a2d-944a-a0b853aff34f None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:48.061914 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32709801-fda1-4a2d-944a-a0b853aff34f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:48.063212 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32709801-fda1-4a2d-944a-a0b853aff34f None admin] RBAC: Adding query filter params (role.id=5d5a8bcef7c8455c9bb6b49e113e74c7, scope.project.id=6b801626292e4924a3f632686ec48fff, user.id=dbe8c1627cd14ceeb40d3289822f740c) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:49:48.063533 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32709801-fda1-4a2d-944a-a0b853aff34f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:48.065032 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32709801-fda1-4a2d-944a-a0b853aff34f None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:48.066612 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f39eb-cf03-4877-beab-44a3df4929ae None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:48.072508 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 63/126] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 26 10:49:47 2022] GET /identity/v3/role_assignments?user.id=dbe8c1627cd14ceeb40d3289822f740c&scope.project.id=6b801626292e4924a3f632686ec48fff&role.id=5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:48.101365 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:48.107611 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74500b6-5e9d-4c00-a434-002e466ccc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:48.108298 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74500b6-5e9d-4c00-a434-002e466ccc4a None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:48.108582 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74500b6-5e9d-4c00-a434-002e466ccc4a None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:48.110206 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74500b6-5e9d-4c00-a434-002e466ccc4a None admin] PATH_INFO: `/v3/users/4d586dd3bf9f4644b302dd187b9c2f4e` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:48.126773 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74500b6-5e9d-4c00-a434-002e466ccc4a None admin] RBAC: Authorizing `identity:get_user(user_id=4d586dd3bf9f4644b302dd187b9c2f4e)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:48.128422 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74500b6-5e9d-4c00-a434-002e466ccc4a None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:48.130218 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 64/127] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 26 10:49:47 2022] GET /identity/v3/users/4d586dd3bf9f4644b302dd187b9c2f4e => generated 289 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:49:48.136216 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32709801-fda1-4a2d-944a-a0b853aff34f None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:48.246851 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32709801-fda1-4a2d-944a-a0b853aff34f None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:48.254835 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:48.283712 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0824751-b7ff-4531-a65d-5a099fa77bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:48.284493 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0824751-b7ff-4531-a65d-5a099fa77bfc None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:48.284785 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0824751-b7ff-4531-a65d-5a099fa77bfc None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:48.285121 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0824751-b7ff-4531-a65d-5a099fa77bfc None admin] PATH_INFO: `/v3/projects/d161ac8d78bd458891d682168cd22b97` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:48.286546 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0824751-b7ff-4531-a65d-5a099fa77bfc None admin] RBAC: Authorizing `identity:get_project(project_id=d161ac8d78bd458891d682168cd22b97)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:48.288077 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0824751-b7ff-4531-a65d-5a099fa77bfc None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:48.289917 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 64/128] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 26 10:49:48 2022] GET /identity/v3/projects/d161ac8d78bd458891d682168cd22b97 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:48.295612 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74500b6-5e9d-4c00-a434-002e466ccc4a None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:48.398869 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74500b6-5e9d-4c00-a434-002e466ccc4a None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:48.432714 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9adbbc-3488-4e8d-b0ba-772c3c81d56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:48.433390 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9adbbc-3488-4e8d-b0ba-772c3c81d56b None admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:48.433677 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9adbbc-3488-4e8d-b0ba-772c3c81d56b None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:48.433956 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9adbbc-3488-4e8d-b0ba-772c3c81d56b None admin] PATH_INFO: `/v3/projects/d161ac8d78bd458891d682168cd22b97/users/4d586dd3bf9f4644b302dd187b9c2f4e/roles/f44ac39d2011426b83226a3c55468d77` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:48.435885 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9adbbc-3488-4e8d-b0ba-772c3c81d56b None admin] RBAC: Authorizing `identity:create_grant(project_id=d161ac8d78bd458891d682168cd22b97, user_id=4d586dd3bf9f4644b302dd187b9c2f4e, role_id=f44ac39d2011426b83226a3c55468d77)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:48.437379 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9adbbc-3488-4e8d-b0ba-772c3c81d56b None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:48.531963 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 65/129] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 26 10:49:48 2022] PUT /identity/v3/projects/d161ac8d78bd458891d682168cd22b97/users/4d586dd3bf9f4644b302dd187b9c2f4e/roles/f44ac39d2011426b83226a3c55468d77 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:49:50.094293 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edd9d5-0d71-43ad-9399-25b41b4907d5 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:50.094844 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edd9d5-0d71-43ad-9399-25b41b4907d5 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:50.094844 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edd9d5-0d71-43ad-9399-25b41b4907d5 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:50.096235 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 65/130] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:49:50.101389 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00579ba0-03de-4e55-b785-0b5b56c949bc None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:50.101792 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00579ba0-03de-4e55-b785-0b5b56c949bc None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:50.101946 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00579ba0-03de-4e55-b785-0b5b56c949bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:50.120045 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-00579ba0-03de-4e55-b785-0b5b56c949bc None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:49:50.121257 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-00579ba0-03de-4e55-b785-0b5b56c949bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:49:50.163630 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:50.186475 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 66/131] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:49:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:49:50.457261 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edd9d5-0d71-43ad-9399-25b41b4907d5 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:50.559385 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edd9d5-0d71-43ad-9399-25b41b4907d5 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:50.593472 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332fd67-add4-4f58-a306-9b5b08a59fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:50.594140 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332fd67-add4-4f58-a306-9b5b08a59fdb None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:50.594420 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332fd67-add4-4f58-a306-9b5b08a59fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:50.594692 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332fd67-add4-4f58-a306-9b5b08a59fdb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:50.595783 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8332fd67-add4-4f58-a306-9b5b08a59fdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:50.597252 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8332fd67-add4-4f58-a306-9b5b08a59fdb None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:50.598810 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 66/132] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:49:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:50.604444 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00579ba0-03de-4e55-b785-0b5b56c949bc None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:50.647989 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2a684-d583-4bfb-baf7-c8184e3c9fff None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:50.648314 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2a684-d583-4bfb-baf7-c8184e3c9fff None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:50.648606 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2a684-d583-4bfb-baf7-c8184e3c9fff None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:50.650502 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 67/133] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:49:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:49:50.655457 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f82ddf-387d-4c7a-b017-0e8abaf21485 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:50.655752 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f82ddf-387d-4c7a-b017-0e8abaf21485 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:50.656039 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f82ddf-387d-4c7a-b017-0e8abaf21485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:50.674436 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-72f82ddf-387d-4c7a-b017-0e8abaf21485 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:49:50.675654 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-72f82ddf-387d-4c7a-b017-0e8abaf21485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:49:50.701335 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00579ba0-03de-4e55-b785-0b5b56c949bc None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:50.710887 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:50.734801 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3197fe-6b85-4981-96a2-ebd516866b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:50.735418 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3197fe-6b85-4981-96a2-ebd516866b49 None admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:50.744688 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3197fe-6b85-4981-96a2-ebd516866b49 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:50.744688 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3197fe-6b85-4981-96a2-ebd516866b49 None admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:50.744688 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3197fe-6b85-4981-96a2-ebd516866b49 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:50.744688 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3197fe-6b85-4981-96a2-ebd516866b49 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:50.745037 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 68/134] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:49:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:49:50.975674 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 67/135] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Oct 26 10:49:50 2022] POST /identity/v3/users => generated 283 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:49:51.019082 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f82ddf-387d-4c7a-b017-0e8abaf21485 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:51.123051 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f82ddf-387d-4c7a-b017-0e8abaf21485 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:51.159595 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc35e3d-d62a-46b7-b1a9-406edba4d64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:51.160268 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc35e3d-d62a-46b7-b1a9-406edba4d64c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:51.160557 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc35e3d-d62a-46b7-b1a9-406edba4d64c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:51.161098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc35e3d-d62a-46b7-b1a9-406edba4d64c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:51.171445 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc35e3d-d62a-46b7-b1a9-406edba4d64c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:49:51.178195 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-4dc35e3d-d62a-46b7-b1a9-406edba4d64c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 26 10:49:51.178195 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:49:51.178195 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:49:51.178195 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:49:51.178195 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:49:51.178195 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:49:51.178195 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:49:51.178195 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:49:51.178195 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:49:51.178195 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:49:51.178195 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:49:51.178195 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:49:51.178195 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:49:51.178195 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:49:51.178195 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:49:51.178195 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:49:51.179286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:49:51.179286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:49:51.179286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:49:51.179286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:49:51.179286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:49:51.179286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:49:51.179286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:49:51.179286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:49:51.179286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:49:51.179286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:49:51.179286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:49:51.179286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:49:51.179286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:49:51.179286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:49:51.179286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:49:51.179286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:49:51.180273 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:49:51.180273 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:49:51.180273 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:49:51.180273 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:49:51.180273 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:49:51.180273 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:49:51.180273 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:49:51.180273 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:49:51.180273 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:49:51.180273 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:49:51.180273 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 26 10:49:51.180273 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:49:51.180273 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 69/136] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 26 10:49:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:49:51.183838 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3197fe-6b85-4981-96a2-ebd516866b49 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:51.223864 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:51.298173 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3197fe-6b85-4981-96a2-ebd516866b49 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:51.334016 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f6b4f-f9ea-4799-a595-4c03f503058e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:51.334639 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f6b4f-f9ea-4799-a595-4c03f503058e None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:51.334927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f6b4f-f9ea-4799-a595-4c03f503058e None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:51.335205 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f6b4f-f9ea-4799-a595-4c03f503058e None admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:51.335887 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f6b4f-f9ea-4799-a595-4c03f503058e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:49:51.338722 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f6b4f-f9ea-4799-a595-4c03f503058e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:51.338722 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f6b4f-f9ea-4799-a595-4c03f503058e None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:51.349582 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 68/137] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Oct 26 10:49:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:51.355419 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc35e3d-d62a-46b7-b1a9-406edba4d64c None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:51.395345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:51.469662 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc35e3d-d62a-46b7-b1a9-406edba4d64c None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:51.505663 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b250e-8aa6-48e7-9999-bcfecdf1f515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:51.506314 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b250e-8aa6-48e7-9999-bcfecdf1f515 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:51.506603 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b250e-8aa6-48e7-9999-bcfecdf1f515 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:51.506889 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b250e-8aa6-48e7-9999-bcfecdf1f515 None admin] PATH_INFO: `/v3/users/4d586dd3bf9f4644b302dd187b9c2f4e` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:51.508038 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b250e-8aa6-48e7-9999-bcfecdf1f515 None admin] RBAC: Authorizing `identity:get_user(user_id=4d586dd3bf9f4644b302dd187b9c2f4e)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:51.509545 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b250e-8aa6-48e7-9999-bcfecdf1f515 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:51.511371 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 70/138] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 26 10:49:51 2022] GET /identity/v3/users/4d586dd3bf9f4644b302dd187b9c2f4e => generated 289 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:51.516861 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f6b4f-f9ea-4799-a595-4c03f503058e None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:51.617237 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:51.623313 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f6b4f-f9ea-4799-a595-4c03f503058e None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:51.663503 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559eb41-393c-4999-906c-7eb66ce23218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:51.664486 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559eb41-393c-4999-906c-7eb66ce23218 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:51.665126 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559eb41-393c-4999-906c-7eb66ce23218 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:51.665405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559eb41-393c-4999-906c-7eb66ce23218 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:51.733794 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559eb41-393c-4999-906c-7eb66ce23218 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:51.735803 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559eb41-393c-4999-906c-7eb66ce23218 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:51.834798 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:51.841812 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 69/139] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 26 10:49:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 26 10:49:51.848550 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b250e-8aa6-48e7-9999-bcfecdf1f515 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:51.952389 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:51.955888 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b250e-8aa6-48e7-9999-bcfecdf1f515 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:51.990982 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64baf1d-b23a-4e3f-a472-49edab9ec6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:51.991639 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64baf1d-b23a-4e3f-a472-49edab9ec6d6 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:51.991939 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64baf1d-b23a-4e3f-a472-49edab9ec6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:51.992249 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64baf1d-b23a-4e3f-a472-49edab9ec6d6 None admin] PATH_INFO: `/v3/projects/d161ac8d78bd458891d682168cd22b97` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:51.993403 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64baf1d-b23a-4e3f-a472-49edab9ec6d6 None admin] RBAC: Authorizing `identity:get_project(project_id=d161ac8d78bd458891d682168cd22b97)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:51.994887 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64baf1d-b23a-4e3f-a472-49edab9ec6d6 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:51.996579 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 71/140] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 26 10:49:51 2022] GET /identity/v3/projects/d161ac8d78bd458891d682168cd22b97 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:52.004534 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559eb41-393c-4999-906c-7eb66ce23218 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:52.110621 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559eb41-393c-4999-906c-7eb66ce23218 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:52.150168 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9f51b-488d-4162-bb93-72ed0d70d996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:52.150795 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9f51b-488d-4162-bb93-72ed0d70d996 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:52.151080 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9f51b-488d-4162-bb93-72ed0d70d996 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:52.151357 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9f51b-488d-4162-bb93-72ed0d70d996 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:52.152122 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9f51b-488d-4162-bb93-72ed0d70d996 None admin] RBAC: Adding query filter params (role.id=f44ac39d2011426b83226a3c55468d77, scope.project.id=d161ac8d78bd458891d682168cd22b97, user.id=4d586dd3bf9f4644b302dd187b9c2f4e) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:49:52.152436 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9f51b-488d-4162-bb93-72ed0d70d996 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:52.153932 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9f51b-488d-4162-bb93-72ed0d70d996 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:52.161283 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 70/141] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 26 10:49:52 2022] GET /identity/v3/role_assignments?user.id=4d586dd3bf9f4644b302dd187b9c2f4e&scope.project.id=d161ac8d78bd458891d682168cd22b97&role.id=f44ac39d2011426b83226a3c55468d77 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:53.480702 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0ceda-860f-466f-8fd9-4cfbae52ceec None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:53.481242 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0ceda-860f-466f-8fd9-4cfbae52ceec None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:53.481242 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0ceda-860f-466f-8fd9-4cfbae52ceec None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:53.482666 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 72/142] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:49:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:49:53.489191 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6d487-f94e-4c6c-8963-d493564fab7a None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:53.489738 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6d487-f94e-4c6c-8963-d493564fab7a None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:53.489738 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6d487-f94e-4c6c-8963-d493564fab7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:53.509667 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-69b6d487-f94e-4c6c-8963-d493564fab7a None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:49:53.510887 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-69b6d487-f94e-4c6c-8963-d493564fab7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:49:53.519481 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bbab1-6b96-4d4f-b49e-52337623f74f None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:53.519774 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bbab1-6b96-4d4f-b49e-52337623f74f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:53.520269 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bbab1-6b96-4d4f-b49e-52337623f74f None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:53.521617 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 73/143] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:49:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:49:53.526455 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66316436-02ad-49ac-9509-e0bab6c5dd52 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:53.526745 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66316436-02ad-49ac-9509-e0bab6c5dd52 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:53.527237 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66316436-02ad-49ac-9509-e0bab6c5dd52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:53.546799 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-66316436-02ad-49ac-9509-e0bab6c5dd52 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:49:53.548840 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-66316436-02ad-49ac-9509-e0bab6c5dd52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:49:53.570260 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:53.581005 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 71/144] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:49:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:49:53.603070 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445b7f4-7ca0-4a69-98f4-4ec970f12ace None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:53.603357 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445b7f4-7ca0-4a69-98f4-4ec970f12ace None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:53.603554 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445b7f4-7ca0-4a69-98f4-4ec970f12ace None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:53.605066 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 72/145] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:49:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:49:53.609918 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3600e-5e1b-435f-9814-4febf1de4e85 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:53.610740 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3600e-5e1b-435f-9814-4febf1de4e85 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:53.611020 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3600e-5e1b-435f-9814-4febf1de4e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:53.619066 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 74/146] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:49:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:49:53.628813 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-a9e3600e-5e1b-435f-9814-4febf1de4e85 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:49:53.630000 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-a9e3600e-5e1b-435f-9814-4febf1de4e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:49:53.695868 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 73/147] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:49:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:49:53.850654 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66316436-02ad-49ac-9509-e0bab6c5dd52 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:53.884751 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3600e-5e1b-435f-9814-4febf1de4e85 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:53.949219 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:53.954177 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66316436-02ad-49ac-9509-e0bab6c5dd52 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:53.988926 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3600e-5e1b-435f-9814-4febf1de4e85 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:53.989264 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42d269-d8c5-436d-b213-e8a5b0307fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:53.989747 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42d269-d8c5-436d-b213-e8a5b0307fa1 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:53.990034 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42d269-d8c5-436d-b213-e8a5b0307fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:53.990314 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42d269-d8c5-436d-b213-e8a5b0307fa1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:54.000328 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a42d269-d8c5-436d-b213-e8a5b0307fa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:49:54.005820 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-6a42d269-d8c5-436d-b213-e8a5b0307fa1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 26 10:49:54.005820 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:49:54.005820 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:49:54.005820 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:49:54.005820 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:49:54.005820 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:49:54.005820 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:49:54.005820 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:49:54.005820 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:49:54.005820 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:49:54.005820 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:49:54.005820 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:49:54.005820 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:49:54.005820 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:49:54.005820 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:49:54.005820 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:49:54.006757 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:49:54.006757 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:49:54.006757 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:49:54.006757 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:49:54.006757 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:49:54.006757 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:49:54.006757 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:49:54.006757 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:49:54.006757 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:49:54.006757 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:49:54.006757 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:49:54.006757 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:49:54.006757 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:49:54.006757 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:49:54.006757 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:49:54.006757 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:49:54.008657 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:49:54.008657 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:49:54.008657 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:49:54.008657 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:49:54.008657 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:49:54.008657 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:49:54.008657 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:49:54.008657 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:49:54.008657 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:49:54.008657 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:49:54.008657 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 26 10:49:54.008657 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:49:54.008657 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 75/148] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Oct 26 10:49:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:49:54.008657 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42d269-d8c5-436d-b213-e8a5b0307fa1 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:54.010133 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:54.023596 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9f722-d38f-4be8-924f-ad66ec3c0faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:54.024269 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9f722-d38f-4be8-924f-ad66ec3c0faf None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:54.024553 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9f722-d38f-4be8-924f-ad66ec3c0faf None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:54.024829 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9f722-d38f-4be8-924f-ad66ec3c0faf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:54.034558 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9f722-d38f-4be8-924f-ad66ec3c0faf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:49:54.039672 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-27e9f722-d38f-4be8-924f-ad66ec3c0faf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:49:54.039672 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:49:54.039672 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:49:54.039672 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:49:54.039672 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:49:54.039672 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:49:54.039672 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:49:54.039672 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:49:54.039672 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:49:54.039672 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:49:54.039672 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:49:54.039672 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:49:54.039672 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:49:54.039672 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:49:54.039672 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:49:54.039672 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:49:54.040823 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:49:54.040823 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:49:54.040823 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:49:54.040823 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:49:54.040823 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:49:54.040823 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:49:54.040823 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:49:54.040823 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:49:54.040823 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:49:54.040823 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:49:54.040823 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:49:54.040823 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:49:54.040823 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:49:54.040823 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:49:54.040823 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:49:54.040823 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:49:54.041644 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:49:54.041644 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:49:54.041644 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:49:54.041644 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:49:54.041644 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:49:54.041644 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:49:54.041644 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:49:54.041644 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:49:54.041644 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:49:54.041644 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:49:54.041644 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:49:54.041644 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:49:54.041644 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 74/149] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 26 10:49:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:49:54.046838 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9f722-d38f-4be8-924f-ad66ec3c0faf None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:54.108373 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42d269-d8c5-436d-b213-e8a5b0307fa1 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:54.141897 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb4ac7-cd3a-4df4-8b53-2ba5520246e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:54.142491 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb4ac7-cd3a-4df4-8b53-2ba5520246e7 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:54.142778 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb4ac7-cd3a-4df4-8b53-2ba5520246e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:54.143055 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb4ac7-cd3a-4df4-8b53-2ba5520246e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:54.143277 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9f722-d38f-4be8-924f-ad66ec3c0faf None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:54.144216 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb4ac7-cd3a-4df4-8b53-2ba5520246e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:54.145689 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb4ac7-cd3a-4df4-8b53-2ba5520246e7 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:54.147248 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 76/150] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:49:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:54.148025 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb4ac7-cd3a-4df4-8b53-2ba5520246e7 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:54.175457 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:54.178410 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82714b8c-8eb3-4384-b505-87616cdd5d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:54.179372 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82714b8c-8eb3-4384-b505-87616cdd5d89 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:54.179646 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82714b8c-8eb3-4384-b505-87616cdd5d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:54.179911 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82714b8c-8eb3-4384-b505-87616cdd5d89 None admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:54.180593 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82714b8c-8eb3-4384-b505-87616cdd5d89 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:49:54.180890 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82714b8c-8eb3-4384-b505-87616cdd5d89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:54.182276 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82714b8c-8eb3-4384-b505-87616cdd5d89 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:54.190793 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 75/151] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 26 10:49:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:54.190793 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82714b8c-8eb3-4384-b505-87616cdd5d89 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:54.233029 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:54.247414 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb4ac7-cd3a-4df4-8b53-2ba5520246e7 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:54.280527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d0f07-c118-465b-8968-749181aa9aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:54.281137 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d0f07-c118-465b-8968-749181aa9aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:54.281429 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d0f07-c118-465b-8968-749181aa9aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:54.281704 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d0f07-c118-465b-8968-749181aa9aa8 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:54.282872 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d0f07-c118-465b-8968-749181aa9aa8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:49:54.283182 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d0f07-c118-465b-8968-749181aa9aa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:54.284592 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d0f07-c118-465b-8968-749181aa9aa8 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:54.289161 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82714b8c-8eb3-4384-b505-87616cdd5d89 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:54.292699 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 77/152] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 26 10:49:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:54.293490 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d0f07-c118-465b-8968-749181aa9aa8 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:54.322993 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26965c83-de5c-49bf-921f-e0d483d60b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:54.323599 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26965c83-de5c-49bf-921f-e0d483d60b18 None admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:54.323876 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26965c83-de5c-49bf-921f-e0d483d60b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:54.324186 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26965c83-de5c-49bf-921f-e0d483d60b18 None admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:54.324833 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26965c83-de5c-49bf-921f-e0d483d60b18 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:54.326279 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26965c83-de5c-49bf-921f-e0d483d60b18 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:54.380343 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:54.392340 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d0f07-c118-465b-8968-749181aa9aa8 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:54.424747 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74fa28-4cdd-49b4-8e52-3b82dec65881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:54.425369 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74fa28-4cdd-49b4-8e52-3b82dec65881 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:54.425650 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74fa28-4cdd-49b4-8e52-3b82dec65881 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:54.425927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74fa28-4cdd-49b4-8e52-3b82dec65881 None admin] PATH_INFO: `/v3/users/14d20bdaf7c14eceb0899ab2ffdef18b` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:54.434896 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 76/153] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Oct 26 10:49:54 2022] POST /identity/v3/users => generated 297 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:49:54.435991 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26965c83-de5c-49bf-921f-e0d483d60b18 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:54.443042 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a74fa28-4cdd-49b4-8e52-3b82dec65881 None admin] RBAC: Authorizing `identity:get_user(user_id=14d20bdaf7c14eceb0899ab2ffdef18b)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:54.444608 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a74fa28-4cdd-49b4-8e52-3b82dec65881 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:54.446388 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 78/154] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 26 10:49:54 2022] GET /identity/v3/users/14d20bdaf7c14eceb0899ab2ffdef18b => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:54.452519 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74fa28-4cdd-49b4-8e52-3b82dec65881 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:54.571580 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:54.572299 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74fa28-4cdd-49b4-8e52-3b82dec65881 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:54.577445 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26965c83-de5c-49bf-921f-e0d483d60b18 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:54.610742 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c4ec0-668d-4e3e-95b6-dfc3372645a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:54.611395 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c4ec0-668d-4e3e-95b6-dfc3372645a0 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:54.611723 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c4ec0-668d-4e3e-95b6-dfc3372645a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:54.612007 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c4ec0-668d-4e3e-95b6-dfc3372645a0 None admin] PATH_INFO: `/v3/projects/9644a41001314f56b4cb83f7f5d1b772` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:54.613177 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44c4ec0-668d-4e3e-95b6-dfc3372645a0 None admin] RBAC: Authorizing `identity:get_project(project_id=9644a41001314f56b4cb83f7f5d1b772)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:54.614642 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44c4ec0-668d-4e3e-95b6-dfc3372645a0 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:54.616640 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 79/155] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 26 10:49:54 2022] GET /identity/v3/projects/9644a41001314f56b4cb83f7f5d1b772 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:49:54.620897 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45607ee5-73a7-4ba2-b21f-a6ed906824ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:54.621573 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45607ee5-73a7-4ba2-b21f-a6ed906824ba None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:54.621856 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45607ee5-73a7-4ba2-b21f-a6ed906824ba None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:54.621966 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c4ec0-668d-4e3e-95b6-dfc3372645a0 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:54.622135 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45607ee5-73a7-4ba2-b21f-a6ed906824ba None admin] PATH_INFO: `/v3/users/14d20bdaf7c14eceb0899ab2ffdef18b` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:54.623315 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45607ee5-73a7-4ba2-b21f-a6ed906824ba None admin] RBAC: Authorizing `identity:get_user(user_id=14d20bdaf7c14eceb0899ab2ffdef18b)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:54.625261 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45607ee5-73a7-4ba2-b21f-a6ed906824ba None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:54.627741 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 77/156] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 26 10:49:54 2022] GET /identity/v3/users/14d20bdaf7c14eceb0899ab2ffdef18b => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:54.632964 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45607ee5-73a7-4ba2-b21f-a6ed906824ba None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:54.639637 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:54.752734 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c4ec0-668d-4e3e-95b6-dfc3372645a0 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:54.766710 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45607ee5-73a7-4ba2-b21f-a6ed906824ba None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:54.796377 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ecbb09-090f-46a8-8c52-3ad9073ebd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:54.797088 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecbb09-090f-46a8-8c52-3ad9073ebd74 None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:54.797346 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecbb09-090f-46a8-8c52-3ad9073ebd74 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:54.798167 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecbb09-090f-46a8-8c52-3ad9073ebd74 None admin] PATH_INFO: `/v3/projects/9644a41001314f56b4cb83f7f5d1b772/users/14d20bdaf7c14eceb0899ab2ffdef18b/roles/a29ce5d75abc411488ef339c191e6d05` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:54.801756 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ecbb09-090f-46a8-8c52-3ad9073ebd74 None admin] RBAC: Authorizing `identity:create_grant(project_id=9644a41001314f56b4cb83f7f5d1b772, user_id=14d20bdaf7c14eceb0899ab2ffdef18b, role_id=a29ce5d75abc411488ef339c191e6d05)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:54.803228 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ecbb09-090f-46a8-8c52-3ad9073ebd74 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:54.809953 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19811834-89c8-49e2-aaae-d7038015683d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:54.810605 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19811834-89c8-49e2-aaae-d7038015683d None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:54.810894 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19811834-89c8-49e2-aaae-d7038015683d None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:54.811174 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19811834-89c8-49e2-aaae-d7038015683d None admin] PATH_INFO: `/v3/projects/9644a41001314f56b4cb83f7f5d1b772` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:54.812353 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19811834-89c8-49e2-aaae-d7038015683d None admin] RBAC: Authorizing `identity:get_project(project_id=9644a41001314f56b4cb83f7f5d1b772)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:54.813870 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19811834-89c8-49e2-aaae-d7038015683d None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:54.815822 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 78/157] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 26 10:49:54 2022] GET /identity/v3/projects/9644a41001314f56b4cb83f7f5d1b772 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:49:54.821437 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19811834-89c8-49e2-aaae-d7038015683d None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:54.863971 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:54.882544 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 80/158] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 26 10:49:54 2022] PUT /identity/v3/projects/9644a41001314f56b4cb83f7f5d1b772/users/14d20bdaf7c14eceb0899ab2ffdef18b/roles/a29ce5d75abc411488ef339c191e6d05 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 10:49:54.964629 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19811834-89c8-49e2-aaae-d7038015683d None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:55.004278 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd54f4-ac57-4726-9867-db0b9d03da06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:55.004890 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd54f4-ac57-4726-9867-db0b9d03da06 None admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:55.005170 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd54f4-ac57-4726-9867-db0b9d03da06 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:55.005445 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd54f4-ac57-4726-9867-db0b9d03da06 None admin] PATH_INFO: `/v3/projects/9644a41001314f56b4cb83f7f5d1b772/users/14d20bdaf7c14eceb0899ab2ffdef18b/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:55.007448 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd54f4-ac57-4726-9867-db0b9d03da06 None admin] RBAC: Authorizing `identity:create_grant(project_id=9644a41001314f56b4cb83f7f5d1b772, user_id=14d20bdaf7c14eceb0899ab2ffdef18b, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:55.008944 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd54f4-ac57-4726-9867-db0b9d03da06 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:55.082133 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 79/159] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 26 10:49:54 2022] PUT /identity/v3/projects/9644a41001314f56b4cb83f7f5d1b772/users/14d20bdaf7c14eceb0899ab2ffdef18b/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 10:49:56.764201 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb3726-2fa5-49f2-974e-7fdeaae68800 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:56.764201 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb3726-2fa5-49f2-974e-7fdeaae68800 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:56.764201 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb3726-2fa5-49f2-974e-7fdeaae68800 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:56.764201 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 81/160] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:49:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:49:56.764873 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa569ead-d1b7-4f95-a9a3-21c42a982f8d None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:56.764873 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa569ead-d1b7-4f95-a9a3-21c42a982f8d None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:56.764873 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa569ead-d1b7-4f95-a9a3-21c42a982f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:56.780860 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-fa569ead-d1b7-4f95-a9a3-21c42a982f8d None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:49:56.782923 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-fa569ead-d1b7-4f95-a9a3-21c42a982f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:49:56.816637 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06220d7b-c6cb-4910-bf77-a5ce0dae320e None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:56.817348 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06220d7b-c6cb-4910-bf77-a5ce0dae320e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:56.817905 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06220d7b-c6cb-4910-bf77-a5ce0dae320e None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:56.819742 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 82/161] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:49:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:49:56.825294 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2d1f6-c40a-48d5-8949-241aed20b800 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:56.825582 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2d1f6-c40a-48d5-8949-241aed20b800 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:56.826058 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2d1f6-c40a-48d5-8949-241aed20b800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:56.850979 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-27b2d1f6-c40a-48d5-8949-241aed20b800 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:49:56.852712 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-27b2d1f6-c40a-48d5-8949-241aed20b800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:49:56.865197 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 80/162] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:49:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:49:56.932480 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 83/163] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:49:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:49:57.084174 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e9d42-3a43-459b-812f-f59cb5497ae5 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:57.084498 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e9d42-3a43-459b-812f-f59cb5497ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:57.084842 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e9d42-3a43-459b-812f-f59cb5497ae5 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:57.086480 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 81/164] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:49:57.091891 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25464d2-0724-4b10-9c75-ae0c8f7da257 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:57.092421 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25464d2-0724-4b10-9c75-ae0c8f7da257 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:57.092902 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25464d2-0724-4b10-9c75-ae0c8f7da257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:57.100524 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:57.113361 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-d25464d2-0724-4b10-9c75-ae0c8f7da257 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:49:57.114777 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d25464d2-0724-4b10-9c75-ae0c8f7da257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:49:57.131988 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e9d42-3a43-459b-812f-f59cb5497ae5 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:57.170038 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:57.206752 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 84/165] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:49:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:49:57.212995 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25464d2-0724-4b10-9c75-ae0c8f7da257 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:57.269945 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e9d42-3a43-459b-812f-f59cb5497ae5 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:57.305815 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca55bb-4e4f-4a2f-9a46-8f9e0fc0b1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:57.306452 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca55bb-4e4f-4a2f-9a46-8f9e0fc0b1c2 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:57.306734 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca55bb-4e4f-4a2f-9a46-8f9e0fc0b1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:57.307010 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca55bb-4e4f-4a2f-9a46-8f9e0fc0b1c2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:57.317406 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ca55bb-4e4f-4a2f-9a46-8f9e0fc0b1c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:49:57.322218 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-51ca55bb-4e4f-4a2f-9a46-8f9e0fc0b1c2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:49:57.322218 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:49:57.322218 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:49:57.322218 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:49:57.322218 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:49:57.322218 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:49:57.322218 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:49:57.322218 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:49:57.322218 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:49:57.322218 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:49:57.322218 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:49:57.322218 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:49:57.322218 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:49:57.322218 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:49:57.322218 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:49:57.322218 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:49:57.323249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:49:57.323249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:49:57.323249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:49:57.323249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:49:57.323249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:49:57.323249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:49:57.323249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:49:57.323249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:49:57.323249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:49:57.323249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:49:57.323249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:49:57.323249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:49:57.323249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:49:57.323249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:49:57.323249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:49:57.323249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:49:57.324349 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:49:57.324349 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:49:57.324349 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:49:57.324349 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:49:57.324349 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:49:57.324349 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:49:57.324349 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:49:57.324349 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:49:57.324349 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:49:57.324349 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:49:57.324349 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:49:57.324349 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:49:57.325087 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25464d2-0724-4b10-9c75-ae0c8f7da257 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:57.325170 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 82/166] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 26 10:49:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:49:57.325170 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46688f95-0fea-4d14-814c-0a4d9d9cd051 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:57.325170 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46688f95-0fea-4d14-814c-0a4d9d9cd051 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:57.325170 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46688f95-0fea-4d14-814c-0a4d9d9cd051 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:57.329994 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 83/167] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:49:57.331111 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46688f95-0fea-4d14-814c-0a4d9d9cd051 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:57.369136 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9d790-1ad7-4258-9605-df851d73c54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:57.369783 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9d790-1ad7-4258-9605-df851d73c54d None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:57.370098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9d790-1ad7-4258-9605-df851d73c54d None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:57.370332 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9d790-1ad7-4258-9605-df851d73c54d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:57.371428 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c9d790-1ad7-4258-9605-df851d73c54d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:57.372925 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c9d790-1ad7-4258-9605-df851d73c54d None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:57.379157 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 85/168] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:49:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:57.380345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47789e2-16f0-4f96-8001-bb117e802d16 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:57.380635 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47789e2-16f0-4f96-8001-bb117e802d16 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:57.380911 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47789e2-16f0-4f96-8001-bb117e802d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:57.387070 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:57.399306 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-c47789e2-16f0-4f96-8001-bb117e802d16 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:49:57.400568 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c47789e2-16f0-4f96-8001-bb117e802d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:49:57.428275 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:57.446576 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46688f95-0fea-4d14-814c-0a4d9d9cd051 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:57.469592 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 86/169] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:49:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:49:57.470930 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47789e2-16f0-4f96-8001-bb117e802d16 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:57.493455 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2457f9-19be-4a88-9ace-216fbaecbb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:57.494117 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2457f9-19be-4a88-9ace-216fbaecbb21 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:57.494407 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2457f9-19be-4a88-9ace-216fbaecbb21 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:57.494610 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2457f9-19be-4a88-9ace-216fbaecbb21 None admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:57.495269 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2457f9-19be-4a88-9ace-216fbaecbb21 None admin] RBAC: Adding query filter params (name=member) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:49:57.495688 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2457f9-19be-4a88-9ace-216fbaecbb21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:57.497156 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2457f9-19be-4a88-9ace-216fbaecbb21 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:57.506166 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 84/170] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Oct 26 10:49:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:57.511332 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2457f9-19be-4a88-9ace-216fbaecbb21 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:57.576244 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47789e2-16f0-4f96-8001-bb117e802d16 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:57.609744 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:57.612808 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2457f9-19be-4a88-9ace-216fbaecbb21 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:57.615971 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342310d-fc10-40c9-9d0c-305d2d314b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:57.616615 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342310d-fc10-40c9-9d0c-305d2d314b04 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:57.616898 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342310d-fc10-40c9-9d0c-305d2d314b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:57.617175 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342310d-fc10-40c9-9d0c-305d2d314b04 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:57.617826 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342310d-fc10-40c9-9d0c-305d2d314b04 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:57.619272 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342310d-fc10-40c9-9d0c-305d2d314b04 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:57.647891 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2af42-95e5-4a06-88e0-cbe2380c538c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:57.648621 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2af42-95e5-4a06-88e0-cbe2380c538c None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:57.648986 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2af42-95e5-4a06-88e0-cbe2380c538c None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:57.649310 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2af42-95e5-4a06-88e0-cbe2380c538c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:57.660016 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f2af42-95e5-4a06-88e0-cbe2380c538c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:49:57.665569 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-b1f2af42-95e5-4a06-88e0-cbe2380c538c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 26 10:49:57.665569 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:49:57.665569 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:49:57.665569 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:49:57.665569 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:49:57.665569 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:49:57.665569 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:49:57.665569 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:49:57.665569 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:49:57.665569 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:49:57.665569 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:49:57.665569 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:49:57.665569 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:49:57.665569 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:49:57.665569 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:49:57.665569 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:49:57.666644 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:49:57.666644 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:49:57.666644 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:49:57.666644 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:49:57.666644 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:49:57.666644 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:49:57.666644 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:49:57.666644 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:49:57.666644 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:49:57.666644 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:49:57.666644 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:49:57.666644 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:49:57.666644 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:49:57.666644 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:49:57.666644 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:49:57.666644 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:49:57.669088 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:49:57.669088 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:49:57.669088 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:49:57.669088 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:49:57.669088 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:49:57.669088 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:49:57.669088 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:49:57.669088 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:49:57.669088 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:49:57.669088 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:49:57.669088 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 26 10:49:57.669088 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:49:57.669088 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 85/171] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Oct 26 10:49:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:49:57.669088 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2af42-95e5-4a06-88e0-cbe2380c538c None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:57.679695 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:57.722643 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 87/172] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Oct 26 10:49:57 2022] POST /identity/v3/users => generated 297 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:49:57.723361 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342310d-fc10-40c9-9d0c-305d2d314b04 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:57.789868 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2af42-95e5-4a06-88e0-cbe2380c538c None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:57.830097 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a930e1-4092-4b8e-a463-03aa925d4d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:57.830749 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a930e1-4092-4b8e-a463-03aa925d4d5d None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:57.831034 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a930e1-4092-4b8e-a463-03aa925d4d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:57.831680 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a930e1-4092-4b8e-a463-03aa925d4d5d None admin] PATH_INFO: `/v3/users/c681890d38d04b71a9ee26744850a28a` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:57.846016 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342310d-fc10-40c9-9d0c-305d2d314b04 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:57.847373 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a930e1-4092-4b8e-a463-03aa925d4d5d None admin] RBAC: Authorizing `identity:get_user(user_id=c681890d38d04b71a9ee26744850a28a)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:57.849411 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a930e1-4092-4b8e-a463-03aa925d4d5d None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:57.855487 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 86/173] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 26 10:49:57 2022] GET /identity/v3/users/c681890d38d04b71a9ee26744850a28a => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:57.855487 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a930e1-4092-4b8e-a463-03aa925d4d5d None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:57.886956 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1aeb37-350c-4aa9-94a6-d8a413ebe541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:57.887488 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1aeb37-350c-4aa9-94a6-d8a413ebe541 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:57.887764 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1aeb37-350c-4aa9-94a6-d8a413ebe541 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:57.888032 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1aeb37-350c-4aa9-94a6-d8a413ebe541 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:57.888737 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1aeb37-350c-4aa9-94a6-d8a413ebe541 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:49:57.889041 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1aeb37-350c-4aa9-94a6-d8a413ebe541 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:57.890421 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1aeb37-350c-4aa9-94a6-d8a413ebe541 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:57.900613 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 88/174] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 26 10:49:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:57.901290 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1aeb37-350c-4aa9-94a6-d8a413ebe541 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:57.928499 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:57.960807 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:57.974899 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a930e1-4092-4b8e-a463-03aa925d4d5d None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:58.022733 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1aeb37-350c-4aa9-94a6-d8a413ebe541 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:58.025661 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331b34e-5be1-4b39-896d-7a2b40219eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:58.027156 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331b34e-5be1-4b39-896d-7a2b40219eb3 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:58.027441 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331b34e-5be1-4b39-896d-7a2b40219eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:58.027718 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331b34e-5be1-4b39-896d-7a2b40219eb3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:58.043723 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8331b34e-5be1-4b39-896d-7a2b40219eb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:49:58.049213 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-8331b34e-5be1-4b39-896d-7a2b40219eb3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:49:58.049213 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:49:58.049213 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:49:58.049213 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:49:58.049213 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:49:58.049213 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:49:58.049213 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:49:58.049213 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:49:58.049213 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:49:58.049213 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:49:58.049213 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:49:58.049213 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:49:58.049213 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:49:58.049213 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:49:58.049213 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:49:58.049213 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:49:58.050108 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:49:58.050108 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:49:58.050108 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:49:58.050108 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:49:58.050108 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:49:58.050108 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:49:58.050108 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:49:58.050108 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:49:58.050108 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:49:58.050108 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:49:58.050108 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:49:58.050108 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:49:58.050108 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:49:58.050108 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:49:58.050108 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:49:58.050108 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:49:58.050933 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:49:58.050933 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:49:58.050933 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:49:58.050933 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:49:58.050933 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:49:58.050933 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:49:58.050933 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:49:58.050933 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:49:58.050933 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:49:58.050933 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:49:58.050933 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:49:58.050933 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:49:58.050933 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 87/175] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 26 10:49:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:49:58.051587 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331b34e-5be1-4b39-896d-7a2b40219eb3 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:58.076209 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234f06d-8f57-422a-8e5f-073894d7b5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:58.076856 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234f06d-8f57-422a-8e5f-073894d7b5b2 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:58.077134 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234f06d-8f57-422a-8e5f-073894d7b5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:58.077404 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234f06d-8f57-422a-8e5f-073894d7b5b2 None admin] PATH_INFO: `/v3/projects/9644a41001314f56b4cb83f7f5d1b772` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:58.079954 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4234f06d-8f57-422a-8e5f-073894d7b5b2 None admin] RBAC: Authorizing `identity:get_project(project_id=9644a41001314f56b4cb83f7f5d1b772)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:58.081464 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4234f06d-8f57-422a-8e5f-073894d7b5b2 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:58.083306 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 89/176] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 26 10:49:57 2022] GET /identity/v3/projects/9644a41001314f56b4cb83f7f5d1b772 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:58.083884 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234f06d-8f57-422a-8e5f-073894d7b5b2 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:58.164770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331b34e-5be1-4b39-896d-7a2b40219eb3 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:58.189559 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:58.192610 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234f06d-8f57-422a-8e5f-073894d7b5b2 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:58.200347 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844180f-e0ae-4100-b7ce-1eeaaaf75892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:58.200912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844180f-e0ae-4100-b7ce-1eeaaaf75892 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:58.201250 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844180f-e0ae-4100-b7ce-1eeaaaf75892 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:58.206011 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844180f-e0ae-4100-b7ce-1eeaaaf75892 None admin] PATH_INFO: `/v3/users/14d20bdaf7c14eceb0899ab2ffdef18b` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:58.206011 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7844180f-e0ae-4100-b7ce-1eeaaaf75892 None admin] RBAC: Authorizing `identity:get_user(user_id=14d20bdaf7c14eceb0899ab2ffdef18b)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:58.206011 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7844180f-e0ae-4100-b7ce-1eeaaaf75892 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:58.206399 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 88/177] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 26 10:49:58 2022] GET /identity/v3/users/14d20bdaf7c14eceb0899ab2ffdef18b => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:58.207150 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844180f-e0ae-4100-b7ce-1eeaaaf75892 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:58.224038 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:58.231403 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478c7e5-a0cd-42f0-84f3-2d6d06df376c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:58.232349 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478c7e5-a0cd-42f0-84f3-2d6d06df376c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:58.232786 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478c7e5-a0cd-42f0-84f3-2d6d06df376c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:58.233200 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478c7e5-a0cd-42f0-84f3-2d6d06df376c None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:58.234041 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478c7e5-a0cd-42f0-84f3-2d6d06df376c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:49:58.234690 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478c7e5-a0cd-42f0-84f3-2d6d06df376c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:58.236308 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478c7e5-a0cd-42f0-84f3-2d6d06df376c None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:58.246409 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 90/178] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 26 10:49:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:58.247568 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478c7e5-a0cd-42f0-84f3-2d6d06df376c None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:58.323710 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844180f-e0ae-4100-b7ce-1eeaaaf75892 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:58.363677 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478c7e5-a0cd-42f0-84f3-2d6d06df376c None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:58.365017 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60b54b-1765-46ab-9418-435d287cd729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:58.365808 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60b54b-1765-46ab-9418-435d287cd729 None admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:58.366162 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60b54b-1765-46ab-9418-435d287cd729 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:58.366513 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60b54b-1765-46ab-9418-435d287cd729 None admin] PATH_INFO: `/v3/projects/9644a41001314f56b4cb83f7f5d1b772/users/c681890d38d04b71a9ee26744850a28a/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:58.368567 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e60b54b-1765-46ab-9418-435d287cd729 None admin] RBAC: Authorizing `identity:create_grant(project_id=9644a41001314f56b4cb83f7f5d1b772, user_id=c681890d38d04b71a9ee26744850a28a, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:58.370095 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e60b54b-1765-46ab-9418-435d287cd729 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:58.399449 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc7d55-5020-46bc-b131-f17437981239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:58.400084 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc7d55-5020-46bc-b131-f17437981239 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:58.400370 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc7d55-5020-46bc-b131-f17437981239 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:58.400640 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc7d55-5020-46bc-b131-f17437981239 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:58.450378 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:58.470410 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc7d55-5020-46bc-b131-f17437981239 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:58.471544 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc7d55-5020-46bc-b131-f17437981239 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:58.477207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 89/179] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 26 10:49:58 2022] PUT /identity/v3/projects/9644a41001314f56b4cb83f7f5d1b772/users/c681890d38d04b71a9ee26744850a28a/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:49:58.479132 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60b54b-1765-46ab-9418-435d287cd729 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:58.545363 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:58.629250 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60b54b-1765-46ab-9418-435d287cd729 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:58.679638 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 91/180] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 26 10:49:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 26 10:49:58.685487 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc7d55-5020-46bc-b131-f17437981239 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:58.717704 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0168d-ed48-4e9e-ac95-6dd92d04e033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:58.718700 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0168d-ed48-4e9e-ac95-6dd92d04e033 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:58.719213 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0168d-ed48-4e9e-ac95-6dd92d04e033 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:58.719689 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0168d-ed48-4e9e-ac95-6dd92d04e033 None admin] PATH_INFO: `/v3/users/14d20bdaf7c14eceb0899ab2ffdef18b` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:58.721646 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe0168d-ed48-4e9e-ac95-6dd92d04e033 None admin] RBAC: Authorizing `identity:get_user(user_id=14d20bdaf7c14eceb0899ab2ffdef18b)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:58.723347 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe0168d-ed48-4e9e-ac95-6dd92d04e033 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:58.725585 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 90/181] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 26 10:49:58 2022] GET /identity/v3/users/14d20bdaf7c14eceb0899ab2ffdef18b => generated 283 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:58.731348 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0168d-ed48-4e9e-ac95-6dd92d04e033 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:58.805586 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:58.829119 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc7d55-5020-46bc-b131-f17437981239 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:58.853474 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0168d-ed48-4e9e-ac95-6dd92d04e033 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:58.868265 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9817f4b-0ae1-4705-84a4-ee855e32f202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:58.868899 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9817f4b-0ae1-4705-84a4-ee855e32f202 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:58.869179 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9817f4b-0ae1-4705-84a4-ee855e32f202 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:58.869449 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9817f4b-0ae1-4705-84a4-ee855e32f202 None admin] PATH_INFO: `/v3/projects/9644a41001314f56b4cb83f7f5d1b772` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:58.870800 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9817f4b-0ae1-4705-84a4-ee855e32f202 None admin] RBAC: Authorizing `identity:get_project(project_id=9644a41001314f56b4cb83f7f5d1b772)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:58.872937 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9817f4b-0ae1-4705-84a4-ee855e32f202 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:58.874856 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 92/182] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 26 10:49:58 2022] GET /identity/v3/projects/9644a41001314f56b4cb83f7f5d1b772 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:49:58.883231 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:58.884325 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9817f4b-0ae1-4705-84a4-ee855e32f202 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:58.898968 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89815f0-cae7-4623-9c44-03bff78afbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:58.900100 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89815f0-cae7-4623-9c44-03bff78afbea None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:58.900563 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89815f0-cae7-4623-9c44-03bff78afbea None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:58.901053 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89815f0-cae7-4623-9c44-03bff78afbea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:58.977405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89815f0-cae7-4623-9c44-03bff78afbea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:58.978804 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89815f0-cae7-4623-9c44-03bff78afbea None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:59.008886 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9817f4b-0ae1-4705-84a4-ee855e32f202 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:59.119391 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 91/183] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 26 10:49:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 26 10:49:59.129027 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89815f0-cae7-4623-9c44-03bff78afbea None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:59.144780 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372b4f0-aeca-46af-bb15-a48cc72202fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:59.145419 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372b4f0-aeca-46af-bb15-a48cc72202fb None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:59.145704 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372b4f0-aeca-46af-bb15-a48cc72202fb None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:59.145979 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372b4f0-aeca-46af-bb15-a48cc72202fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:59.146714 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5372b4f0-aeca-46af-bb15-a48cc72202fb None admin] RBAC: Adding query filter params (role.id=a29ce5d75abc411488ef339c191e6d05, scope.project.id=9644a41001314f56b4cb83f7f5d1b772, user.id=14d20bdaf7c14eceb0899ab2ffdef18b) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:49:59.147023 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5372b4f0-aeca-46af-bb15-a48cc72202fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:59.154346 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5372b4f0-aeca-46af-bb15-a48cc72202fb None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:59.154829 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 93/184] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 26 10:49:58 2022] GET /identity/v3/role_assignments?user.id=14d20bdaf7c14eceb0899ab2ffdef18b&scope.project.id=9644a41001314f56b4cb83f7f5d1b772&role.id=a29ce5d75abc411488ef339c191e6d05 => generated 608 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:59.190982 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:59.270414 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89815f0-cae7-4623-9c44-03bff78afbea None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:59.316005 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bfc70f-3225-42a8-907e-907c3ddd9b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:59.324461 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfc70f-3225-42a8-907e-907c3ddd9b43 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:59.324461 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfc70f-3225-42a8-907e-907c3ddd9b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:59.324461 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfc70f-3225-42a8-907e-907c3ddd9b43 None admin] PATH_INFO: `/v3/projects/9644a41001314f56b4cb83f7f5d1b772` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:59.325358 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bfc70f-3225-42a8-907e-907c3ddd9b43 None admin] RBAC: Authorizing `identity:get_project(project_id=9644a41001314f56b4cb83f7f5d1b772)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:59.326970 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bfc70f-3225-42a8-907e-907c3ddd9b43 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:59.330706 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 92/185] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 26 10:49:59 2022] GET /identity/v3/projects/9644a41001314f56b4cb83f7f5d1b772 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:49:59.335652 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372b4f0-aeca-46af-bb15-a48cc72202fb None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:49:59.362084 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:49:59.484075 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372b4f0-aeca-46af-bb15-a48cc72202fb None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:49:59.519651 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33df1ab-79e5-4ec1-9a67-12ebf5ce7679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:49:59.520323 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33df1ab-79e5-4ec1-9a67-12ebf5ce7679 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:49:59.520656 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33df1ab-79e5-4ec1-9a67-12ebf5ce7679 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:49:59.520879 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33df1ab-79e5-4ec1-9a67-12ebf5ce7679 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:49:59.521609 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33df1ab-79e5-4ec1-9a67-12ebf5ce7679 None admin] RBAC: Adding query filter params (role.id=d6876897d7c548b7900d4e01cb45a007, scope.project.id=9644a41001314f56b4cb83f7f5d1b772, user.id=14d20bdaf7c14eceb0899ab2ffdef18b) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:49:59.521917 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33df1ab-79e5-4ec1-9a67-12ebf5ce7679 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:49:59.523368 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33df1ab-79e5-4ec1-9a67-12ebf5ce7679 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:49:59.538333 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 94/186] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 26 10:49:59 2022] GET /identity/v3/role_assignments?user.id=14d20bdaf7c14eceb0899ab2ffdef18b&scope.project.id=9644a41001314f56b4cb83f7f5d1b772&role.id=d6876897d7c548b7900d4e01cb45a007 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:00.330019 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa872a-ed71-4939-96f1-0b5486cc625f None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:00.330524 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa872a-ed71-4939-96f1-0b5486cc625f None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:00.330633 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa872a-ed71-4939-96f1-0b5486cc625f None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:00.331913 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 93/187] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:50:00.337345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a86f7e-a9a7-4b52-b985-06ffb5313def None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:00.337735 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a86f7e-a9a7-4b52-b985-06ffb5313def None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:00.337980 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a86f7e-a9a7-4b52-b985-06ffb5313def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:00.352612 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e91f25-781e-4478-a81a-5af14f19d435 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:00.352912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e91f25-781e-4478-a81a-5af14f19d435 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:00.353168 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e91f25-781e-4478-a81a-5af14f19d435 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:00.354511 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 94/188] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:50:00.359429 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a9002-fdc7-439c-a599-17f42c2c83c9 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:00.359684 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-94a86f7e-a9a7-4b52-b985-06ffb5313def None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:00.359784 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a9002-fdc7-439c-a599-17f42c2c83c9 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:00.359983 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a9002-fdc7-439c-a599-17f42c2c83c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:00.360935 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-94a86f7e-a9a7-4b52-b985-06ffb5313def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:00.379911 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-4e0a9002-fdc7-439c-a599-17f42c2c83c9 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:00.381117 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-4e0a9002-fdc7-439c-a599-17f42c2c83c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:00.436253 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 95/189] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:50:00.453831 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 95/190] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:50:00.702671 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a86f7e-a9a7-4b52-b985-06ffb5313def None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:00.711511 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:00.719290 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a9002-fdc7-439c-a599-17f42c2c83c9 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:00.738568 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:00.807602 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a86f7e-a9a7-4b52-b985-06ffb5313def None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:00.827827 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a9002-fdc7-439c-a599-17f42c2c83c9 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:00.846465 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2e4b19-59dd-44b3-baf8-c938c2388144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:00.847105 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e4b19-59dd-44b3-baf8-c938c2388144 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:00.847392 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e4b19-59dd-44b3-baf8-c938c2388144 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:00.847663 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e4b19-59dd-44b3-baf8-c938c2388144 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:00.848794 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2e4b19-59dd-44b3-baf8-c938c2388144 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:00.850267 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2e4b19-59dd-44b3-baf8-c938c2388144 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:00.851834 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 96/191] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:50:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:00.857548 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2e4b19-59dd-44b3-baf8-c938c2388144 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:00.869550 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acedaf6d-c031-438c-8af7-300c5748255e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:00.870500 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedaf6d-c031-438c-8af7-300c5748255e None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:00.870788 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedaf6d-c031-438c-8af7-300c5748255e None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:00.871215 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedaf6d-c031-438c-8af7-300c5748255e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:00.881274 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acedaf6d-c031-438c-8af7-300c5748255e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:50:00.886086 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-acedaf6d-c031-438c-8af7-300c5748255e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 26 10:50:00.886086 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:00.886086 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:00.886086 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:00.886086 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:00.886086 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:00.886086 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:00.886086 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:00.886086 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:00.886086 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:00.886086 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:00.886086 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:00.886086 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:50:00.886086 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:50:00.886086 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:50:00.886086 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:50:00.886969 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:50:00.886969 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:50:00.886969 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:50:00.886969 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:50:00.886969 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:00.886969 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:00.886969 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:00.886969 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:00.886969 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:00.886969 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:00.886969 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:00.886969 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:00.886969 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:00.886969 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:00.886969 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:00.886969 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:00.887763 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:00.887763 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:00.887763 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:00.887763 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:00.887763 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:50:00.887763 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:50:00.887763 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:50:00.887763 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:50:00.887763 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:50:00.887763 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:50:00.887763 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 26 10:50:00.887763 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:00.887763 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 96/192] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 26 10:50:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:50:00.893461 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acedaf6d-c031-438c-8af7-300c5748255e None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:00.945850 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:00.971943 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2e4b19-59dd-44b3-baf8-c938c2388144 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:00.988525 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:01.007927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139bde2-3b89-486a-bd8d-76a2910adf79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:01.008571 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139bde2-3b89-486a-bd8d-76a2910adf79 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:01.008851 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139bde2-3b89-486a-bd8d-76a2910adf79 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:01.009434 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139bde2-3b89-486a-bd8d-76a2910adf79 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:01.009927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139bde2-3b89-486a-bd8d-76a2910adf79 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:01.011369 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139bde2-3b89-486a-bd8d-76a2910adf79 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:01.015082 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acedaf6d-c031-438c-8af7-300c5748255e None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:01.050666 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d9a23-cef3-437f-8e0a-9a58bbe2ecd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:01.051311 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d9a23-cef3-437f-8e0a-9a58bbe2ecd9 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:01.051589 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d9a23-cef3-437f-8e0a-9a58bbe2ecd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:01.051859 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d9a23-cef3-437f-8e0a-9a58bbe2ecd9 None admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:01.052582 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d9a23-cef3-437f-8e0a-9a58bbe2ecd9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:01.052891 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d9a23-cef3-437f-8e0a-9a58bbe2ecd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:01.054306 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d9a23-cef3-437f-8e0a-9a58bbe2ecd9 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:01.064536 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 97/193] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Oct 26 10:50:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:01.070526 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d9a23-cef3-437f-8e0a-9a58bbe2ecd9 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:01.096563 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 97/194] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Oct 26 10:50:00 2022] POST /identity/v3/users => generated 293 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:50:01.175339 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f5bd0-dc8e-4bed-baec-ead8a410557f None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:01.175738 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f5bd0-dc8e-4bed-baec-ead8a410557f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:01.175894 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f5bd0-dc8e-4bed-baec-ead8a410557f None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:01.177485 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 98/195] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:50:01.182976 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eebf5d-9ea0-4806-a25a-8899ac62f256 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:01.183275 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eebf5d-9ea0-4806-a25a-8899ac62f256 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:01.183557 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eebf5d-9ea0-4806-a25a-8899ac62f256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:01.200244 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d9a23-cef3-437f-8e0a-9a58bbe2ecd9 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:01.202983 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-93eebf5d-9ea0-4806-a25a-8899ac62f256 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:01.204258 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-93eebf5d-9ea0-4806-a25a-8899ac62f256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:01.239456 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89875cc1-2c0d-47cc-a053-1904530ee9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:01.240027 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89875cc1-2c0d-47cc-a053-1904530ee9bb None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:01.240333 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89875cc1-2c0d-47cc-a053-1904530ee9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:01.240615 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89875cc1-2c0d-47cc-a053-1904530ee9bb None admin] PATH_INFO: `/v3/users/16b57247b5a949828e67c2c9b470b7c2` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:01.254508 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:01.258124 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89875cc1-2c0d-47cc-a053-1904530ee9bb None admin] RBAC: Authorizing `identity:get_user(user_id=16b57247b5a949828e67c2c9b470b7c2)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:01.259705 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89875cc1-2c0d-47cc-a053-1904530ee9bb None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:01.261597 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 98/196] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 26 10:50:01 2022] GET /identity/v3/users/16b57247b5a949828e67c2c9b470b7c2 => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:01.267626 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89875cc1-2c0d-47cc-a053-1904530ee9bb None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:01.286355 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 99/197] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:50:01.379497 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89875cc1-2c0d-47cc-a053-1904530ee9bb None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:01.416792 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5533f-8bd1-47f3-9536-075476e96a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:01.417435 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5533f-8bd1-47f3-9536-075476e96a7b None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:01.417720 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5533f-8bd1-47f3-9536-075476e96a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:01.417999 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5533f-8bd1-47f3-9536-075476e96a7b None admin] PATH_INFO: `/v3/projects/9644a41001314f56b4cb83f7f5d1b772` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:01.419128 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5533f-8bd1-47f3-9536-075476e96a7b None admin] RBAC: Authorizing `identity:get_project(project_id=9644a41001314f56b4cb83f7f5d1b772)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:01.420611 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5533f-8bd1-47f3-9536-075476e96a7b None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:01.422562 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 99/198] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 26 10:50:01 2022] GET /identity/v3/projects/9644a41001314f56b4cb83f7f5d1b772 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:50:01.430344 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eebf5d-9ea0-4806-a25a-8899ac62f256 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:01.502101 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:01.544767 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eebf5d-9ea0-4806-a25a-8899ac62f256 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:01.560904 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5533f-8bd1-47f3-9536-075476e96a7b None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:01.585872 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795314ef-7137-4559-b63f-cdc16907a763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:01.586839 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795314ef-7137-4559-b63f-cdc16907a763 None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:01.587135 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795314ef-7137-4559-b63f-cdc16907a763 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:01.587404 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795314ef-7137-4559-b63f-cdc16907a763 None admin] PATH_INFO: `/v3/projects/9644a41001314f56b4cb83f7f5d1b772/users/16b57247b5a949828e67c2c9b470b7c2/roles/f44ac39d2011426b83226a3c55468d77` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:01.590310 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795314ef-7137-4559-b63f-cdc16907a763 None admin] RBAC: Authorizing `identity:create_grant(project_id=9644a41001314f56b4cb83f7f5d1b772, user_id=16b57247b5a949828e67c2c9b470b7c2, role_id=f44ac39d2011426b83226a3c55468d77)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:01.592636 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795314ef-7137-4559-b63f-cdc16907a763 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:01.631569 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:01.665690 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5533f-8bd1-47f3-9536-075476e96a7b None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:01.678692 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 100/199] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 26 10:50:01 2022] PUT /identity/v3/projects/9644a41001314f56b4cb83f7f5d1b772/users/16b57247b5a949828e67c2c9b470b7c2/roles/f44ac39d2011426b83226a3c55468d77 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 10:50:01.709666 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60b630-f069-4821-843e-f38c62e520ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:01.710335 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60b630-f069-4821-843e-f38c62e520ac None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:01.710613 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60b630-f069-4821-843e-f38c62e520ac None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:01.710883 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60b630-f069-4821-843e-f38c62e520ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:01.724000 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60b630-f069-4821-843e-f38c62e520ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:50:01.729316 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-ed60b630-f069-4821-843e-f38c62e520ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:50:01.729316 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:01.729316 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:01.729316 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:01.729316 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:01.729316 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:01.729316 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:01.729316 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:01.729316 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:01.729316 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:01.729316 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:01.729316 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:01.729316 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:50:01.729316 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:50:01.729316 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:50:01.729316 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:50:01.730245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:50:01.730245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:50:01.730245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:50:01.730245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:50:01.730245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:01.730245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:01.730245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:01.730245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:01.730245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:01.730245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:01.730245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:01.730245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:01.730245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:01.730245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:01.730245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:01.730245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:01.731043 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:01.731043 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:01.731043 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:01.731043 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:01.731043 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:50:01.731043 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:50:01.731043 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:50:01.731043 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:50:01.731043 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:50:01.731043 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:50:01.731043 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:50:01.731043 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:01.735710 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 100/200] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 26 10:50:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:50:01.737907 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795314ef-7137-4559-b63f-cdc16907a763 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:01.858824 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795314ef-7137-4559-b63f-cdc16907a763 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:01.881282 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:01.896740 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4af99-aa06-4988-9afb-9c4b3fc9d518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:01.897368 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4af99-aa06-4988-9afb-9c4b3fc9d518 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:01.897654 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4af99-aa06-4988-9afb-9c4b3fc9d518 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:01.897932 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4af99-aa06-4988-9afb-9c4b3fc9d518 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:01.898609 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b4af99-aa06-4988-9afb-9c4b3fc9d518 None admin] RBAC: Adding query filter params (name=member) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:01.898911 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b4af99-aa06-4988-9afb-9c4b3fc9d518 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:01.900399 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b4af99-aa06-4988-9afb-9c4b3fc9d518 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:01.908915 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 101/201] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Oct 26 10:50:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:01.914957 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60b630-f069-4821-843e-f38c62e520ac None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:02.025183 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60b630-f069-4821-843e-f38c62e520ac None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:02.056780 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:02.065413 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b22c2-e911-4e1a-b01c-0803d836d5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:02.066053 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b22c2-e911-4e1a-b01c-0803d836d5a5 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:02.066332 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b22c2-e911-4e1a-b01c-0803d836d5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:02.073954 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b22c2-e911-4e1a-b01c-0803d836d5a5 None admin] PATH_INFO: `/v3/users/c681890d38d04b71a9ee26744850a28a` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:02.073954 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76b22c2-e911-4e1a-b01c-0803d836d5a5 None admin] RBAC: Authorizing `identity:get_user(user_id=c681890d38d04b71a9ee26744850a28a)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:02.073954 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76b22c2-e911-4e1a-b01c-0803d836d5a5 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:02.073954 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 101/202] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 26 10:50:01 2022] GET /identity/v3/users/c681890d38d04b71a9ee26744850a28a => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:02.076406 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4af99-aa06-4988-9afb-9c4b3fc9d518 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:02.185696 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4af99-aa06-4988-9afb-9c4b3fc9d518 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:02.225985 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9e104-0fdd-441e-9962-b77e55abb353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:02.227004 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9e104-0fdd-441e-9962-b77e55abb353 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:02.227493 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9e104-0fdd-441e-9962-b77e55abb353 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:02.228018 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9e104-0fdd-441e-9962-b77e55abb353 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:02.284785 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:02.305671 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd9e104-0fdd-441e-9962-b77e55abb353 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:02.307490 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd9e104-0fdd-441e-9962-b77e55abb353 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:02.411747 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 102/203] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 26 10:50:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 26 10:50:02.417663 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b22c2-e911-4e1a-b01c-0803d836d5a5 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:02.523864 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b22c2-e911-4e1a-b01c-0803d836d5a5 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:02.558617 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601daf08-19c8-41c0-a25f-b78d35e5552c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:02.559645 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601daf08-19c8-41c0-a25f-b78d35e5552c None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:02.560164 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601daf08-19c8-41c0-a25f-b78d35e5552c None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:02.560648 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601daf08-19c8-41c0-a25f-b78d35e5552c None admin] PATH_INFO: `/v3/projects/9644a41001314f56b4cb83f7f5d1b772` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:02.561957 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601daf08-19c8-41c0-a25f-b78d35e5552c None admin] RBAC: Authorizing `identity:get_project(project_id=9644a41001314f56b4cb83f7f5d1b772)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:02.563607 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601daf08-19c8-41c0-a25f-b78d35e5552c None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:02.566345 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 102/204] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 26 10:50:02 2022] GET /identity/v3/projects/9644a41001314f56b4cb83f7f5d1b772 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:02.576106 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9e104-0fdd-441e-9962-b77e55abb353 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:02.662118 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:02.681500 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9e104-0fdd-441e-9962-b77e55abb353 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:02.718257 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a484690-0749-4b85-81c5-f6a37331a194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:02.718878 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a484690-0749-4b85-81c5-f6a37331a194 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:02.719162 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a484690-0749-4b85-81c5-f6a37331a194 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:02.719441 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a484690-0749-4b85-81c5-f6a37331a194 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:02.720728 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a484690-0749-4b85-81c5-f6a37331a194 None admin] RBAC: Adding query filter params (role.id=5d5a8bcef7c8455c9bb6b49e113e74c7, scope.project.id=9644a41001314f56b4cb83f7f5d1b772, user.id=c681890d38d04b71a9ee26744850a28a) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:02.721043 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a484690-0749-4b85-81c5-f6a37331a194 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:02.722560 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a484690-0749-4b85-81c5-f6a37331a194 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:02.728846 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 103/205] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 26 10:50:02 2022] GET /identity/v3/role_assignments?user.id=c681890d38d04b71a9ee26744850a28a&scope.project.id=9644a41001314f56b4cb83f7f5d1b772&role.id=5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:03.516115 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954411d-5c20-4be9-82e7-0afaf34a8ea3 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:03.516644 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954411d-5c20-4be9-82e7-0afaf34a8ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:03.516644 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954411d-5c20-4be9-82e7-0afaf34a8ea3 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:03.518215 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 103/206] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:50:03.523196 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fb857-5a21-45a6-904b-f82ab65c811e None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:03.523491 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fb857-5a21-45a6-904b-f82ab65c811e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:03.523773 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fb857-5a21-45a6-904b-f82ab65c811e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:03.542945 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-7f9fb857-5a21-45a6-904b-f82ab65c811e None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:03.544174 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7f9fb857-5a21-45a6-904b-f82ab65c811e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:03.567392 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70917e5f-db50-4126-9165-08d75bf67b80 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:03.567682 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70917e5f-db50-4126-9165-08d75bf67b80 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:03.567947 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70917e5f-db50-4126-9165-08d75bf67b80 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:03.569442 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 104/207] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:50:03.574239 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed706c-f7a4-4df4-b696-bc9ec0d179e9 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:03.574517 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed706c-f7a4-4df4-b696-bc9ec0d179e9 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:03.574791 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed706c-f7a4-4df4-b696-bc9ec0d179e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:03.592867 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-4bed706c-f7a4-4df4-b696-bc9ec0d179e9 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:03.593975 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-4bed706c-f7a4-4df4-b696-bc9ec0d179e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:03.614597 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 104/208] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:50:03.651343 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:03.661982 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 105/209] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:50:03.879693 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fb857-5a21-45a6-904b-f82ab65c811e None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:03.922323 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d96eed-2c12-406d-9f52-2c31c8a19acb None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:03.922958 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d96eed-2c12-406d-9f52-2c31c8a19acb None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:03.923301 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d96eed-2c12-406d-9f52-2c31c8a19acb None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:03.925476 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 106/210] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:50:03.930473 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f111f-9e0a-43ec-84bd-dfc92fda0cc0 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:03.930762 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f111f-9e0a-43ec-84bd-dfc92fda0cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:03.931038 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f111f-9e0a-43ec-84bd-dfc92fda0cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:03.949850 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-eb1f111f-9e0a-43ec-84bd-dfc92fda0cc0 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:03.951048 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-eb1f111f-9e0a-43ec-84bd-dfc92fda0cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:03.961696 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:03.984330 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fb857-5a21-45a6-904b-f82ab65c811e None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:04.015912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 107/211] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:50:04.017137 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f111f-9e0a-43ec-84bd-dfc92fda0cc0 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:04.018209 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2f252-bed2-4271-b57d-cba83bd96651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:04.018856 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2f252-bed2-4271-b57d-cba83bd96651 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:04.019168 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2f252-bed2-4271-b57d-cba83bd96651 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:04.019422 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2f252-bed2-4271-b57d-cba83bd96651 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:04.030763 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce2f252-bed2-4271-b57d-cba83bd96651 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:50:04.036234 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-2ce2f252-bed2-4271-b57d-cba83bd96651 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:50:04.036234 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:04.036234 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:04.036234 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:04.036234 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:04.036234 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:04.036234 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:04.036234 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:04.036234 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:04.036234 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:04.036234 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:04.036234 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:04.036234 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:50:04.036234 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:50:04.036234 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:50:04.036234 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:50:04.037115 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:50:04.037115 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:50:04.037115 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:50:04.037115 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:50:04.037115 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:04.037115 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:04.037115 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:04.037115 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:04.037115 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:04.037115 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:04.037115 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:04.037115 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:04.037115 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:04.037115 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:04.037115 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:04.037115 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:04.041333 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:04.041333 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:04.041333 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:04.041333 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:04.041333 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:50:04.041333 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:50:04.041333 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:50:04.041333 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:50:04.041333 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:50:04.041333 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:50:04.041333 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:50:04.041333 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:04.041333 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 105/212] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 26 10:50:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:04.045164 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2f252-bed2-4271-b57d-cba83bd96651 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:04.123535 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f111f-9e0a-43ec-84bd-dfc92fda0cc0 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:04.152112 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:04.152278 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2f252-bed2-4271-b57d-cba83bd96651 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:04.165525 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaec3f2-65a7-468a-aa3a-6fe5b353b645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:04.166510 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaec3f2-65a7-468a-aa3a-6fe5b353b645 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:04.166816 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaec3f2-65a7-468a-aa3a-6fe5b353b645 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:04.167090 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaec3f2-65a7-468a-aa3a-6fe5b353b645 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:04.168489 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaec3f2-65a7-468a-aa3a-6fe5b353b645 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:04.170383 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaec3f2-65a7-468a-aa3a-6fe5b353b645 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:04.172090 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 108/213] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:50:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:04.177288 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaec3f2-65a7-468a-aa3a-6fe5b353b645 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:04.192901 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d1500-36e3-4eef-a3da-5debd11ade8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:04.193539 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d1500-36e3-4eef-a3da-5debd11ade8e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:04.193822 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d1500-36e3-4eef-a3da-5debd11ade8e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:04.194099 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d1500-36e3-4eef-a3da-5debd11ade8e None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:04.194765 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d1500-36e3-4eef-a3da-5debd11ade8e None admin] RBAC: Adding query filter params (name=member) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:04.195071 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d1500-36e3-4eef-a3da-5debd11ade8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:04.196500 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d1500-36e3-4eef-a3da-5debd11ade8e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:04.199000 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:04.206020 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 106/214] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Oct 26 10:50:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:04.211893 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d1500-36e3-4eef-a3da-5debd11ade8e None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:04.287747 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaec3f2-65a7-468a-aa3a-6fe5b353b645 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:04.314498 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d1500-36e3-4eef-a3da-5debd11ade8e None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:04.321713 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c74ca-bbbc-4419-9d32-ece2ad9177f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:04.322327 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c74ca-bbbc-4419-9d32-ece2ad9177f7 None admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:04.322613 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c74ca-bbbc-4419-9d32-ece2ad9177f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:04.322889 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c74ca-bbbc-4419-9d32-ece2ad9177f7 None admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:04.323541 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15c74ca-bbbc-4419-9d32-ece2ad9177f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:04.325040 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15c74ca-bbbc-4419-9d32-ece2ad9177f7 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:04.349101 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3b436-a7e6-467b-ac2b-b2c2a0f58590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:04.349788 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3b436-a7e6-467b-ac2b-b2c2a0f58590 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:04.350063 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3b436-a7e6-467b-ac2b-b2c2a0f58590 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:04.350350 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3b436-a7e6-467b-ac2b-b2c2a0f58590 None admin] PATH_INFO: `/v3/users/b5b5ef5d40c649f19e225efb4076bbd2` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:04.363837 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3b436-a7e6-467b-ac2b-b2c2a0f58590 None admin] RBAC: Authorizing `identity:get_user(user_id=b5b5ef5d40c649f19e225efb4076bbd2)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:04.365342 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3b436-a7e6-467b-ac2b-b2c2a0f58590 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:04.366917 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 107/215] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 26 10:50:04 2022] GET /identity/v3/users/b5b5ef5d40c649f19e225efb4076bbd2 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:04.367755 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3b436-a7e6-467b-ac2b-b2c2a0f58590 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:04.422231 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:04.439024 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 109/216] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Oct 26 10:50:04 2022] POST /identity/v3/users => generated 293 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 10:50:04.440590 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c74ca-bbbc-4419-9d32-ece2ad9177f7 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:04.469864 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3b436-a7e6-467b-ac2b-b2c2a0f58590 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:04.492594 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:04.513741 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b8451-59af-4a62-8752-820136b8d6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:04.514401 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b8451-59af-4a62-8752-820136b8d6c4 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:04.514684 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b8451-59af-4a62-8752-820136b8d6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:04.514950 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b8451-59af-4a62-8752-820136b8d6c4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:04.527668 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b8451-59af-4a62-8752-820136b8d6c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:50:04.533332 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-038b8451-59af-4a62-8752-820136b8d6c4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 26 10:50:04.533332 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:04.533332 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:04.533332 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:04.533332 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:04.533332 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:04.533332 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:04.533332 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:04.533332 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:04.533332 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:04.533332 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:04.533332 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:04.533332 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:50:04.533332 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:50:04.533332 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:50:04.533332 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:50:04.534566 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:50:04.534566 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:50:04.534566 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:50:04.534566 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:50:04.534566 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:04.534566 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:04.534566 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:04.534566 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:04.534566 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:04.534566 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:04.534566 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:04.534566 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:04.534566 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:04.534566 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:04.534566 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:04.534566 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:04.535578 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:04.535578 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:04.535578 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:04.535578 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:04.535578 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:50:04.535578 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:50:04.535578 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:50:04.535578 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:50:04.535578 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:50:04.535578 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:50:04.535578 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 26 10:50:04.535578 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:04.535578 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 108/217] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 26 10:50:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:04.540871 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b8451-59af-4a62-8752-820136b8d6c4 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:04.559988 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c74ca-bbbc-4419-9d32-ece2ad9177f7 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:04.598193 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59b40b-795b-4c44-8671-a05f019d5d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:04.598821 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59b40b-795b-4c44-8671-a05f019d5d53 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:04.599105 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59b40b-795b-4c44-8671-a05f019d5d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:04.599384 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59b40b-795b-4c44-8671-a05f019d5d53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:04.600166 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c59b40b-795b-4c44-8671-a05f019d5d53 None admin] RBAC: Adding query filter params (role.id=5d5a8bcef7c8455c9bb6b49e113e74c7, user.id=b5b5ef5d40c649f19e225efb4076bbd2, scope.system=all) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:04.600483 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c59b40b-795b-4c44-8671-a05f019d5d53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:04.601955 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c59b40b-795b-4c44-8671-a05f019d5d53 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:04.616259 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 110/218] 10.222.0.45 () {56 vars in 1308 bytes} [Wed Oct 26 10:50:04 2022] GET /identity/v3/role_assignments?user.id=b5b5ef5d40c649f19e225efb4076bbd2&scope.system=all&role.id=5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:04.658724 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b8451-59af-4a62-8752-820136b8d6c4 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:04.678092 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:04.698837 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43cdaf3-2a71-4960-af27-d58f073ff87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:04.699771 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cdaf3-2a71-4960-af27-d58f073ff87b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:04.700078 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cdaf3-2a71-4960-af27-d58f073ff87b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:04.700365 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cdaf3-2a71-4960-af27-d58f073ff87b None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:04.701073 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43cdaf3-2a71-4960-af27-d58f073ff87b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:04.701933 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43cdaf3-2a71-4960-af27-d58f073ff87b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:04.702826 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43cdaf3-2a71-4960-af27-d58f073ff87b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:04.716198 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 109/219] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Oct 26 10:50:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:04.722278 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59b40b-795b-4c44-8671-a05f019d5d53 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:04.836975 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59b40b-795b-4c44-8671-a05f019d5d53 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:04.847911 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:04.875392 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f2236-66d0-48b9-8fa0-2f470ea2600e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:04.876034 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f2236-66d0-48b9-8fa0-2f470ea2600e None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:04.876352 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f2236-66d0-48b9-8fa0-2f470ea2600e None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:04.877127 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f2236-66d0-48b9-8fa0-2f470ea2600e None admin] PATH_INFO: `/v3/users/16b57247b5a949828e67c2c9b470b7c2` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:04.878297 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f2236-66d0-48b9-8fa0-2f470ea2600e None admin] RBAC: Authorizing `identity:get_user(user_id=16b57247b5a949828e67c2c9b470b7c2)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:04.879754 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f2236-66d0-48b9-8fa0-2f470ea2600e None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:04.881567 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 111/220] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 26 10:50:04 2022] GET /identity/v3/users/16b57247b5a949828e67c2c9b470b7c2 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:04.887164 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43cdaf3-2a71-4960-af27-d58f073ff87b None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:05.001199 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43cdaf3-2a71-4960-af27-d58f073ff87b None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:05.041532 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7597032-7955-4bda-9651-579506de6ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:05.042152 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7597032-7955-4bda-9651-579506de6ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:05.042436 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7597032-7955-4bda-9651-579506de6ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:05.043004 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7597032-7955-4bda-9651-579506de6ad0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:05.098174 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:05.120957 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7597032-7955-4bda-9651-579506de6ad0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:05.122457 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7597032-7955-4bda-9651-579506de6ad0 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:05.232370 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 110/221] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 26 10:50:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 26 10:50:05.238409 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f2236-66d0-48b9-8fa0-2f470ea2600e None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:05.343458 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f2236-66d0-48b9-8fa0-2f470ea2600e None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:05.379755 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610d5b4-f1c3-4f0f-afad-e07edcbee701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:05.380450 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610d5b4-f1c3-4f0f-afad-e07edcbee701 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:05.380736 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610d5b4-f1c3-4f0f-afad-e07edcbee701 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:05.381018 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610d5b4-f1c3-4f0f-afad-e07edcbee701 None admin] PATH_INFO: `/v3/projects/9644a41001314f56b4cb83f7f5d1b772` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:05.382195 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610d5b4-f1c3-4f0f-afad-e07edcbee701 None admin] RBAC: Authorizing `identity:get_project(project_id=9644a41001314f56b4cb83f7f5d1b772)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:05.383667 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610d5b4-f1c3-4f0f-afad-e07edcbee701 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:05.388174 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 112/222] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 26 10:50:05 2022] GET /identity/v3/projects/9644a41001314f56b4cb83f7f5d1b772 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:05.391678 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7597032-7955-4bda-9651-579506de6ad0 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:05.474726 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:05.496554 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7597032-7955-4bda-9651-579506de6ad0 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:05.534120 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83617b-afa2-4bf6-91c4-1572345317e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:05.534784 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83617b-afa2-4bf6-91c4-1572345317e8 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:05.535070 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83617b-afa2-4bf6-91c4-1572345317e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:05.535351 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83617b-afa2-4bf6-91c4-1572345317e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:05.536181 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d83617b-afa2-4bf6-91c4-1572345317e8 None admin] RBAC: Adding query filter params (role.id=f44ac39d2011426b83226a3c55468d77, scope.project.id=9644a41001314f56b4cb83f7f5d1b772, user.id=16b57247b5a949828e67c2c9b470b7c2) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:05.536502 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d83617b-afa2-4bf6-91c4-1572345317e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:05.538416 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d83617b-afa2-4bf6-91c4-1572345317e8 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:05.545847 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 111/223] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 26 10:50:05 2022] GET /identity/v3/role_assignments?user.id=16b57247b5a949828e67c2c9b470b7c2&scope.project.id=9644a41001314f56b4cb83f7f5d1b772&role.id=f44ac39d2011426b83226a3c55468d77 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:06.815407 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d119995-cdb4-49ec-921b-674fc5167018 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:06.815926 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d119995-cdb4-49ec-921b-674fc5167018 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:06.816342 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d119995-cdb4-49ec-921b-674fc5167018 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:06.817479 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 113/224] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:50:06.822498 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f2f15-8a31-41f4-b279-6c78ee511b33 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:06.822910 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f2f15-8a31-41f4-b279-6c78ee511b33 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:06.823119 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f2f15-8a31-41f4-b279-6c78ee511b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:06.826011 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366fcd6-272c-4e9b-9f0d-495d1464f4c8 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:06.826274 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366fcd6-272c-4e9b-9f0d-495d1464f4c8 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:06.826562 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366fcd6-272c-4e9b-9f0d-495d1464f4c8 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:06.827953 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 114/225] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:50:06.833402 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eeb4f3-6642-4e96-b1d8-b741c5219cd1 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:06.833692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eeb4f3-6642-4e96-b1d8-b741c5219cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:06.833974 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eeb4f3-6642-4e96-b1d8-b741c5219cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:06.842524 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-6c0f2f15-8a31-41f4-b279-6c78ee511b33 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:06.843717 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6c0f2f15-8a31-41f4-b279-6c78ee511b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:06.853241 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-d0eeb4f3-6642-4e96-b1d8-b741c5219cd1 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:06.854420 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-d0eeb4f3-6642-4e96-b1d8-b741c5219cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:06.895752 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:06.911398 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 112/226] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:50:06.913702 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95586aa5-273e-4a10-9802-4aaa82bcc850 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:06.913995 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95586aa5-273e-4a10-9802-4aaa82bcc850 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:06.914281 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95586aa5-273e-4a10-9802-4aaa82bcc850 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:06.919798 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 113/227] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:50:06.921366 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b129fdd-d3ec-472e-91f5-80250007af99 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:06.921656 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b129fdd-d3ec-472e-91f5-80250007af99 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:06.921936 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b129fdd-d3ec-472e-91f5-80250007af99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:06.924346 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 115/228] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:50:06.940296 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-7b129fdd-d3ec-472e-91f5-80250007af99 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:06.941487 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7b129fdd-d3ec-472e-91f5-80250007af99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:07.012027 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 114/229] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:50:07.193328 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eeb4f3-6642-4e96-b1d8-b741c5219cd1 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:07.199228 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b129fdd-d3ec-472e-91f5-80250007af99 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:07.201826 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:07.298137 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eeb4f3-6642-4e96-b1d8-b741c5219cd1 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:07.307609 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b129fdd-d3ec-472e-91f5-80250007af99 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:07.332468 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2addfca3-3b6a-4a63-b2c3-725e29b9c32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:07.333099 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2addfca3-3b6a-4a63-b2c3-725e29b9c32b None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:07.333381 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2addfca3-3b6a-4a63-b2c3-725e29b9c32b None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:07.333654 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2addfca3-3b6a-4a63-b2c3-725e29b9c32b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:07.342172 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e0c725-7561-4d7c-a7c8-2f12d5073939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:07.342806 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0c725-7561-4d7c-a7c8-2f12d5073939 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:07.343269 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0c725-7561-4d7c-a7c8-2f12d5073939 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:07.343545 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0c725-7561-4d7c-a7c8-2f12d5073939 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:07.346450 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2addfca3-3b6a-4a63-b2c3-725e29b9c32b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:50:07.351314 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-2addfca3-3b6a-4a63-b2c3-725e29b9c32b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:50:07.351314 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:07.351314 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:07.351314 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:07.351314 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:07.351314 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:07.351314 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:07.351314 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:07.351314 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:07.351314 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:07.351314 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:07.351314 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:07.351314 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:50:07.351314 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:50:07.351314 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:50:07.351314 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:50:07.352349 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:50:07.352349 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:50:07.352349 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:50:07.352349 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:50:07.352349 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:07.352349 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:07.352349 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:07.352349 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:07.352349 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:07.352349 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:07.352349 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:07.352349 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:07.352349 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:07.352349 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:07.352349 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:07.352349 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:07.353132 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:07.353132 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:07.353132 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:07.353132 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:07.353132 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:50:07.353132 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:50:07.353132 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:50:07.353132 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:50:07.353132 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:50:07.353132 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:50:07.353132 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:50:07.353132 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:07.353132 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 116/230] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 26 10:50:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:50:07.354190 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2addfca3-3b6a-4a63-b2c3-725e29b9c32b None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:07.354928 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e0c725-7561-4d7c-a7c8-2f12d5073939 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:50:07.359845 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-28e0c725-7561-4d7c-a7c8-2f12d5073939 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 26 10:50:07.359845 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:07.359845 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:07.359845 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:07.359845 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:07.359845 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:07.359845 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:07.359845 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:07.359845 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:07.359845 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:07.359845 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:07.359845 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:07.359845 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:50:07.359845 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:50:07.359845 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:50:07.359845 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:50:07.360771 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:50:07.360771 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:50:07.360771 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:50:07.360771 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:50:07.360771 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:07.360771 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:07.360771 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:07.360771 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:07.360771 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:07.360771 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:07.360771 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:07.360771 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:07.360771 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:07.360771 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:07.360771 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:07.360771 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:07.362917 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:07.362917 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:07.362917 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:07.362917 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:07.362917 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:50:07.362917 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:50:07.362917 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:50:07.362917 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:50:07.362917 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:50:07.362917 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:50:07.362917 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 26 10:50:07.362917 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:07.362917 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 115/231] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 26 10:50:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:50:07.362917 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e0c725-7561-4d7c-a7c8-2f12d5073939 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:07.388549 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:07.423141 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:07.451421 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2addfca3-3b6a-4a63-b2c3-725e29b9c32b None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:07.462084 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e0c725-7561-4d7c-a7c8-2f12d5073939 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:07.485352 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5f3b5-26e0-461c-9649-3d87657a9fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:07.485977 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5f3b5-26e0-461c-9649-3d87657a9fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:07.486283 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5f3b5-26e0-461c-9649-3d87657a9fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:07.486551 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5f3b5-26e0-461c-9649-3d87657a9fc9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:07.487636 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a5f3b5-26e0-461c-9649-3d87657a9fc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:07.489100 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a5f3b5-26e0-461c-9649-3d87657a9fc9 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:07.490650 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 117/232] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:50:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:07.491403 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5f3b5-26e0-461c-9649-3d87657a9fc9 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:07.499305 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244d4c2-7348-475c-8cba-0b36992c2cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:07.499911 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244d4c2-7348-475c-8cba-0b36992c2cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:07.500235 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244d4c2-7348-475c-8cba-0b36992c2cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:07.500506 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244d4c2-7348-475c-8cba-0b36992c2cf0 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:07.501164 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0244d4c2-7348-475c-8cba-0b36992c2cf0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:07.501463 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0244d4c2-7348-475c-8cba-0b36992c2cf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:07.502868 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0244d4c2-7348-475c-8cba-0b36992c2cf0 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:07.510871 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 116/233] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Oct 26 10:50:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:07.513005 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244d4c2-7348-475c-8cba-0b36992c2cf0 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:07.589997 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5f3b5-26e0-461c-9649-3d87657a9fc9 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:07.593003 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:07.610642 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244d4c2-7348-475c-8cba-0b36992c2cf0 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:07.624010 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b3340-9143-408b-8ea4-068d5b92144f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:07.624648 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b3340-9143-408b-8ea4-068d5b92144f None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:07.624931 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b3340-9143-408b-8ea4-068d5b92144f None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:07.625205 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b3340-9143-408b-8ea4-068d5b92144f None admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:07.625863 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54b3340-9143-408b-8ea4-068d5b92144f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:07.626166 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54b3340-9143-408b-8ea4-068d5b92144f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:07.627628 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54b3340-9143-408b-8ea4-068d5b92144f None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:07.634946 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:07.636199 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 118/234] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Oct 26 10:50:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:07.637000 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b3340-9143-408b-8ea4-068d5b92144f None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:07.647002 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e382a-8c6c-499e-bdf2-f6471cce3f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:07.647624 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e382a-8c6c-499e-bdf2-f6471cce3f99 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:07.651775 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e382a-8c6c-499e-bdf2-f6471cce3f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:07.651775 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e382a-8c6c-499e-bdf2-f6471cce3f99 None admin] PATH_INFO: `/v3/groups` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:07.651775 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e382a-8c6c-499e-bdf2-f6471cce3f99 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:07.651775 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e382a-8c6c-499e-bdf2-f6471cce3f99 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:07.733472 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b3340-9143-408b-8ea4-068d5b92144f None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:07.736088 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 117/235] 10.222.0.45 () {60 vars in 1134 bytes} [Wed Oct 26 10:50:07 2022] POST /identity/v3/groups => generated 229 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:50:07.737609 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e382a-8c6c-499e-bdf2-f6471cce3f99 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:07.775418 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c4bcc-2dc0-4595-b7f8-b967a2fdbd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:07.776096 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c4bcc-2dc0-4595-b7f8-b967a2fdbd8b None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:07.776384 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c4bcc-2dc0-4595-b7f8-b967a2fdbd8b None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:07.776656 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c4bcc-2dc0-4595-b7f8-b967a2fdbd8b None admin] PATH_INFO: `/v3/users/b5b5ef5d40c649f19e225efb4076bbd2` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:07.777861 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c4bcc-2dc0-4595-b7f8-b967a2fdbd8b None admin] RBAC: Authorizing `identity:get_user(user_id=b5b5ef5d40c649f19e225efb4076bbd2)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:07.779337 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c4bcc-2dc0-4595-b7f8-b967a2fdbd8b None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:07.781206 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 119/236] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 26 10:50:07 2022] GET /identity/v3/users/b5b5ef5d40c649f19e225efb4076bbd2 => generated 293 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:07.787299 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c4bcc-2dc0-4595-b7f8-b967a2fdbd8b None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:07.825853 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:07.863256 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e382a-8c6c-499e-bdf2-f6471cce3f99 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:07.974533 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec8fa3-4e2f-4769-8ede-0e8007acb334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:07.975244 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec8fa3-4e2f-4769-8ede-0e8007acb334 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:07.975533 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec8fa3-4e2f-4769-8ede-0e8007acb334 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:07.975814 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec8fa3-4e2f-4769-8ede-0e8007acb334 None admin] PATH_INFO: `/v3/users/5db2b58657c14ff1b17996be954fb2f6` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:07.991361 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec8fa3-4e2f-4769-8ede-0e8007acb334 None admin] RBAC: Authorizing `identity:get_user(user_id=5db2b58657c14ff1b17996be954fb2f6)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:07.992797 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec8fa3-4e2f-4769-8ede-0e8007acb334 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:07.994467 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 118/237] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 26 10:50:07 2022] GET /identity/v3/users/5db2b58657c14ff1b17996be954fb2f6 => generated 293 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:08.000235 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec8fa3-4e2f-4769-8ede-0e8007acb334 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:08.017547 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c4bcc-2dc0-4595-b7f8-b967a2fdbd8b None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:08.044736 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:08.053237 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a453a4-d8c6-4132-80c4-d150b54e23d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:08.053895 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a453a4-d8c6-4132-80c4-d150b54e23d8 None admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:08.054178 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a453a4-d8c6-4132-80c4-d150b54e23d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:08.054457 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a453a4-d8c6-4132-80c4-d150b54e23d8 None admin] PATH_INFO: `/v3/system/users/b5b5ef5d40c649f19e225efb4076bbd2/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:08.055936 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a453a4-d8c6-4132-80c4-d150b54e23d8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b5b5ef5d40c649f19e225efb4076bbd2, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:08.057359 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a453a4-d8c6-4132-80c4-d150b54e23d8 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:08.102158 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec8fa3-4e2f-4769-8ede-0e8007acb334 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:08.134476 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd6ff5-b915-4ce1-be25-36a095420bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:08.135090 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd6ff5-b915-4ce1-be25-36a095420bc4 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:08.135373 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd6ff5-b915-4ce1-be25-36a095420bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:08.135648 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd6ff5-b915-4ce1-be25-36a095420bc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:08.136409 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd6ff5-b915-4ce1-be25-36a095420bc4 None admin] RBAC: Adding query filter params (role.id=f44ac39d2011426b83226a3c55468d77, user.id=5db2b58657c14ff1b17996be954fb2f6, scope.system=all) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:08.136760 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd6ff5-b915-4ce1-be25-36a095420bc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:08.138249 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd6ff5-b915-4ce1-be25-36a095420bc4 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:08.143601 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 119/238] 10.222.0.45 () {56 vars in 1308 bytes} [Wed Oct 26 10:50:07 2022] GET /identity/v3/role_assignments?user.id=5db2b58657c14ff1b17996be954fb2f6&scope.system=all&role.id=f44ac39d2011426b83226a3c55468d77 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:08.215423 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 120/239] 10.222.0.45 () {58 vars in 1334 bytes} [Wed Oct 26 10:50:07 2022] PUT /identity/v3/system/users/b5b5ef5d40c649f19e225efb4076bbd2/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 10:50:09.909071 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42aa20-e3cb-495d-ace4-7c50b9852f98 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:09.909645 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42aa20-e3cb-495d-ace4-7c50b9852f98 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:09.909645 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42aa20-e3cb-495d-ace4-7c50b9852f98 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:09.911102 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 120/240] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:50:09.916442 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e97a87-bff9-4a13-b659-1534101c2410 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:09.916820 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e97a87-bff9-4a13-b659-1534101c2410 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:09.916982 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e97a87-bff9-4a13-b659-1534101c2410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:09.935689 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-c8e97a87-bff9-4a13-b659-1534101c2410 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:09.936900 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-c8e97a87-bff9-4a13-b659-1534101c2410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:10.003314 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 121/241] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:50:10.268862 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42aa20-e3cb-495d-ace4-7c50b9852f98 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:10.302998 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456c266-e686-42fa-9bf7-d850b1b24499 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:10.303337 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456c266-e686-42fa-9bf7-d850b1b24499 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:10.303544 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456c266-e686-42fa-9bf7-d850b1b24499 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:10.305171 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 122/242] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:50:10.310001 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bbd01-30fc-4869-a8a8-87f20656d7e6 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:10.310285 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bbd01-30fc-4869-a8a8-87f20656d7e6 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:10.310559 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bbd01-30fc-4869-a8a8-87f20656d7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:10.329500 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-381bbd01-30fc-4869-a8a8-87f20656d7e6 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:10.331221 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-381bbd01-30fc-4869-a8a8-87f20656d7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:10.356211 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:10.383860 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42aa20-e3cb-495d-ace4-7c50b9852f98 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:10.391781 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:10.401599 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 123/243] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:50:10.404022 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1258e3-8568-4679-9c6c-e18947258feb None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:10.404361 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1258e3-8568-4679-9c6c-e18947258feb None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:10.404637 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1258e3-8568-4679-9c6c-e18947258feb None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:10.406049 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 124/244] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:50:10.411822 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e77539-39bd-44a4-9237-b7ad63e07c98 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:10.412126 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e77539-39bd-44a4-9237-b7ad63e07c98 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:10.412402 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e77539-39bd-44a4-9237-b7ad63e07c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:10.419913 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c29fe-9d91-41a8-b965-0a254caefaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:10.420578 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c29fe-9d91-41a8-b965-0a254caefaa9 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:10.420860 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c29fe-9d91-41a8-b965-0a254caefaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:10.425877 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c29fe-9d91-41a8-b965-0a254caefaa9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:10.425877 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c29fe-9d91-41a8-b965-0a254caefaa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:10.425877 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c29fe-9d91-41a8-b965-0a254caefaa9 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:10.425877 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 121/245] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:50:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:10.430618 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c29fe-9d91-41a8-b965-0a254caefaa9 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:10.432170 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-87e77539-39bd-44a4-9237-b7ad63e07c98 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:10.433343 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-87e77539-39bd-44a4-9237-b7ad63e07c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:10.508875 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 125/246] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:50:10.541940 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c29fe-9d91-41a8-b965-0a254caefaa9 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:10.577080 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0b1bf-4d73-47b1-a7f6-9519490ce804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:10.577690 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0b1bf-4d73-47b1-a7f6-9519490ce804 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:10.577971 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0b1bf-4d73-47b1-a7f6-9519490ce804 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:10.578250 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0b1bf-4d73-47b1-a7f6-9519490ce804 None admin] PATH_INFO: `/v3/groups` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:10.578885 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b0b1bf-4d73-47b1-a7f6-9519490ce804 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:10.580380 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b0b1bf-4d73-47b1-a7f6-9519490ce804 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:10.665824 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 122/247] 10.222.0.45 () {60 vars in 1134 bytes} [Wed Oct 26 10:50:10 2022] POST /identity/v3/groups => generated 226 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 10:50:10.669372 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e77539-39bd-44a4-9237-b7ad63e07c98 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:10.766789 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:10.779876 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e77539-39bd-44a4-9237-b7ad63e07c98 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:10.787808 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0b1bf-4d73-47b1-a7f6-9519490ce804 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:10.819526 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2c522-b02b-4a73-965e-1b8e1e7e4168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:10.820116 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2c522-b02b-4a73-965e-1b8e1e7e4168 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:10.820401 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2c522-b02b-4a73-965e-1b8e1e7e4168 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:10.820675 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2c522-b02b-4a73-965e-1b8e1e7e4168 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:10.829318 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:10.831545 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2c522-b02b-4a73-965e-1b8e1e7e4168 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:50:10.836886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-15c2c522-b02b-4a73-965e-1b8e1e7e4168 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 26 10:50:10.836886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:10.836886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:10.836886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:10.836886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:10.836886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:10.836886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:10.836886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:10.836886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:10.836886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:10.836886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:10.836886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:10.836886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:50:10.836886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:50:10.836886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:50:10.836886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:50:10.839094 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:50:10.839094 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:50:10.839094 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:50:10.839094 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:50:10.839094 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:10.839094 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:10.839094 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:10.839094 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:10.839094 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:10.839094 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:10.839094 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:10.839094 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:10.839094 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:10.839094 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:10.839094 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:10.839094 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:10.839912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:10.839912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:10.839912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:10.839912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:10.839912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:50:10.839912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:50:10.839912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:50:10.839912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:50:10.839912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:50:10.839912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:50:10.839912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 26 10:50:10.839912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:10.839912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 126/248] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 26 10:50:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:10.843468 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2c522-b02b-4a73-965e-1b8e1e7e4168 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:10.901679 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0b1bf-4d73-47b1-a7f6-9519490ce804 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:10.942949 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a868d89-0376-425f-8a7b-92c79ec90bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:10.942949 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a868d89-0376-425f-8a7b-92c79ec90bf7 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:10.942949 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a868d89-0376-425f-8a7b-92c79ec90bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:10.942949 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a868d89-0376-425f-8a7b-92c79ec90bf7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:10.953805 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a868d89-0376-425f-8a7b-92c79ec90bf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:50:10.958850 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-2a868d89-0376-425f-8a7b-92c79ec90bf7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:50:10.958850 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:10.958850 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:10.958850 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:10.958850 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:10.958850 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:10.958850 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:10.958850 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:10.958850 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:10.958850 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:10.958850 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:10.958850 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:10.958850 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:50:10.958850 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:50:10.958850 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:50:10.958850 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:50:10.959773 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:50:10.959773 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:50:10.959773 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:50:10.959773 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:50:10.959773 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:10.959773 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:10.959773 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:10.959773 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:10.959773 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:10.959773 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:10.959773 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:10.959773 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:10.959773 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:10.959773 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:10.959773 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:10.959773 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:10.960619 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:10.960619 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:10.960619 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:10.960619 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:10.960619 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:50:10.960619 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:50:10.960619 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:50:10.960619 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:50:10.960619 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:50:10.960619 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:50:10.960619 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:50:10.960619 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:10.960619 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 123/249] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 26 10:50:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:50:10.966344 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a868d89-0376-425f-8a7b-92c79ec90bf7 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:10.973184 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2c522-b02b-4a73-965e-1b8e1e7e4168 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:11.030448 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8afc25e-711e-4933-b9f7-13833a5412b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:11.031076 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afc25e-711e-4933-b9f7-13833a5412b8 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:11.031357 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afc25e-711e-4933-b9f7-13833a5412b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:11.031629 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afc25e-711e-4933-b9f7-13833a5412b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:11.032372 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8afc25e-711e-4933-b9f7-13833a5412b8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:11.032674 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8afc25e-711e-4933-b9f7-13833a5412b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:11.034106 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8afc25e-711e-4933-b9f7-13833a5412b8 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:11.049708 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 127/250] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Oct 26 10:50:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:50:11.055131 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8afc25e-711e-4933-b9f7-13833a5412b8 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:11.071254 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:11.092514 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:11.101702 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a868d89-0376-425f-8a7b-92c79ec90bf7 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:11.151291 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12c368-0f13-4517-9dad-1ef05b8530df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:11.151916 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12c368-0f13-4517-9dad-1ef05b8530df None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:11.152226 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12c368-0f13-4517-9dad-1ef05b8530df None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:11.152506 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12c368-0f13-4517-9dad-1ef05b8530df None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:11.153189 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c12c368-0f13-4517-9dad-1ef05b8530df None admin] RBAC: Adding query filter params (name=member) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:11.153653 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c12c368-0f13-4517-9dad-1ef05b8530df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:11.155203 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c12c368-0f13-4517-9dad-1ef05b8530df None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:11.165959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 124/251] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Oct 26 10:50:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:11.173188 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12c368-0f13-4517-9dad-1ef05b8530df None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:11.198933 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8afc25e-711e-4933-b9f7-13833a5412b8 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:11.243116 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589857a2-62b7-45c5-a226-508e92088fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:11.244151 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589857a2-62b7-45c5-a226-508e92088fdc None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:11.244861 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589857a2-62b7-45c5-a226-508e92088fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:11.245281 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589857a2-62b7-45c5-a226-508e92088fdc None admin] PATH_INFO: `/v3/users/5db2b58657c14ff1b17996be954fb2f6` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:11.247313 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589857a2-62b7-45c5-a226-508e92088fdc None admin] RBAC: Authorizing `identity:get_user(user_id=5db2b58657c14ff1b17996be954fb2f6)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:11.249747 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589857a2-62b7-45c5-a226-508e92088fdc None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:11.252929 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 128/252] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 26 10:50:11 2022] GET /identity/v3/users/5db2b58657c14ff1b17996be954fb2f6 => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:50:11.258227 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589857a2-62b7-45c5-a226-508e92088fdc None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:11.305294 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12c368-0f13-4517-9dad-1ef05b8530df None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:11.351229 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3b3ce-7770-43b5-b134-7d250ed5143a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:11.352297 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3b3ce-7770-43b5-b134-7d250ed5143a None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:11.352759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3b3ce-7770-43b5-b134-7d250ed5143a None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:11.353311 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3b3ce-7770-43b5-b134-7d250ed5143a None admin] PATH_INFO: `/v3/users/b5b5ef5d40c649f19e225efb4076bbd2` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:11.354648 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d3b3ce-7770-43b5-b134-7d250ed5143a None admin] RBAC: Authorizing `identity:get_user(user_id=b5b5ef5d40c649f19e225efb4076bbd2)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:11.356337 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d3b3ce-7770-43b5-b134-7d250ed5143a None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:11.358420 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 125/253] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 26 10:50:11 2022] GET /identity/v3/users/b5b5ef5d40c649f19e225efb4076bbd2 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:50:11.363875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3b3ce-7770-43b5-b134-7d250ed5143a None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:11.369752 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:11.398710 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589857a2-62b7-45c5-a226-508e92088fdc None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:11.420461 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:11.436773 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b574ed-de48-4b9f-b9bf-86ad57084ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:11.437804 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b574ed-de48-4b9f-b9bf-86ad57084ee0 None admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:11.438286 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b574ed-de48-4b9f-b9bf-86ad57084ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:11.438759 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b574ed-de48-4b9f-b9bf-86ad57084ee0 None admin] PATH_INFO: `/v3/system/users/5db2b58657c14ff1b17996be954fb2f6/roles/f44ac39d2011426b83226a3c55468d77` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:11.441355 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b574ed-de48-4b9f-b9bf-86ad57084ee0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5db2b58657c14ff1b17996be954fb2f6, role_id=f44ac39d2011426b83226a3c55468d77)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:11.442963 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b574ed-de48-4b9f-b9bf-86ad57084ee0 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:11.485003 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3b3ce-7770-43b5-b134-7d250ed5143a None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:11.513199 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 129/254] 10.222.0.45 () {58 vars in 1334 bytes} [Wed Oct 26 10:50:11 2022] PUT /identity/v3/system/users/5db2b58657c14ff1b17996be954fb2f6/roles/f44ac39d2011426b83226a3c55468d77 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 10:50:11.529263 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7b768-1df6-4d1e-b194-14e4d2594f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:11.529991 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7b768-1df6-4d1e-b194-14e4d2594f84 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:11.530281 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7b768-1df6-4d1e-b194-14e4d2594f84 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:11.530561 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7b768-1df6-4d1e-b194-14e4d2594f84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:11.531307 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf7b768-1df6-4d1e-b194-14e4d2594f84 None admin] RBAC: Adding query filter params (role.id=5d5a8bcef7c8455c9bb6b49e113e74c7, user.id=b5b5ef5d40c649f19e225efb4076bbd2, scope.system=all) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:11.531622 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf7b768-1df6-4d1e-b194-14e4d2594f84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:11.533157 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf7b768-1df6-4d1e-b194-14e4d2594f84 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:11.548350 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 126/255] 10.222.0.45 () {56 vars in 1308 bytes} [Wed Oct 26 10:50:11 2022] GET /identity/v3/role_assignments?user.id=b5b5ef5d40c649f19e225efb4076bbd2&scope.system=all&role.id=5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 510 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:13.315829 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7e54c-f62b-4696-a27f-7b2093f36e7d None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:13.316397 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7e54c-f62b-4696-a27f-7b2093f36e7d None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:13.316397 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7e54c-f62b-4696-a27f-7b2093f36e7d None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:13.317807 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 130/256] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:50:13.323731 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ed6d3-8c3f-490c-a981-3f2cb8cf9fc7 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:13.324271 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ed6d3-8c3f-490c-a981-3f2cb8cf9fc7 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:13.324345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ed6d3-8c3f-490c-a981-3f2cb8cf9fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:13.369130 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-b68ed6d3-8c3f-490c-a981-3f2cb8cf9fc7 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:13.370389 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b68ed6d3-8c3f-490c-a981-3f2cb8cf9fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:13.447739 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 127/257] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 26 10:50:13.491853 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87a222-02c4-48b5-8b6d-c9e5b6d8b81d None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:13.492185 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87a222-02c4-48b5-8b6d-c9e5b6d8b81d None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:13.492453 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87a222-02c4-48b5-8b6d-c9e5b6d8b81d None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:13.494055 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 131/258] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:50:13.499463 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422287ce-f83c-45a4-abce-10cf78fc619a None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:13.499754 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422287ce-f83c-45a4-abce-10cf78fc619a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:13.500038 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422287ce-f83c-45a4-abce-10cf78fc619a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:13.535427 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-422287ce-f83c-45a4-abce-10cf78fc619a None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:13.536993 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-422287ce-f83c-45a4-abce-10cf78fc619a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:13.548051 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 128/259] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 26 10:50:13.862043 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f87a222-02c4-48b5-8b6d-c9e5b6d8b81d None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:13.876406 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f87a222-02c4-48b5-8b6d-c9e5b6d8b81d None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:13.882106 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231b03b-9010-4b51-a594-c7902b9923fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:13.882751 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231b03b-9010-4b51-a594-c7902b9923fc admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:13.883035 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231b03b-9010-4b51-a594-c7902b9923fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:13.883315 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231b03b-9010-4b51-a594-c7902b9923fc admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:13.904996 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b231b03b-9010-4b51-a594-c7902b9923fc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:50:13.910671 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-b231b03b-9010-4b51-a594-c7902b9923fc admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:50:13.910671 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:13.910671 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:13.910671 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:13.910671 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:13.910671 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:13.910671 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:13.910671 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:13.910671 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:13.910671 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:13.910671 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:13.910671 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:13.910671 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:50:13.910671 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:50:13.910671 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:50:13.910671 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:50:13.911550 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:50:13.911550 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:50:13.911550 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:50:13.911550 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:50:13.911550 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:13.911550 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:13.911550 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:13.911550 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:13.911550 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:13.911550 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:13.911550 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:13.911550 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:13.911550 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:13.911550 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:13.911550 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:13.911550 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:13.912943 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:13.912943 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:13.912943 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:13.912943 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:13.912943 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:50:13.912943 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:50:13.912943 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:50:13.912943 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:50:13.912943 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:50:13.912943 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:50:13.912943 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:50:13.912943 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:13.912943 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 132/260] 10.222.0.45 () {56 vars in 1120 bytes} [Wed Oct 26 10:50:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:13.917875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422287ce-f83c-45a4-abce-10cf78fc619a None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:13.927550 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422287ce-f83c-45a4-abce-10cf78fc619a None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:13.936187 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3db47-a3ca-4ab2-82bf-15bc7a3f1129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:13.936811 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3db47-a3ca-4ab2-82bf-15bc7a3f1129 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:13.937096 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3db47-a3ca-4ab2-82bf-15bc7a3f1129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:13.937372 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3db47-a3ca-4ab2-82bf-15bc7a3f1129 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:13.938046 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed3db47-a3ca-4ab2-82bf-15bc7a3f1129 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:13.938351 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed3db47-a3ca-4ab2-82bf-15bc7a3f1129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:13.940731 dv-cinder-862679-1-smb devstack@keystone.service[81623]: WARNING py.warnings [None req-3ed3db47-a3ca-4ab2-82bf-15bc7a3f1129 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 26 10:50:13.940731 dv-cinder-862679-1-smb devstack@keystone.service[81623]: warnings.warn(msg) Oct 26 10:50:13.940731 dv-cinder-862679-1-smb devstack@keystone.service[81623]: Oct 26 10:50:13.941740 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed3db47-a3ca-4ab2-82bf-15bc7a3f1129 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:13.945718 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231b03b-9010-4b51-a594-c7902b9923fc admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:13.955810 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231b03b-9010-4b51-a594-c7902b9923fc admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:13.956248 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 129/261] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Oct 26 10:50:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:13.957180 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3db47-a3ca-4ab2-82bf-15bc7a3f1129 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:13.970337 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573e9f0-5991-4a03-9d66-ad946f7baf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:13.970991 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573e9f0-5991-4a03-9d66-ad946f7baf02 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:13.971847 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573e9f0-5991-4a03-9d66-ad946f7baf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:13.972137 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573e9f0-5991-4a03-9d66-ad946f7baf02 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:13.978287 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3db47-a3ca-4ab2-82bf-15bc7a3f1129 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:13.988721 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac88b7-b4f0-419e-b11c-7eb4f7c66553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:13.989371 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac88b7-b4f0-419e-b11c-7eb4f7c66553 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:13.989655 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac88b7-b4f0-419e-b11c-7eb4f7c66553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:13.989937 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac88b7-b4f0-419e-b11c-7eb4f7c66553 admin admin] PATH_INFO: `/v3/groups/0a9bf7c7247344c2b25bc7c2c22ce3a6` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:13.996496 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573e9f0-5991-4a03-9d66-ad946f7baf02 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:50:14.001567 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-a573e9f0-5991-4a03-9d66-ad946f7baf02 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 26 10:50:14.001567 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:14.001567 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:14.001567 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:14.001567 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:14.001567 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:14.001567 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:14.001567 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:14.001567 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:14.001567 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:14.001567 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:14.001567 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:14.001567 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:50:14.001567 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:50:14.001567 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:50:14.001567 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:50:14.004342 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:50:14.004342 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:50:14.004342 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:50:14.004342 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:50:14.004342 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:14.004342 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:14.004342 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:14.004342 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:14.004342 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:14.004342 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:14.004342 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:14.004342 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:14.004342 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:14.004342 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:14.004342 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:14.004342 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:14.006517 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:14.006517 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:14.006517 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:14.006517 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:14.006517 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:50:14.006517 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:50:14.006517 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:50:14.006517 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:50:14.006517 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:50:14.006517 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:50:14.006517 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 26 10:50:14.006517 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:14.008043 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac88b7-b4f0-419e-b11c-7eb4f7c66553 admin admin] RBAC: Authorizing `identity:get_group(group_id=0a9bf7c7247344c2b25bc7c2c22ce3a6)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:14.008043 dv-cinder-862679-1-smb devstack@keystone.service[81623]: WARNING py.warnings [None req-9cac88b7-b4f0-419e-b11c-7eb4f7c66553 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 26 10:50:14.008043 dv-cinder-862679-1-smb devstack@keystone.service[81623]: warnings.warn(msg) Oct 26 10:50:14.008043 dv-cinder-862679-1-smb devstack@keystone.service[81623]: Oct 26 10:50:14.008641 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 133/262] 10.222.0.45 () {56 vars in 1135 bytes} [Wed Oct 26 10:50:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:14.008783 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac88b7-b4f0-419e-b11c-7eb4f7c66553 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:14.010217 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573e9f0-5991-4a03-9d66-ad946f7baf02 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:14.010400 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 130/263] 10.222.0.45 () {56 vars in 1201 bytes} [Wed Oct 26 10:50:13 2022] GET /identity/v3/groups/0a9bf7c7247344c2b25bc7c2c22ce3a6 => generated 226 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:14.015637 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac88b7-b4f0-419e-b11c-7eb4f7c66553 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:14.026243 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:14.027817 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573e9f0-5991-4a03-9d66-ad946f7baf02 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:14.037335 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac88b7-b4f0-419e-b11c-7eb4f7c66553 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:14.044815 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73feb434-0569-4979-b471-9e785537ee88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:14.045477 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73feb434-0569-4979-b471-9e785537ee88 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:14.045731 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73feb434-0569-4979-b471-9e785537ee88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:14.046017 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73feb434-0569-4979-b471-9e785537ee88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:14.046674 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73feb434-0569-4979-b471-9e785537ee88 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:14.046967 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73feb434-0569-4979-b471-9e785537ee88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:14.048832 dv-cinder-862679-1-smb devstack@keystone.service[81622]: WARNING py.warnings [None req-73feb434-0569-4979-b471-9e785537ee88 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 26 10:50:14.048832 dv-cinder-862679-1-smb devstack@keystone.service[81622]: warnings.warn(msg) Oct 26 10:50:14.048832 dv-cinder-862679-1-smb devstack@keystone.service[81622]: Oct 26 10:50:14.049828 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73feb434-0569-4979-b471-9e785537ee88 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:14.060049 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 134/264] 10.222.0.45 () {56 vars in 1132 bytes} [Wed Oct 26 10:50:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:14.060997 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270715fa-7450-4b83-8502-062e9ea334c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:14.061654 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270715fa-7450-4b83-8502-062e9ea334c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:14.061943 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270715fa-7450-4b83-8502-062e9ea334c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:14.062358 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270715fa-7450-4b83-8502-062e9ea334c7 admin admin] PATH_INFO: `/v3/projects/d161ac8d78bd458891d682168cd22b97` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:14.063585 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270715fa-7450-4b83-8502-062e9ea334c7 admin admin] RBAC: Authorizing `identity:get_project(project_id=d161ac8d78bd458891d682168cd22b97)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:14.065733 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73feb434-0569-4979-b471-9e785537ee88 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:14.065943 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270715fa-7450-4b83-8502-062e9ea334c7 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:14.072365 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 131/265] 10.222.0.45 () {56 vars in 1207 bytes} [Wed Oct 26 10:50:14 2022] GET /identity/v3/projects/d161ac8d78bd458891d682168cd22b97 => generated 298 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:14.073259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270715fa-7450-4b83-8502-062e9ea334c7 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:14.081944 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73feb434-0569-4979-b471-9e785537ee88 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:14.090170 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270715fa-7450-4b83-8502-062e9ea334c7 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:14.093965 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a984d-a432-4325-af0a-08f075fba8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:14.094645 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a984d-a432-4325-af0a-08f075fba8d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:14.094905 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a984d-a432-4325-af0a-08f075fba8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:14.095182 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a984d-a432-4325-af0a-08f075fba8d4 admin admin] PATH_INFO: `/v3/groups/0a9bf7c7247344c2b25bc7c2c22ce3a6` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:14.096784 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a984d-a432-4325-af0a-08f075fba8d4 admin admin] RBAC: Authorizing `identity:get_group(group_id=0a9bf7c7247344c2b25bc7c2c22ce3a6)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:14.097810 dv-cinder-862679-1-smb devstack@keystone.service[81622]: WARNING py.warnings [None req-5e2a984d-a432-4325-af0a-08f075fba8d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 26 10:50:14.097810 dv-cinder-862679-1-smb devstack@keystone.service[81622]: warnings.warn(msg) Oct 26 10:50:14.097810 dv-cinder-862679-1-smb devstack@keystone.service[81622]: Oct 26 10:50:14.099043 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a984d-a432-4325-af0a-08f075fba8d4 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:14.100663 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 135/266] 10.222.0.45 () {56 vars in 1201 bytes} [Wed Oct 26 10:50:14 2022] GET /identity/v3/groups/0a9bf7c7247344c2b25bc7c2c22ce3a6 => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:14.103168 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077a3bc-1c17-4348-87c3-39ab43d52a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:14.103848 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077a3bc-1c17-4348-87c3-39ab43d52a9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:14.104156 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077a3bc-1c17-4348-87c3-39ab43d52a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:14.104438 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077a3bc-1c17-4348-87c3-39ab43d52a9e admin admin] PATH_INFO: `/v3/projects/d161ac8d78bd458891d682168cd22b97/groups/0a9bf7c7247344c2b25bc7c2c22ce3a6/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:14.106078 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a984d-a432-4325-af0a-08f075fba8d4 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:14.112648 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077a3bc-1c17-4348-87c3-39ab43d52a9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d161ac8d78bd458891d682168cd22b97, group_id=0a9bf7c7247344c2b25bc7c2c22ce3a6, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:14.113627 dv-cinder-862679-1-smb devstack@keystone.service[81623]: WARNING py.warnings [None req-1077a3bc-1c17-4348-87c3-39ab43d52a9e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 26 10:50:14.113627 dv-cinder-862679-1-smb devstack@keystone.service[81623]: warnings.warn(msg) Oct 26 10:50:14.113627 dv-cinder-862679-1-smb devstack@keystone.service[81623]: Oct 26 10:50:14.115634 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077a3bc-1c17-4348-87c3-39ab43d52a9e admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:14.130321 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a984d-a432-4325-af0a-08f075fba8d4 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:14.135414 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f55bf9-8b29-4786-b2a9-81d4c2dd0aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:14.136051 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f55bf9-8b29-4786-b2a9-81d4c2dd0aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:14.136359 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f55bf9-8b29-4786-b2a9-81d4c2dd0aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:14.136636 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f55bf9-8b29-4786-b2a9-81d4c2dd0aa5 admin admin] PATH_INFO: `/v3/projects/d161ac8d78bd458891d682168cd22b97` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:14.140750 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f55bf9-8b29-4786-b2a9-81d4c2dd0aa5 admin admin] RBAC: Authorizing `identity:get_project(project_id=d161ac8d78bd458891d682168cd22b97)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:14.142847 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f55bf9-8b29-4786-b2a9-81d4c2dd0aa5 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:14.145390 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 136/267] 10.222.0.45 () {56 vars in 1207 bytes} [Wed Oct 26 10:50:14 2022] GET /identity/v3/projects/d161ac8d78bd458891d682168cd22b97 => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:14.150768 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f55bf9-8b29-4786-b2a9-81d4c2dd0aa5 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:14.162106 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f55bf9-8b29-4786-b2a9-81d4c2dd0aa5 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:14.166860 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a54188-0258-4cfa-a008-592b5ffcc828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:14.167518 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a54188-0258-4cfa-a008-592b5ffcc828 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:14.167793 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a54188-0258-4cfa-a008-592b5ffcc828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:14.168162 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a54188-0258-4cfa-a008-592b5ffcc828 admin admin] PATH_INFO: `/v3/projects/d161ac8d78bd458891d682168cd22b97/groups/0a9bf7c7247344c2b25bc7c2c22ce3a6/roles/a29ce5d75abc411488ef339c191e6d05` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:14.170442 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a54188-0258-4cfa-a008-592b5ffcc828 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d161ac8d78bd458891d682168cd22b97, group_id=0a9bf7c7247344c2b25bc7c2c22ce3a6, role_id=a29ce5d75abc411488ef339c191e6d05)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:14.171632 dv-cinder-862679-1-smb devstack@keystone.service[81622]: WARNING py.warnings [None req-d0a54188-0258-4cfa-a008-592b5ffcc828 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 26 10:50:14.171632 dv-cinder-862679-1-smb devstack@keystone.service[81622]: warnings.warn(msg) Oct 26 10:50:14.171632 dv-cinder-862679-1-smb devstack@keystone.service[81622]: Oct 26 10:50:14.173953 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a54188-0258-4cfa-a008-592b5ffcc828 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:14.205381 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 132/268] 10.222.0.45 () {58 vars in 1463 bytes} [Wed Oct 26 10:50:14 2022] PUT /identity/v3/projects/d161ac8d78bd458891d682168cd22b97/groups/0a9bf7c7247344c2b25bc7c2c22ce3a6/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:50:14.211821 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b49fc0-a012-4529-ba1b-0b629c8e9056 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:14.212145 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b49fc0-a012-4529-ba1b-0b629c8e9056 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:14.212435 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b49fc0-a012-4529-ba1b-0b629c8e9056 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:14.213846 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 133/269] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:50:14.219729 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1cbe21-88a4-4f12-be7a-e7a3205ae320 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:14.220144 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1cbe21-88a4-4f12-be7a-e7a3205ae320 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:14.220504 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1cbe21-88a4-4f12-be7a-e7a3205ae320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:14.257399 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-9c1cbe21-88a4-4f12-be7a-e7a3205ae320 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:14.258764 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9c1cbe21-88a4-4f12-be7a-e7a3205ae320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:14.306791 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 137/270] 10.222.0.45 () {58 vars in 1463 bytes} [Wed Oct 26 10:50:14 2022] PUT /identity/v3/projects/d161ac8d78bd458891d682168cd22b97/groups/0a9bf7c7247344c2b25bc7c2c22ce3a6/roles/a29ce5d75abc411488ef339c191e6d05 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 10:50:14.360657 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 134/271] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 26 10:50:14.569959 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83fde4d-b896-4b77-bd47-e531e4b4ce40 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:14.570977 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83fde4d-b896-4b77-bd47-e531e4b4ce40 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:14.571463 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83fde4d-b896-4b77-bd47-e531e4b4ce40 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:14.573095 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 138/272] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:50:14.578669 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f80e9-7552-4239-83a5-82ed64c79a52 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:14.578960 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f80e9-7552-4239-83a5-82ed64c79a52 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:14.579237 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f80e9-7552-4239-83a5-82ed64c79a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:14.602267 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-fa3f80e9-7552-4239-83a5-82ed64c79a52 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:14.603463 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-fa3f80e9-7552-4239-83a5-82ed64c79a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:14.677395 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 135/273] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:50:14.737671 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83fde4d-b896-4b77-bd47-e531e4b4ce40 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:14.802126 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83fde4d-b896-4b77-bd47-e531e4b4ce40 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:14.806512 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1589dbf-c242-40b1-998c-dd34b9350316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:14.807142 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1589dbf-c242-40b1-998c-dd34b9350316 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:14.807423 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1589dbf-c242-40b1-998c-dd34b9350316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:14.807695 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1589dbf-c242-40b1-998c-dd34b9350316 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:14.818617 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1589dbf-c242-40b1-998c-dd34b9350316 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:50:14.824012 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-b1589dbf-c242-40b1-998c-dd34b9350316 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:50:14.824012 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:14.824012 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:14.824012 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:14.824012 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:14.824012 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:14.824012 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:14.824012 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:14.824012 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:14.824012 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:14.824012 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:14.824012 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:14.824012 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:50:14.824012 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:50:14.824012 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:50:14.824012 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:50:14.824886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:50:14.824886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:50:14.824886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:50:14.824886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:50:14.824886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:14.824886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:14.824886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:14.824886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:14.824886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:14.824886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:14.824886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:14.824886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:14.824886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:14.824886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:14.824886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:14.824886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:14.825676 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:14.825676 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:14.825676 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:14.825676 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:14.825676 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:50:14.825676 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:50:14.825676 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:50:14.825676 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:50:14.825676 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:50:14.825676 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:50:14.825676 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:50:14.825676 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:14.825676 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 139/274] 10.222.0.45 () {56 vars in 1120 bytes} [Wed Oct 26 10:50:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:14.831613 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f80e9-7552-4239-83a5-82ed64c79a52 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:14.842311 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f80e9-7552-4239-83a5-82ed64c79a52 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:14.848528 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab848fcb-d735-46b2-b0e8-8a5f241aaf6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:14.849149 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab848fcb-d735-46b2-b0e8-8a5f241aaf6d admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:14.849431 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab848fcb-d735-46b2-b0e8-8a5f241aaf6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:14.849708 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab848fcb-d735-46b2-b0e8-8a5f241aaf6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:14.850382 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab848fcb-d735-46b2-b0e8-8a5f241aaf6d admin admin] RBAC: Adding query filter params (name=member) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:14.850684 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab848fcb-d735-46b2-b0e8-8a5f241aaf6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:14.852342 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab848fcb-d735-46b2-b0e8-8a5f241aaf6d admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:14.861406 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 136/275] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Oct 26 10:50:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:14.867512 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1589dbf-c242-40b1-998c-dd34b9350316 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:14.878216 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1589dbf-c242-40b1-998c-dd34b9350316 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:14.883609 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93c3f6-c2bf-4f58-80ff-705d6b5dcd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:14.884302 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93c3f6-c2bf-4f58-80ff-705d6b5dcd04 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:14.884589 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93c3f6-c2bf-4f58-80ff-705d6b5dcd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:14.884864 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93c3f6-c2bf-4f58-80ff-705d6b5dcd04 admin admin] PATH_INFO: `/v3/groups/0a9bf7c7247344c2b25bc7c2c22ce3a6` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:14.885986 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93c3f6-c2bf-4f58-80ff-705d6b5dcd04 admin admin] RBAC: Authorizing `identity:get_group(group_id=0a9bf7c7247344c2b25bc7c2c22ce3a6)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:14.887933 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93c3f6-c2bf-4f58-80ff-705d6b5dcd04 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:14.889540 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 140/276] 10.222.0.45 () {56 vars in 1201 bytes} [Wed Oct 26 10:50:14 2022] GET /identity/v3/groups/0a9bf7c7247344c2b25bc7c2c22ce3a6 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:14.895558 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab848fcb-d735-46b2-b0e8-8a5f241aaf6d admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:14.906554 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab848fcb-d735-46b2-b0e8-8a5f241aaf6d admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:14.911171 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2396f3-e1a2-4491-ab44-f52e2a6b2c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:14.911809 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2396f3-e1a2-4491-ab44-f52e2a6b2c51 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:14.912111 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2396f3-e1a2-4491-ab44-f52e2a6b2c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:14.912394 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2396f3-e1a2-4491-ab44-f52e2a6b2c51 admin admin] PATH_INFO: `/v3/projects/9644a41001314f56b4cb83f7f5d1b772` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:14.913528 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2396f3-e1a2-4491-ab44-f52e2a6b2c51 admin admin] RBAC: Authorizing `identity:get_project(project_id=9644a41001314f56b4cb83f7f5d1b772)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:14.915877 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2396f3-e1a2-4491-ab44-f52e2a6b2c51 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:14.917553 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 137/277] 10.222.0.45 () {56 vars in 1207 bytes} [Wed Oct 26 10:50:14 2022] GET /identity/v3/projects/9644a41001314f56b4cb83f7f5d1b772 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:14.923233 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93c3f6-c2bf-4f58-80ff-705d6b5dcd04 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:14.933748 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93c3f6-c2bf-4f58-80ff-705d6b5dcd04 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:14.938242 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf786e84-dc8f-4484-b2af-4dfb8a9299b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:14.938909 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf786e84-dc8f-4484-b2af-4dfb8a9299b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:14.939192 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf786e84-dc8f-4484-b2af-4dfb8a9299b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:14.939474 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf786e84-dc8f-4484-b2af-4dfb8a9299b8 admin admin] PATH_INFO: `/v3/projects/9644a41001314f56b4cb83f7f5d1b772/groups/0a9bf7c7247344c2b25bc7c2c22ce3a6/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:14.941482 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf786e84-dc8f-4484-b2af-4dfb8a9299b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9644a41001314f56b4cb83f7f5d1b772, group_id=0a9bf7c7247344c2b25bc7c2c22ce3a6, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:14.944176 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf786e84-dc8f-4484-b2af-4dfb8a9299b8 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:15.086255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2396f3-e1a2-4491-ab44-f52e2a6b2c51 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:15.112591 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 141/278] 10.222.0.45 () {58 vars in 1463 bytes} [Wed Oct 26 10:50:14 2022] PUT /identity/v3/projects/9644a41001314f56b4cb83f7f5d1b772/groups/0a9bf7c7247344c2b25bc7c2c22ce3a6/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:50:15.149755 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:15.203673 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2396f3-e1a2-4491-ab44-f52e2a6b2c51 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:15.242448 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673274ae-82d8-4b60-87b1-4b9410dc5817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:15.243103 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673274ae-82d8-4b60-87b1-4b9410dc5817 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:15.243388 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673274ae-82d8-4b60-87b1-4b9410dc5817 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:15.243666 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673274ae-82d8-4b60-87b1-4b9410dc5817 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:15.257934 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673274ae-82d8-4b60-87b1-4b9410dc5817 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:50:15.263312 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-673274ae-82d8-4b60-87b1-4b9410dc5817 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 26 10:50:15.263312 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:15.263312 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:15.263312 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:15.263312 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:15.263312 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:15.263312 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:15.263312 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:15.263312 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:15.263312 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:15.263312 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:15.263312 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:15.263312 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:50:15.263312 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:50:15.263312 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:50:15.263312 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:50:15.264225 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:50:15.264225 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:50:15.264225 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:50:15.264225 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:50:15.264225 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:15.264225 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:15.264225 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:15.264225 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:15.264225 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:15.264225 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:15.264225 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:15.264225 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:15.264225 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:15.264225 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:15.264225 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:15.264225 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:15.265118 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:15.265118 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:15.265118 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:15.265118 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:15.265118 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:50:15.265118 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:50:15.265118 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:50:15.265118 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:50:15.265118 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:50:15.265118 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:50:15.265118 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 26 10:50:15.265118 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:15.265118 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 138/279] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 26 10:50:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:15.270718 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf786e84-dc8f-4484-b2af-4dfb8a9299b8 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:15.292500 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:15.400273 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf786e84-dc8f-4484-b2af-4dfb8a9299b8 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:15.445833 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342624a6-8644-4349-b4cc-1c8d010fd4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:15.446459 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342624a6-8644-4349-b4cc-1c8d010fd4a7 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:15.446740 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342624a6-8644-4349-b4cc-1c8d010fd4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:15.447015 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342624a6-8644-4349-b4cc-1c8d010fd4a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:15.447697 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342624a6-8644-4349-b4cc-1c8d010fd4a7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:15.447999 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342624a6-8644-4349-b4cc-1c8d010fd4a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:15.449444 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342624a6-8644-4349-b4cc-1c8d010fd4a7 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:15.464499 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 142/280] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Oct 26 10:50:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:15.470166 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673274ae-82d8-4b60-87b1-4b9410dc5817 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:15.596578 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673274ae-82d8-4b60-87b1-4b9410dc5817 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:15.607473 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:15.632201 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274ab67-aaa1-4f87-8407-22b731fb5c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:15.632863 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274ab67-aaa1-4f87-8407-22b731fb5c7c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:15.633167 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274ab67-aaa1-4f87-8407-22b731fb5c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:15.633447 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274ab67-aaa1-4f87-8407-22b731fb5c7c None admin] PATH_INFO: `/v3/users/5db2b58657c14ff1b17996be954fb2f6` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:15.635587 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3274ab67-aaa1-4f87-8407-22b731fb5c7c None admin] RBAC: Authorizing `identity:get_user(user_id=5db2b58657c14ff1b17996be954fb2f6)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:15.637683 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3274ab67-aaa1-4f87-8407-22b731fb5c7c None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:15.644433 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 139/281] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 26 10:50:15 2022] GET /identity/v3/users/5db2b58657c14ff1b17996be954fb2f6 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:15.646574 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342624a6-8644-4349-b4cc-1c8d010fd4a7 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:15.681837 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42b80b-2aa3-40af-8dc4-1f3651690dd6 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:15.682151 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42b80b-2aa3-40af-8dc4-1f3651690dd6 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:15.682405 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42b80b-2aa3-40af-8dc4-1f3651690dd6 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:15.683747 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 140/282] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:50:15.689458 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29009cc0-4e21-4241-96b9-14f0de362159 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:15.689745 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29009cc0-4e21-4241-96b9-14f0de362159 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:15.690087 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29009cc0-4e21-4241-96b9-14f0de362159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:15.711782 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-29009cc0-4e21-4241-96b9-14f0de362159 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:15.713034 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-29009cc0-4e21-4241-96b9-14f0de362159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:15.751132 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:15.780512 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342624a6-8644-4349-b4cc-1c8d010fd4a7 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:15.785579 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 141/283] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 26 10:50:15.822315 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b3d56-f4d2-4bae-9bac-35148545f2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:15.823172 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b3d56-f4d2-4bae-9bac-35148545f2e0 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:15.823595 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b3d56-f4d2-4bae-9bac-35148545f2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:15.824007 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b3d56-f4d2-4bae-9bac-35148545f2e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:15.825092 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b3d56-f4d2-4bae-9bac-35148545f2e0 None admin] RBAC: Adding query filter params (role.id=f44ac39d2011426b83226a3c55468d77, user.id=5db2b58657c14ff1b17996be954fb2f6, scope.system=all) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:15.825546 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b3d56-f4d2-4bae-9bac-35148545f2e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:15.827125 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b3d56-f4d2-4bae-9bac-35148545f2e0 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:15.840744 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 143/284] 10.222.0.45 () {56 vars in 1308 bytes} [Wed Oct 26 10:50:15 2022] GET /identity/v3/role_assignments?user.id=5db2b58657c14ff1b17996be954fb2f6&scope.system=all&role.id=f44ac39d2011426b83226a3c55468d77 => generated 510 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:16.100030 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29009cc0-4e21-4241-96b9-14f0de362159 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:16.110237 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29009cc0-4e21-4241-96b9-14f0de362159 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:16.116616 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea114cb9-baa6-4b48-b506-e0962fcbe6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:16.117468 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea114cb9-baa6-4b48-b506-e0962fcbe6f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:16.117837 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea114cb9-baa6-4b48-b506-e0962fcbe6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:16.118207 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea114cb9-baa6-4b48-b506-e0962fcbe6f5 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:16.135719 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea114cb9-baa6-4b48-b506-e0962fcbe6f5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:50:16.140927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-ea114cb9-baa6-4b48-b506-e0962fcbe6f5 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 26 10:50:16.140927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:16.140927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:16.140927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:16.140927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:16.140927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:16.140927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:16.140927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:16.140927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:16.140927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:16.140927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:16.140927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:16.140927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:50:16.140927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:50:16.140927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:50:16.140927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:50:16.141807 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:50:16.141807 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:50:16.141807 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:50:16.141807 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:50:16.141807 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:16.141807 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:16.141807 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:16.141807 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:16.141807 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:16.141807 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:16.141807 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:16.141807 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:16.141807 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:16.141807 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:16.141807 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:16.141807 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:16.142613 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:16.142613 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:16.142613 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:16.142613 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:16.142613 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:50:16.142613 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:50:16.142613 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:50:16.142613 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:50:16.142613 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:50:16.142613 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:50:16.142613 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 26 10:50:16.142613 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:16.142613 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 142/285] 10.222.0.45 () {56 vars in 1135 bytes} [Wed Oct 26 10:50:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:16.149366 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b3d56-f4d2-4bae-9bac-35148545f2e0 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:16.165223 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b3d56-f4d2-4bae-9bac-35148545f2e0 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:16.169929 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f28a30-1fc8-4160-b0fd-3463ca61fc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:16.170585 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f28a30-1fc8-4160-b0fd-3463ca61fc62 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:16.170863 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f28a30-1fc8-4160-b0fd-3463ca61fc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:16.171131 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f28a30-1fc8-4160-b0fd-3463ca61fc62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:16.171787 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f28a30-1fc8-4160-b0fd-3463ca61fc62 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:16.172101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f28a30-1fc8-4160-b0fd-3463ca61fc62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:16.173838 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f28a30-1fc8-4160-b0fd-3463ca61fc62 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:16.184478 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 144/286] 10.222.0.45 () {56 vars in 1132 bytes} [Wed Oct 26 10:50:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:16.189941 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea114cb9-baa6-4b48-b506-e0962fcbe6f5 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:16.203484 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea114cb9-baa6-4b48-b506-e0962fcbe6f5 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:16.208927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1041f-d0b7-42c7-b099-4859cb7c231a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:16.209752 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1041f-d0b7-42c7-b099-4859cb7c231a admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:16.210031 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1041f-d0b7-42c7-b099-4859cb7c231a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:16.210395 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1041f-d0b7-42c7-b099-4859cb7c231a admin admin] PATH_INFO: `/v3/groups/0a9bf7c7247344c2b25bc7c2c22ce3a6` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:16.211759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f1041f-d0b7-42c7-b099-4859cb7c231a admin admin] RBAC: Authorizing `identity:get_group(group_id=0a9bf7c7247344c2b25bc7c2c22ce3a6)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:16.213773 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f1041f-d0b7-42c7-b099-4859cb7c231a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:16.215668 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 143/287] 10.222.0.45 () {56 vars in 1201 bytes} [Wed Oct 26 10:50:16 2022] GET /identity/v3/groups/0a9bf7c7247344c2b25bc7c2c22ce3a6 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:16.221163 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f28a30-1fc8-4160-b0fd-3463ca61fc62 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:16.233776 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f28a30-1fc8-4160-b0fd-3463ca61fc62 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:16.239427 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315c9d4-5374-4ef0-adbd-202d8d67f584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:16.240090 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315c9d4-5374-4ef0-adbd-202d8d67f584 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:16.240367 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315c9d4-5374-4ef0-adbd-202d8d67f584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:16.240637 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315c9d4-5374-4ef0-adbd-202d8d67f584 admin admin] PATH_INFO: `/v3/projects/9644a41001314f56b4cb83f7f5d1b772` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:16.241767 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1315c9d4-5374-4ef0-adbd-202d8d67f584 admin admin] RBAC: Authorizing `identity:get_project(project_id=9644a41001314f56b4cb83f7f5d1b772)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:16.243875 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1315c9d4-5374-4ef0-adbd-202d8d67f584 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:16.245729 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 145/288] 10.222.0.45 () {56 vars in 1207 bytes} [Wed Oct 26 10:50:16 2022] GET /identity/v3/projects/9644a41001314f56b4cb83f7f5d1b772 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:16.251710 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1041f-d0b7-42c7-b099-4859cb7c231a admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:16.265452 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1041f-d0b7-42c7-b099-4859cb7c231a admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:16.274463 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a31170-9157-4b8e-91c8-a31eec37ae58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:16.275205 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a31170-9157-4b8e-91c8-a31eec37ae58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:16.275484 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a31170-9157-4b8e-91c8-a31eec37ae58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:16.275814 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a31170-9157-4b8e-91c8-a31eec37ae58 admin admin] PATH_INFO: `/v3/projects/9644a41001314f56b4cb83f7f5d1b772/groups/0a9bf7c7247344c2b25bc7c2c22ce3a6/roles/a29ce5d75abc411488ef339c191e6d05` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:16.279712 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a31170-9157-4b8e-91c8-a31eec37ae58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9644a41001314f56b4cb83f7f5d1b772, group_id=0a9bf7c7247344c2b25bc7c2c22ce3a6, role_id=a29ce5d75abc411488ef339c191e6d05)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:16.282655 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a31170-9157-4b8e-91c8-a31eec37ae58 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:16.378407 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 144/289] 10.222.0.45 () {58 vars in 1463 bytes} [Wed Oct 26 10:50:16 2022] PUT /identity/v3/projects/9644a41001314f56b4cb83f7f5d1b772/groups/0a9bf7c7247344c2b25bc7c2c22ce3a6/roles/a29ce5d75abc411488ef339c191e6d05 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:50:16.683992 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7de6c8-8126-42c2-8c87-5e8faeb55e0d None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:16.684694 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7de6c8-8126-42c2-8c87-5e8faeb55e0d None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:16.684694 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7de6c8-8126-42c2-8c87-5e8faeb55e0d None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:16.685977 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 146/290] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:50:16.691827 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce9b21-2abe-4342-8afe-c90678c9451f None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:16.692408 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce9b21-2abe-4342-8afe-c90678c9451f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:16.692408 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce9b21-2abe-4342-8afe-c90678c9451f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:16.715176 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-21ce9b21-2abe-4342-8afe-c90678c9451f None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:16.716415 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-21ce9b21-2abe-4342-8afe-c90678c9451f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:16.786543 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 145/291] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 26 10:50:17.171735 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7de6c8-8126-42c2-8c87-5e8faeb55e0d None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:17.188794 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7de6c8-8126-42c2-8c87-5e8faeb55e0d None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:17.194159 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bcb89a-0cda-4715-8e10-4d4cf002c070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:17.195039 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bcb89a-0cda-4715-8e10-4d4cf002c070 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:17.195515 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bcb89a-0cda-4715-8e10-4d4cf002c070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:17.195982 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bcb89a-0cda-4715-8e10-4d4cf002c070 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:17.211334 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bcb89a-0cda-4715-8e10-4d4cf002c070 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:50:17.214734 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad5748-a8e1-42dd-85ec-9435d0ba444c None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:17.215243 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad5748-a8e1-42dd-85ec-9435d0ba444c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:17.215719 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad5748-a8e1-42dd-85ec-9435d0ba444c None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:17.217286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 146/292] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:50:17.220985 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-59bcb89a-0cda-4715-8e10-4d4cf002c070 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:50:17.220985 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:17.220985 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:17.220985 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:17.220985 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:17.220985 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:17.220985 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:17.220985 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:17.220985 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:17.220985 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:17.220985 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:17.220985 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:17.220985 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:50:17.220985 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:50:17.220985 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:50:17.220985 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:50:17.221929 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:50:17.221929 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:50:17.221929 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:50:17.221929 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:50:17.221929 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:17.221929 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:17.221929 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:17.221929 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:17.221929 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:17.221929 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:17.221929 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:17.221929 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:17.221929 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:17.221929 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:17.221929 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:17.221929 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:17.222715 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:17.222715 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:17.222715 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:17.222715 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:17.222715 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:50:17.222715 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:50:17.222715 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:50:17.222715 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:50:17.222715 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:50:17.222715 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:50:17.222715 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:50:17.222715 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:17.225026 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846ecde-a609-45dd-bf25-27ebbc953b65 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:17.225518 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846ecde-a609-45dd-bf25-27ebbc953b65 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:17.225987 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846ecde-a609-45dd-bf25-27ebbc953b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:17.236472 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 147/293] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Oct 26 10:50:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:17.244690 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bcb89a-0cda-4715-8e10-4d4cf002c070 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:17.260994 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-f846ecde-a609-45dd-bf25-27ebbc953b65 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:17.263555 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f846ecde-a609-45dd-bf25-27ebbc953b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:17.268033 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bcb89a-0cda-4715-8e10-4d4cf002c070 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:17.282247 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af88aa5-1ebe-41cc-92c2-6bd653e48230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:17.283266 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af88aa5-1ebe-41cc-92c2-6bd653e48230 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:17.283772 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af88aa5-1ebe-41cc-92c2-6bd653e48230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:17.284344 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af88aa5-1ebe-41cc-92c2-6bd653e48230 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:17.285206 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af88aa5-1ebe-41cc-92c2-6bd653e48230 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:17.285716 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af88aa5-1ebe-41cc-92c2-6bd653e48230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:17.289601 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af88aa5-1ebe-41cc-92c2-6bd653e48230 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:17.304766 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 148/294] 10.222.0.45 () {56 vars in 1120 bytes} [Wed Oct 26 10:50:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:17.315768 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af88aa5-1ebe-41cc-92c2-6bd653e48230 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:17.330240 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af88aa5-1ebe-41cc-92c2-6bd653e48230 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:17.341055 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a59f0-8a83-4988-a69c-610502bfe8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:17.342031 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a59f0-8a83-4988-a69c-610502bfe8aa admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:17.343509 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a59f0-8a83-4988-a69c-610502bfe8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:17.343987 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a59f0-8a83-4988-a69c-610502bfe8aa admin admin] PATH_INFO: `/v3/groups/37f4c01ee55d461d85f074886e5fdda5` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:17.352437 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:17.360581 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a59f0-8a83-4988-a69c-610502bfe8aa admin admin] RBAC: Authorizing `identity:get_group(group_id=37f4c01ee55d461d85f074886e5fdda5)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:17.363230 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a59f0-8a83-4988-a69c-610502bfe8aa admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:17.368368 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 149/295] 10.222.0.45 () {56 vars in 1201 bytes} [Wed Oct 26 10:50:17 2022] GET /identity/v3/groups/37f4c01ee55d461d85f074886e5fdda5 => generated 229 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:50:17.374370 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a59f0-8a83-4988-a69c-610502bfe8aa admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:17.392098 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a59f0-8a83-4988-a69c-610502bfe8aa admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:17.403232 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528dbf6-860c-4964-84e8-e8f7f7427fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:17.404993 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528dbf6-860c-4964-84e8-e8f7f7427fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:17.406485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528dbf6-860c-4964-84e8-e8f7f7427fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:17.406877 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528dbf6-860c-4964-84e8-e8f7f7427fb7 admin admin] PATH_INFO: `/v3/projects/f4a9b4bb2dba420f8a4e538ebab67142` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:17.409657 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1528dbf6-860c-4964-84e8-e8f7f7427fb7 admin admin] RBAC: Authorizing `identity:get_project(project_id=f4a9b4bb2dba420f8a4e538ebab67142)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:17.413564 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1528dbf6-860c-4964-84e8-e8f7f7427fb7 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:17.416533 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 150/296] 10.222.0.45 () {56 vars in 1207 bytes} [Wed Oct 26 10:50:17 2022] GET /identity/v3/projects/f4a9b4bb2dba420f8a4e538ebab67142 => generated 344 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:17.421507 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 147/297] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:50:17.423887 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528dbf6-860c-4964-84e8-e8f7f7427fb7 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:17.434871 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528dbf6-860c-4964-84e8-e8f7f7427fb7 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:17.448736 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827c9d6-d73c-40e0-82da-deaeb5941442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:17.449818 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827c9d6-d73c-40e0-82da-deaeb5941442 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:17.450313 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827c9d6-d73c-40e0-82da-deaeb5941442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:17.450778 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827c9d6-d73c-40e0-82da-deaeb5941442 admin admin] PATH_INFO: `/v3/projects/f4a9b4bb2dba420f8a4e538ebab67142/groups/37f4c01ee55d461d85f074886e5fdda5/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:17.452920 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827c9d6-d73c-40e0-82da-deaeb5941442 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4a9b4bb2dba420f8a4e538ebab67142, group_id=37f4c01ee55d461d85f074886e5fdda5, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:17.455773 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827c9d6-d73c-40e0-82da-deaeb5941442 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:17.748921 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846ecde-a609-45dd-bf25-27ebbc953b65 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:17.844026 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 151/298] 10.222.0.45 () {58 vars in 1463 bytes} [Wed Oct 26 10:50:17 2022] PUT /identity/v3/projects/f4a9b4bb2dba420f8a4e538ebab67142/groups/37f4c01ee55d461d85f074886e5fdda5/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:50:17.878854 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846ecde-a609-45dd-bf25-27ebbc953b65 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:17.912776 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebcfdb3-b323-4520-8082-7b61a484be23 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:17.913103 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebcfdb3-b323-4520-8082-7b61a484be23 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:17.913337 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebcfdb3-b323-4520-8082-7b61a484be23 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:17.915166 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 152/299] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:50:17.921592 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090afb69-8aae-4b53-a9f3-a85a3b77a31a None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:17.921906 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090afb69-8aae-4b53-a9f3-a85a3b77a31a None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:17.922149 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090afb69-8aae-4b53-a9f3-a85a3b77a31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:17.935903 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92072d1-4d12-400b-9772-2625ca12419b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:17.936599 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92072d1-4d12-400b-9772-2625ca12419b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:17.936882 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92072d1-4d12-400b-9772-2625ca12419b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:17.937156 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92072d1-4d12-400b-9772-2625ca12419b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:17.954899 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-090afb69-8aae-4b53-a9f3-a85a3b77a31a None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:17.956957 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-090afb69-8aae-4b53-a9f3-a85a3b77a31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:17.966270 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92072d1-4d12-400b-9772-2625ca12419b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:50:17.972071 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-a92072d1-4d12-400b-9772-2625ca12419b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:50:17.972071 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:17.972071 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:17.972071 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:17.972071 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:17.972071 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:17.972071 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:17.972071 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:17.972071 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:17.972071 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:17.972071 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:17.972071 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:17.972071 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:50:17.972071 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:50:17.972071 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:50:17.972071 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:50:17.973060 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:50:17.973060 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:50:17.973060 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:50:17.973060 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:50:17.973060 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:17.973060 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:17.973060 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:17.973060 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:17.973060 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:17.973060 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:17.973060 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:17.973060 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:17.973060 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:17.973060 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:17.973060 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:17.973060 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:17.973896 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:17.973896 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:17.973896 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:17.973896 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:17.973896 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:50:17.973896 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:50:17.973896 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:50:17.973896 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:50:17.973896 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:50:17.973896 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:50:17.973896 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:50:17.973896 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:17.973896 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 148/300] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 26 10:50:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:17.983235 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92072d1-4d12-400b-9772-2625ca12419b None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:18.025258 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:18.065826 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 153/301] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:50:18.112880 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92072d1-4d12-400b-9772-2625ca12419b None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:18.150312 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883be99-5ce8-448c-8b97-d560c274e9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:18.150926 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883be99-5ce8-448c-8b97-d560c274e9ea None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:18.151209 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883be99-5ce8-448c-8b97-d560c274e9ea None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:18.151481 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883be99-5ce8-448c-8b97-d560c274e9ea None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:18.152174 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883be99-5ce8-448c-8b97-d560c274e9ea None admin] RBAC: Adding query filter params (name=member) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:18.152481 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883be99-5ce8-448c-8b97-d560c274e9ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:18.153873 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883be99-5ce8-448c-8b97-d560c274e9ea None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:18.164773 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 149/302] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Oct 26 10:50:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:18.170459 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090afb69-8aae-4b53-a9f3-a85a3b77a31a None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:18.173957 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:18.301703 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090afb69-8aae-4b53-a9f3-a85a3b77a31a None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:18.351560 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95c69a-dcae-4400-b5d8-13d26fa77128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:18.352220 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95c69a-dcae-4400-b5d8-13d26fa77128 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:18.352507 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95c69a-dcae-4400-b5d8-13d26fa77128 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:18.352784 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95c69a-dcae-4400-b5d8-13d26fa77128 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:18.399409 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce4e1d-de91-4798-bbee-7821dc83e704 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:18.400048 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce4e1d-de91-4798-bbee-7821dc83e704 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:18.400780 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce4e1d-de91-4798-bbee-7821dc83e704 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:18.403447 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 150/303] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:50:18.409874 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e0efb-c7bb-4d07-9bc4-25040329c6ea None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:18.410164 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e0efb-c7bb-4d07-9bc4-25040329c6ea None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:18.410451 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e0efb-c7bb-4d07-9bc4-25040329c6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:18.438337 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-333e0efb-c7bb-4d07-9bc4-25040329c6ea None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:18.439884 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-333e0efb-c7bb-4d07-9bc4-25040329c6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:18.445456 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a95c69a-dcae-4400-b5d8-13d26fa77128 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:18.446932 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a95c69a-dcae-4400-b5d8-13d26fa77128 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:18.448897 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:18.524455 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 151/304] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:50:18.525734 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e0efb-c7bb-4d07-9bc4-25040329c6ea None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:18.570073 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:18.590053 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 154/305] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 26 10:50:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 26 10:50:18.595237 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95c69a-dcae-4400-b5d8-13d26fa77128 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:18.711465 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e0efb-c7bb-4d07-9bc4-25040329c6ea None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:18.747621 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a731ddd-1a69-4f51-8a7d-39e868acc118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:18.748282 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a731ddd-1a69-4f51-8a7d-39e868acc118 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:18.748565 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a731ddd-1a69-4f51-8a7d-39e868acc118 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:18.748837 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a731ddd-1a69-4f51-8a7d-39e868acc118 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:18.758396 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95c69a-dcae-4400-b5d8-13d26fa77128 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:18.763268 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a731ddd-1a69-4f51-8a7d-39e868acc118 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:50:18.764122 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-5a731ddd-1a69-4f51-8a7d-39e868acc118 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 26 10:50:18.764122 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:18.764122 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:18.764122 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:18.764122 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:18.764122 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:18.764122 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:18.764122 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:18.764122 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:18.764122 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:18.764122 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:18.764122 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:18.764122 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:50:18.764122 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:50:18.764122 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:50:18.764122 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:50:18.765024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:50:18.765024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:50:18.765024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:50:18.765024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:50:18.765024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:18.765024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:18.765024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:18.765024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:18.765024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:18.765024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:18.765024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:18.765024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:18.765024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:18.765024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:18.765024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:18.765024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:18.765815 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:18.765815 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:18.765815 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:18.765815 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:18.765815 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:50:18.765815 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:50:18.765815 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:50:18.765815 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:50:18.765815 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:50:18.765815 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:50:18.765815 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 26 10:50:18.765815 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:18.765815 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 152/306] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Oct 26 10:50:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:18.773302 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a731ddd-1a69-4f51-8a7d-39e868acc118 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:18.774850 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:18.817954 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a86a4-9d55-41ba-a810-6e1b7884a148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:18.818963 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a86a4-9d55-41ba-a810-6e1b7884a148 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:18.819498 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a86a4-9d55-41ba-a810-6e1b7884a148 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:18.820822 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a86a4-9d55-41ba-a810-6e1b7884a148 None admin] PATH_INFO: `/v3/projects/d161ac8d78bd458891d682168cd22b97` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:18.823202 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36a86a4-9d55-41ba-a810-6e1b7884a148 None admin] RBAC: Authorizing `identity:get_project(project_id=d161ac8d78bd458891d682168cd22b97)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:18.826088 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36a86a4-9d55-41ba-a810-6e1b7884a148 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:18.831761 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 155/307] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 26 10:50:18 2022] GET /identity/v3/projects/d161ac8d78bd458891d682168cd22b97 => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:50:18.837460 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a86a4-9d55-41ba-a810-6e1b7884a148 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:18.906533 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:18.942106 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a731ddd-1a69-4f51-8a7d-39e868acc118 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:18.984819 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9c63c-44a1-4ddb-9444-1f383c634f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:18.985444 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9c63c-44a1-4ddb-9444-1f383c634f44 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:18.985730 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9c63c-44a1-4ddb-9444-1f383c634f44 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:18.986013 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9c63c-44a1-4ddb-9444-1f383c634f44 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:18.986680 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c9c63c-44a1-4ddb-9444-1f383c634f44 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:18.986986 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c9c63c-44a1-4ddb-9444-1f383c634f44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:18.989039 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c9c63c-44a1-4ddb-9444-1f383c634f44 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:18.990921 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a86a4-9d55-41ba-a810-6e1b7884a148 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:19.001260 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 153/308] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 26 10:50:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:50:19.002238 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9c63c-44a1-4ddb-9444-1f383c634f44 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:19.041503 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f651db7-63ba-4c38-ba3a-39ac6d275ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:19.042751 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f651db7-63ba-4c38-ba3a-39ac6d275ca2 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:19.043515 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f651db7-63ba-4c38-ba3a-39ac6d275ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:19.044295 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f651db7-63ba-4c38-ba3a-39ac6d275ca2 None admin] PATH_INFO: `/v3/groups/0a9bf7c7247344c2b25bc7c2c22ce3a6` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:19.046128 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f651db7-63ba-4c38-ba3a-39ac6d275ca2 None admin] RBAC: Authorizing `identity:get_group(group_id=0a9bf7c7247344c2b25bc7c2c22ce3a6)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:19.048046 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f651db7-63ba-4c38-ba3a-39ac6d275ca2 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:19.051168 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 156/309] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Oct 26 10:50:18 2022] GET /identity/v3/groups/0a9bf7c7247344c2b25bc7c2c22ce3a6 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:50:19.052295 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f651db7-63ba-4c38-ba3a-39ac6d275ca2 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:19.111508 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:19.134468 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9c63c-44a1-4ddb-9444-1f383c634f44 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:19.176181 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5dbd20-d5a0-47bf-a9b5-5d258a9b168a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:19.176859 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5dbd20-d5a0-47bf-a9b5-5d258a9b168a None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:19.177156 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5dbd20-d5a0-47bf-a9b5-5d258a9b168a None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:19.177432 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5dbd20-d5a0-47bf-a9b5-5d258a9b168a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:19.193399 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5dbd20-d5a0-47bf-a9b5-5d258a9b168a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:50:19.194454 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f651db7-63ba-4c38-ba3a-39ac6d275ca2 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:19.199335 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-3c5dbd20-d5a0-47bf-a9b5-5d258a9b168a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:50:19.199335 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:19.199335 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:19.199335 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:19.199335 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:19.199335 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:19.199335 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:19.199335 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:19.199335 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:19.199335 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:19.199335 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:19.199335 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:19.199335 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:50:19.199335 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:50:19.199335 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:50:19.199335 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:50:19.200338 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:50:19.200338 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:50:19.200338 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:50:19.200338 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:50:19.200338 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:19.200338 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:19.200338 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:19.200338 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:19.200338 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:19.200338 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:19.200338 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:19.200338 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:19.200338 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:19.200338 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:19.200338 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:19.200338 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:19.201130 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:19.201130 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:19.201130 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:19.201130 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:19.201130 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:50:19.201130 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:50:19.201130 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:50:19.201130 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:50:19.201130 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:50:19.201130 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:50:19.201130 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:50:19.201130 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:19.201130 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 154/310] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 26 10:50:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:19.201791 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5dbd20-d5a0-47bf-a9b5-5d258a9b168a None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:19.213721 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:19.247764 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c0225-394b-4b57-8036-b36dc4d6f98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:19.248507 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c0225-394b-4b57-8036-b36dc4d6f98e None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:19.248789 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c0225-394b-4b57-8036-b36dc4d6f98e None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:19.249059 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c0225-394b-4b57-8036-b36dc4d6f98e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:19.334646 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5dbd20-d5a0-47bf-a9b5-5d258a9b168a None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:19.352146 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c0225-394b-4b57-8036-b36dc4d6f98e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:19.353938 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c0225-394b-4b57-8036-b36dc4d6f98e None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:19.371554 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e54d48-ec63-4d3d-bcfe-d14b6e2a42a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:19.372119 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e54d48-ec63-4d3d-bcfe-d14b6e2a42a3 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:19.372399 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e54d48-ec63-4d3d-bcfe-d14b6e2a42a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:19.372674 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e54d48-ec63-4d3d-bcfe-d14b6e2a42a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:19.373395 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e54d48-ec63-4d3d-bcfe-d14b6e2a42a3 None admin] RBAC: Adding query filter params (group.id=0a9bf7c7247344c2b25bc7c2c22ce3a6, role.id=5d5a8bcef7c8455c9bb6b49e113e74c7, scope.project.id=d161ac8d78bd458891d682168cd22b97) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:19.373707 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e54d48-ec63-4d3d-bcfe-d14b6e2a42a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:19.375246 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e54d48-ec63-4d3d-bcfe-d14b6e2a42a3 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:19.381617 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 155/311] 10.222.0.45 () {56 vars in 1376 bytes} [Wed Oct 26 10:50:19 2022] GET /identity/v3/role_assignments?group.id=0a9bf7c7247344c2b25bc7c2c22ce3a6&scope.project.id=d161ac8d78bd458891d682168cd22b97&role.id=5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 611 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:19.382701 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e54d48-ec63-4d3d-bcfe-d14b6e2a42a3 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:19.400369 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:19.482761 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:19.486560 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 157/312] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 26 10:50:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 26 10:50:19.489455 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6135a9-ff4b-4d6f-bd93-591968e24126 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:19.489749 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6135a9-ff4b-4d6f-bd93-591968e24126 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:19.490028 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6135a9-ff4b-4d6f-bd93-591968e24126 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:19.491369 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 158/313] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:50:19.492126 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6135a9-ff4b-4d6f-bd93-591968e24126 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:19.538314 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e54d48-ec63-4d3d-bcfe-d14b6e2a42a3 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:19.581778 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed50511-38ad-4b88-a141-ec05c88a2f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:19.582409 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed50511-38ad-4b88-a141-ec05c88a2f7f None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:19.582692 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed50511-38ad-4b88-a141-ec05c88a2f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:19.582971 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed50511-38ad-4b88-a141-ec05c88a2f7f None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:19.584392 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed50511-38ad-4b88-a141-ec05c88a2f7f None admin] RBAC: Adding query filter params (name=member) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:19.584570 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed50511-38ad-4b88-a141-ec05c88a2f7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:19.586048 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed50511-38ad-4b88-a141-ec05c88a2f7f None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:19.601643 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 156/314] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Oct 26 10:50:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:19.601643 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb8ef3-99be-4afe-a488-d10457911849 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:19.601643 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb8ef3-99be-4afe-a488-d10457911849 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:19.601643 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb8ef3-99be-4afe-a488-d10457911849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:19.623462 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-42fb8ef3-99be-4afe-a488-d10457911849 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:19.624656 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-42fb8ef3-99be-4afe-a488-d10457911849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:19.660036 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6135a9-ff4b-4d6f-bd93-591968e24126 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:19.698475 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6870c-3c2a-4162-b8e2-3aab01f44327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:19.699374 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6870c-3c2a-4162-b8e2-3aab01f44327 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:19.699799 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6870c-3c2a-4162-b8e2-3aab01f44327 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:19.700249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6870c-3c2a-4162-b8e2-3aab01f44327 None admin] PATH_INFO: `/v3/projects/d161ac8d78bd458891d682168cd22b97` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:19.701545 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6870c-3c2a-4162-b8e2-3aab01f44327 None admin] RBAC: Authorizing `identity:get_project(project_id=d161ac8d78bd458891d682168cd22b97)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:19.703135 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6870c-3c2a-4162-b8e2-3aab01f44327 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:19.705037 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 159/315] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 26 10:50:19 2022] GET /identity/v3/projects/d161ac8d78bd458891d682168cd22b97 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:50:19.705972 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6870c-3c2a-4162-b8e2-3aab01f44327 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:19.713871 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 157/316] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:50:19.714747 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb8ef3-99be-4afe-a488-d10457911849 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:19.723536 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:19.794395 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:19.842251 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6870c-3c2a-4162-b8e2-3aab01f44327 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:19.847741 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb8ef3-99be-4afe-a488-d10457911849 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:19.879578 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4c693-5d12-4b84-a37c-0d49ac655985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:19.880315 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4c693-5d12-4b84-a37c-0d49ac655985 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:19.880715 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4c693-5d12-4b84-a37c-0d49ac655985 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:19.881090 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4c693-5d12-4b84-a37c-0d49ac655985 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:19.889880 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42918c57-41bc-43ce-9f40-3c0aac1c70db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:19.890769 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42918c57-41bc-43ce-9f40-3c0aac1c70db None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:19.891204 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42918c57-41bc-43ce-9f40-3c0aac1c70db None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:19.891616 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42918c57-41bc-43ce-9f40-3c0aac1c70db None admin] PATH_INFO: `/v3/groups/0a9bf7c7247344c2b25bc7c2c22ce3a6` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:19.892911 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42918c57-41bc-43ce-9f40-3c0aac1c70db None admin] RBAC: Authorizing `identity:get_group(group_id=0a9bf7c7247344c2b25bc7c2c22ce3a6)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:19.894565 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42918c57-41bc-43ce-9f40-3c0aac1c70db None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:19.896347 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 158/317] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Oct 26 10:50:19 2022] GET /identity/v3/groups/0a9bf7c7247344c2b25bc7c2c22ce3a6 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:19.902245 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42918c57-41bc-43ce-9f40-3c0aac1c70db None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:19.965236 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a4c693-5d12-4b84-a37c-0d49ac655985 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:19.966984 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a4c693-5d12-4b84-a37c-0d49ac655985 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:19.976611 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:20.035845 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42918c57-41bc-43ce-9f40-3c0aac1c70db None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:20.073370 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:20.078189 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 160/318] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 26 10:50:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 26 10:50:20.080912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4c693-5d12-4b84-a37c-0d49ac655985 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:20.087433 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b752dbe-6e02-45b8-aa4a-d8d30629d29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:20.088086 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b752dbe-6e02-45b8-aa4a-d8d30629d29e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:20.089056 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b752dbe-6e02-45b8-aa4a-d8d30629d29e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:20.089056 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b752dbe-6e02-45b8-aa4a-d8d30629d29e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:20.089346 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b752dbe-6e02-45b8-aa4a-d8d30629d29e None admin] RBAC: Adding query filter params (group.id=0a9bf7c7247344c2b25bc7c2c22ce3a6, role.id=a29ce5d75abc411488ef339c191e6d05, scope.project.id=d161ac8d78bd458891d682168cd22b97) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:20.089653 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b752dbe-6e02-45b8-aa4a-d8d30629d29e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:20.091099 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b752dbe-6e02-45b8-aa4a-d8d30629d29e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:20.097741 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 159/319] 10.222.0.45 () {56 vars in 1376 bytes} [Wed Oct 26 10:50:19 2022] GET /identity/v3/role_assignments?group.id=0a9bf7c7247344c2b25bc7c2c22ce3a6&scope.project.id=d161ac8d78bd458891d682168cd22b97&role.id=a29ce5d75abc411488ef339c191e6d05 => generated 611 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:50:20.098602 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b752dbe-6e02-45b8-aa4a-d8d30629d29e None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:20.233260 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4c693-5d12-4b84-a37c-0d49ac655985 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:20.245455 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:20.280019 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c9541-0ec1-4f27-8b66-50ff68ef2654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:20.281998 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c9541-0ec1-4f27-8b66-50ff68ef2654 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:20.282287 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c9541-0ec1-4f27-8b66-50ff68ef2654 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:20.282555 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c9541-0ec1-4f27-8b66-50ff68ef2654 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:20.294915 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b752dbe-6e02-45b8-aa4a-d8d30629d29e None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:20.298706 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c9541-0ec1-4f27-8b66-50ff68ef2654 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:50:20.303501 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-2d7c9541-0ec1-4f27-8b66-50ff68ef2654 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 26 10:50:20.303501 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:20.303501 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:20.303501 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:20.303501 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:20.303501 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:20.303501 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:20.303501 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:20.303501 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:20.303501 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:20.303501 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:20.303501 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:20.303501 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:50:20.303501 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:50:20.303501 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:50:20.303501 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:50:20.304607 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:50:20.304607 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:50:20.304607 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:50:20.304607 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:50:20.304607 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:20.304607 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:20.304607 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:20.304607 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:20.304607 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:20.304607 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:20.304607 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:20.304607 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:20.304607 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:20.304607 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:20.304607 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:20.304607 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:20.305612 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:20.305612 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:20.305612 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:20.305612 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:20.305612 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:50:20.305612 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:50:20.305612 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:50:20.305612 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:50:20.305612 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:50:20.305612 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:50:20.305612 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 26 10:50:20.305612 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:20.305612 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 161/320] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Oct 26 10:50:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:20.313460 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c9541-0ec1-4f27-8b66-50ff68ef2654 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:20.352853 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041314b-2197-4a07-925c-4c105d807cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:20.353768 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041314b-2197-4a07-925c-4c105d807cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:20.354284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041314b-2197-4a07-925c-4c105d807cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:20.354753 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041314b-2197-4a07-925c-4c105d807cc0 None admin] PATH_INFO: `/v3/projects/9644a41001314f56b4cb83f7f5d1b772` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:20.356157 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041314b-2197-4a07-925c-4c105d807cc0 None admin] RBAC: Authorizing `identity:get_project(project_id=9644a41001314f56b4cb83f7f5d1b772)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:20.358877 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041314b-2197-4a07-925c-4c105d807cc0 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:20.360871 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 160/321] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 26 10:50:20 2022] GET /identity/v3/projects/9644a41001314f56b4cb83f7f5d1b772 => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:20.367076 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041314b-2197-4a07-925c-4c105d807cc0 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:20.446736 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:20.450816 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c9541-0ec1-4f27-8b66-50ff68ef2654 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:20.496571 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389d5bd-f51a-4c32-bd88-99b0e927be2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:20.497255 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389d5bd-f51a-4c32-bd88-99b0e927be2f None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:20.497444 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389d5bd-f51a-4c32-bd88-99b0e927be2f None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:20.497675 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389d5bd-f51a-4c32-bd88-99b0e927be2f None admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:20.499275 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389d5bd-f51a-4c32-bd88-99b0e927be2f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:20.499582 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389d5bd-f51a-4c32-bd88-99b0e927be2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:20.500968 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041314b-2197-4a07-925c-4c105d807cc0 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:20.501079 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389d5bd-f51a-4c32-bd88-99b0e927be2f None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:20.511705 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 162/322] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 26 10:50:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:50:20.518373 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389d5bd-f51a-4c32-bd88-99b0e927be2f None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:20.553224 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf2c3d-9695-433b-a9b9-0bebd6a34bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:20.553636 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:20.553862 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf2c3d-9695-433b-a9b9-0bebd6a34bcf None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:20.554148 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf2c3d-9695-433b-a9b9-0bebd6a34bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:20.554430 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf2c3d-9695-433b-a9b9-0bebd6a34bcf None admin] PATH_INFO: `/v3/groups/0a9bf7c7247344c2b25bc7c2c22ce3a6` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:20.555734 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf2c3d-9695-433b-a9b9-0bebd6a34bcf None admin] RBAC: Authorizing `identity:get_group(group_id=0a9bf7c7247344c2b25bc7c2c22ce3a6)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:20.557255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf2c3d-9695-433b-a9b9-0bebd6a34bcf None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:20.558846 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 161/323] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Oct 26 10:50:20 2022] GET /identity/v3/groups/0a9bf7c7247344c2b25bc7c2c22ce3a6 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:20.565125 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf2c3d-9695-433b-a9b9-0bebd6a34bcf None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:20.635348 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389d5bd-f51a-4c32-bd88-99b0e927be2f None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:20.679021 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a3075-6c4d-4b1e-825b-d204756d1727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:20.679637 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a3075-6c4d-4b1e-825b-d204756d1727 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:20.680950 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a3075-6c4d-4b1e-825b-d204756d1727 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:20.680950 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a3075-6c4d-4b1e-825b-d204756d1727 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:20.683326 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf2c3d-9695-433b-a9b9-0bebd6a34bcf None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:20.715554 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:20.723670 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e4797-58b5-4578-a546-70ad80935953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:20.724578 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e4797-58b5-4578-a546-70ad80935953 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:20.724856 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e4797-58b5-4578-a546-70ad80935953 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:20.725130 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e4797-58b5-4578-a546-70ad80935953 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:20.725859 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e4797-58b5-4578-a546-70ad80935953 None admin] RBAC: Adding query filter params (group.id=0a9bf7c7247344c2b25bc7c2c22ce3a6, role.id=5d5a8bcef7c8455c9bb6b49e113e74c7, scope.project.id=9644a41001314f56b4cb83f7f5d1b772) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:20.726829 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e4797-58b5-4578-a546-70ad80935953 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:20.728017 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e4797-58b5-4578-a546-70ad80935953 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:20.734417 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 162/324] 10.222.0.45 () {56 vars in 1376 bytes} [Wed Oct 26 10:50:20 2022] GET /identity/v3/role_assignments?group.id=0a9bf7c7247344c2b25bc7c2c22ce3a6&scope.project.id=9644a41001314f56b4cb83f7f5d1b772&role.id=5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:20.736705 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5e4ac-71c6-4c7a-aee5-30b2c66fde05 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:20.736978 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5e4ac-71c6-4c7a-aee5-30b2c66fde05 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:20.760877 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5e4ac-71c6-4c7a-aee5-30b2c66fde05 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:20.760877 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 163/325] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:50:20.760877 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7bb533-d9a5-4c00-bd8a-67b7c21abfcb None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:20.760877 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7bb533-d9a5-4c00-bd8a-67b7c21abfcb None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:20.760877 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7bb533-d9a5-4c00-bd8a-67b7c21abfcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:20.765538 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-7a7bb533-d9a5-4c00-bd8a-67b7c21abfcb None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:20.766754 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7a7bb533-d9a5-4c00-bd8a-67b7c21abfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:20.769530 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a3075-6c4d-4b1e-825b-d204756d1727 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:20.772216 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a3075-6c4d-4b1e-825b-d204756d1727 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:20.811755 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:20.861635 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 164/326] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:50:20.910548 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 163/327] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 26 10:50:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 26 10:50:20.918819 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7bb533-d9a5-4c00-bd8a-67b7c21abfcb None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:21.029185 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7bb533-d9a5-4c00-bd8a-67b7c21abfcb None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:21.053531 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:21.064079 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b8c58-31bb-4b92-801e-aefc3a145872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:21.075876 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b8c58-31bb-4b92-801e-aefc3a145872 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:21.075876 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b8c58-31bb-4b92-801e-aefc3a145872 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:21.075876 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b8c58-31bb-4b92-801e-aefc3a145872 None admin] PATH_INFO: `/v3/projects/9644a41001314f56b4cb83f7f5d1b772` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:21.075876 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2b8c58-31bb-4b92-801e-aefc3a145872 None admin] RBAC: Authorizing `identity:get_project(project_id=9644a41001314f56b4cb83f7f5d1b772)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:21.075876 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2b8c58-31bb-4b92-801e-aefc3a145872 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:21.075876 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 165/328] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 26 10:50:20 2022] GET /identity/v3/projects/9644a41001314f56b4cb83f7f5d1b772 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:21.076404 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a3075-6c4d-4b1e-825b-d204756d1727 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:21.144815 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b8c58-31bb-4b92-801e-aefc3a145872 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:21.196476 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a3075-6c4d-4b1e-825b-d204756d1727 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:21.226994 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:21.243386 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b77883-21ee-4e82-9178-99c21f636a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:21.243386 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b77883-21ee-4e82-9178-99c21f636a41 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:21.243386 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b77883-21ee-4e82-9178-99c21f636a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:21.243386 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b77883-21ee-4e82-9178-99c21f636a41 None admin] PATH_INFO: `/v3/groups/0a9bf7c7247344c2b25bc7c2c22ce3a6` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:21.243795 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b77883-21ee-4e82-9178-99c21f636a41 None admin] RBAC: Authorizing `identity:get_group(group_id=0a9bf7c7247344c2b25bc7c2c22ce3a6)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:21.243795 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b77883-21ee-4e82-9178-99c21f636a41 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:21.246751 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 164/329] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Oct 26 10:50:21 2022] GET /identity/v3/groups/0a9bf7c7247344c2b25bc7c2c22ce3a6 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:21.251933 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b77883-21ee-4e82-9178-99c21f636a41 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:21.278785 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b8c58-31bb-4b92-801e-aefc3a145872 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:21.314678 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfc30a-1cfe-4f7e-842d-4343ab32c201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:21.316256 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfc30a-1cfe-4f7e-842d-4343ab32c201 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:21.316719 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfc30a-1cfe-4f7e-842d-4343ab32c201 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:21.317200 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfc30a-1cfe-4f7e-842d-4343ab32c201 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:21.332607 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dfc30a-1cfe-4f7e-842d-4343ab32c201 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:50:21.338752 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-c9dfc30a-1cfe-4f7e-842d-4343ab32c201 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:50:21.338752 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:21.338752 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:21.338752 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:21.338752 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:21.338752 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:21.338752 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:21.338752 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:21.338752 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:21.338752 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:21.338752 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:21.338752 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:21.338752 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:50:21.338752 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:50:21.338752 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:50:21.338752 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:50:21.339685 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:50:21.339685 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:50:21.339685 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:50:21.339685 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:50:21.339685 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:21.339685 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:21.339685 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:21.339685 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:21.339685 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:21.339685 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:21.339685 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:21.339685 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:21.339685 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:21.339685 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:21.339685 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:21.339685 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:21.340559 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:21.340559 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:21.340559 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:21.340559 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:21.340559 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:50:21.340559 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:50:21.340559 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:50:21.340559 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:50:21.340559 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:50:21.340559 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:50:21.340559 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:50:21.340559 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:21.344194 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 166/330] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 26 10:50:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:21.348000 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfc30a-1cfe-4f7e-842d-4343ab32c201 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:21.383316 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b77883-21ee-4e82-9178-99c21f636a41 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:21.408103 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:21.427666 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d74d2c-a0a2-4b78-9d83-0ee1de3f4255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:21.428349 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d74d2c-a0a2-4b78-9d83-0ee1de3f4255 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:21.428630 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d74d2c-a0a2-4b78-9d83-0ee1de3f4255 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:21.428906 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d74d2c-a0a2-4b78-9d83-0ee1de3f4255 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:21.429636 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d74d2c-a0a2-4b78-9d83-0ee1de3f4255 None admin] RBAC: Adding query filter params (group.id=0a9bf7c7247344c2b25bc7c2c22ce3a6, role.id=a29ce5d75abc411488ef339c191e6d05, scope.project.id=9644a41001314f56b4cb83f7f5d1b772) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:21.430056 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d74d2c-a0a2-4b78-9d83-0ee1de3f4255 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:21.431487 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d74d2c-a0a2-4b78-9d83-0ee1de3f4255 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:21.437733 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 165/331] 10.222.0.45 () {56 vars in 1376 bytes} [Wed Oct 26 10:50:21 2022] GET /identity/v3/role_assignments?group.id=0a9bf7c7247344c2b25bc7c2c22ce3a6&scope.project.id=9644a41001314f56b4cb83f7f5d1b772&role.id=a29ce5d75abc411488ef339c191e6d05 => generated 611 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:50:21.465187 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfc30a-1cfe-4f7e-842d-4343ab32c201 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:21.501948 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba1fda-1625-4ae3-94d7-6627d45188dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:21.502591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba1fda-1625-4ae3-94d7-6627d45188dd None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:21.502874 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba1fda-1625-4ae3-94d7-6627d45188dd None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:21.503687 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba1fda-1625-4ae3-94d7-6627d45188dd None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:21.504466 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba1fda-1625-4ae3-94d7-6627d45188dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:21.504776 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba1fda-1625-4ae3-94d7-6627d45188dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:21.506183 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba1fda-1625-4ae3-94d7-6627d45188dd None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:21.515406 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 167/332] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 26 10:50:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:21.521979 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d74d2c-a0a2-4b78-9d83-0ee1de3f4255 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:21.584619 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:21.627784 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d74d2c-a0a2-4b78-9d83-0ee1de3f4255 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:21.662813 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d63ff-2ac1-4500-bba4-8fea4345aab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:21.663431 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d63ff-2ac1-4500-bba4-8fea4345aab8 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:21.663711 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d63ff-2ac1-4500-bba4-8fea4345aab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:21.663983 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d63ff-2ac1-4500-bba4-8fea4345aab8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:21.733471 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d63ff-2ac1-4500-bba4-8fea4345aab8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:21.734922 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d63ff-2ac1-4500-bba4-8fea4345aab8 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:21.792143 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:21.833181 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 166/333] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 26 10:50:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 26 10:50:21.839062 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba1fda-1625-4ae3-94d7-6627d45188dd None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:21.936001 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba1fda-1625-4ae3-94d7-6627d45188dd None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:21.949534 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:21.968911 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c0e75-76dd-464f-9c33-ba4c0ff77f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:21.969527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c0e75-76dd-464f-9c33-ba4c0ff77f62 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:21.969813 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c0e75-76dd-464f-9c33-ba4c0ff77f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:21.970091 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c0e75-76dd-464f-9c33-ba4c0ff77f62 None admin] PATH_INFO: `/v3/projects/f4a9b4bb2dba420f8a4e538ebab67142` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:21.971199 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c0e75-76dd-464f-9c33-ba4c0ff77f62 None admin] RBAC: Authorizing `identity:get_project(project_id=f4a9b4bb2dba420f8a4e538ebab67142)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:21.972707 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c0e75-76dd-464f-9c33-ba4c0ff77f62 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:21.974302 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 168/334] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 26 10:50:21 2022] GET /identity/v3/projects/f4a9b4bb2dba420f8a4e538ebab67142 => generated 344 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:21.979835 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d63ff-2ac1-4500-bba4-8fea4345aab8 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:22.076021 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d63ff-2ac1-4500-bba4-8fea4345aab8 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:22.108713 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f6f5c-a620-4f93-bc69-853d4831aa72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:22.109277 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f6f5c-a620-4f93-bc69-853d4831aa72 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:22.109557 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f6f5c-a620-4f93-bc69-853d4831aa72 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:22.109833 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f6f5c-a620-4f93-bc69-853d4831aa72 None admin] PATH_INFO: `/v3/groups/37f4c01ee55d461d85f074886e5fdda5` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:22.110919 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f6f5c-a620-4f93-bc69-853d4831aa72 None admin] RBAC: Authorizing `identity:get_group(group_id=37f4c01ee55d461d85f074886e5fdda5)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:22.112385 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f6f5c-a620-4f93-bc69-853d4831aa72 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:22.113935 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 167/335] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Oct 26 10:50:21 2022] GET /identity/v3/groups/37f4c01ee55d461d85f074886e5fdda5 => generated 229 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:22.119568 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c0e75-76dd-464f-9c33-ba4c0ff77f62 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:22.216158 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c0e75-76dd-464f-9c33-ba4c0ff77f62 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:22.247661 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c63e9e-79fc-4d30-b45f-388d09c9583e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:22.248296 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c63e9e-79fc-4d30-b45f-388d09c9583e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:22.248583 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c63e9e-79fc-4d30-b45f-388d09c9583e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:22.248861 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c63e9e-79fc-4d30-b45f-388d09c9583e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:22.249585 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c63e9e-79fc-4d30-b45f-388d09c9583e None admin] RBAC: Adding query filter params (group.id=37f4c01ee55d461d85f074886e5fdda5, role.id=d6876897d7c548b7900d4e01cb45a007, scope.project.id=f4a9b4bb2dba420f8a4e538ebab67142) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:22.249895 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c63e9e-79fc-4d30-b45f-388d09c9583e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:22.251323 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c63e9e-79fc-4d30-b45f-388d09c9583e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:22.257413 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 169/336] 10.222.0.45 () {56 vars in 1376 bytes} [Wed Oct 26 10:50:22 2022] GET /identity/v3/role_assignments?group.id=37f4c01ee55d461d85f074886e5fdda5&scope.project.id=f4a9b4bb2dba420f8a4e538ebab67142&role.id=d6876897d7c548b7900d4e01cb45a007 => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:24.813790 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ffb1c-6ec3-4068-a54d-d09f9ce527c5 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:24.814309 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ffb1c-6ec3-4068-a54d-d09f9ce527c5 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:24.814309 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ffb1c-6ec3-4068-a54d-d09f9ce527c5 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:24.816140 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 168/337] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:50:24.821792 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf206a3-314a-4105-bf05-b9e91cea41f6 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:24.822231 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf206a3-314a-4105-bf05-b9e91cea41f6 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:24.822420 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf206a3-314a-4105-bf05-b9e91cea41f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:24.853048 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-7cf206a3-314a-4105-bf05-b9e91cea41f6 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:24.854258 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7cf206a3-314a-4105-bf05-b9e91cea41f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:24.911419 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:24.940538 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 170/338] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:50:25.080479 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0ad15-3631-4d78-9c1d-422b1722f477 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:25.081089 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0ad15-3631-4d78-9c1d-422b1722f477 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:25.081658 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0ad15-3631-4d78-9c1d-422b1722f477 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:25.083236 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 169/339] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:50:25.088860 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8180d-0967-43e2-a401-3639800f868d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:25.089476 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8180d-0967-43e2-a401-3639800f868d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:25.089953 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8180d-0967-43e2-a401-3639800f868d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:25.116649 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-27a8180d-0967-43e2-a401-3639800f868d None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:25.118235 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-27a8180d-0967-43e2-a401-3639800f868d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:25.195412 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 171/340] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:50:25.273323 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8df68-1065-41f1-91cf-dca58624a69a None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:25.273973 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8df68-1065-41f1-91cf-dca58624a69a None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:25.274448 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8df68-1065-41f1-91cf-dca58624a69a None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:25.276119 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 170/341] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:50:25.290433 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee485b60-19dc-415d-a6bc-34a55273838d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:25.291025 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee485b60-19dc-415d-a6bc-34a55273838d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:25.291550 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee485b60-19dc-415d-a6bc-34a55273838d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:25.316757 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-ee485b60-19dc-415d-a6bc-34a55273838d None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:25.318250 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ee485b60-19dc-415d-a6bc-34a55273838d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:25.348987 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d8df68-1065-41f1-91cf-dca58624a69a None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:25.399141 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:25.407010 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 172/342] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:50:25.480519 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d8df68-1065-41f1-91cf-dca58624a69a None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:25.526719 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa633d60-1c3c-4940-8679-c78c1b6579fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:25.527366 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa633d60-1c3c-4940-8679-c78c1b6579fa None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:25.527650 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa633d60-1c3c-4940-8679-c78c1b6579fa None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:25.527930 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa633d60-1c3c-4940-8679-c78c1b6579fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:25.542797 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa633d60-1c3c-4940-8679-c78c1b6579fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:25.544365 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa633d60-1c3c-4940-8679-c78c1b6579fa None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:25.564136 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-fa633d60-1c3c-4940-8679-c78c1b6579fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:25.564136 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:25.564136 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:25.564136 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:25.564136 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:25.564136 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:25.564136 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:25.564136 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:25.564136 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:25.564136 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:25.564136 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:25.564136 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:25.564136 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:50:25.564136 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:50:25.564136 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:50:25.564136 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:50:25.565134 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:25.565134 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:25.565134 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:25.565134 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:25.565134 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:25.565134 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:25.565134 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:25.565134 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:25.565134 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:25.565134 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:25.565134 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:25.565134 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:25.565134 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:25.565134 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:25.565134 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:25.565134 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:25.565134 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:50:25.566052 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:50:25.566052 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:25.566052 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:25.566052 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 171/343] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:50:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:25.572855 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee485b60-19dc-415d-a6bc-34a55273838d None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:25.613463 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:25.670296 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa633d60-1c3c-4940-8679-c78c1b6579fa None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:25.688490 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee485b60-19dc-415d-a6bc-34a55273838d None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:25.744728 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdcac3-5006-45d7-a750-c6e6f2c68ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:25.745356 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdcac3-5006-45d7-a750-c6e6f2c68ec8 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:25.745646 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdcac3-5006-45d7-a750-c6e6f2c68ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:25.745922 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdcac3-5006-45d7-a750-c6e6f2c68ec8 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:25.746635 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bdcac3-5006-45d7-a750-c6e6f2c68ec8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:25.746942 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bdcac3-5006-45d7-a750-c6e6f2c68ec8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:25.749614 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bdcac3-5006-45d7-a750-c6e6f2c68ec8 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:25.766961 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 173/344] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:25.767888 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdcac3-5006-45d7-a750-c6e6f2c68ec8 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:25.801017 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:25.820266 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa633d60-1c3c-4940-8679-c78c1b6579fa None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:25.856773 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75147e-f0f2-42af-9dd4-7d85fb523952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:25.857414 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75147e-f0f2-42af-9dd4-7d85fb523952 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:25.857701 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75147e-f0f2-42af-9dd4-7d85fb523952 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:25.857978 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75147e-f0f2-42af-9dd4-7d85fb523952 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:25.868820 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75147e-f0f2-42af-9dd4-7d85fb523952 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:25.868949 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:25.870216 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75147e-f0f2-42af-9dd4-7d85fb523952 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:25.875118 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdcac3-5006-45d7-a750-c6e6f2c68ec8 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:25.885081 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-4c75147e-f0f2-42af-9dd4-7d85fb523952 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:25.885081 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:25.885081 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:25.885081 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:25.885081 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:25.885081 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:25.885081 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:25.885081 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:25.885081 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:25.885081 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:25.885081 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:25.885081 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:25.885081 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:50:25.885081 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:50:25.885081 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:50:25.885081 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:50:25.888317 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:25.888317 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:25.888317 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:25.888317 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:25.888317 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:25.888317 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:25.888317 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:25.888317 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:25.888317 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:25.888317 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:25.888317 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:25.888317 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:25.888317 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:25.888317 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:25.888317 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:25.888317 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:25.888317 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:50:25.889197 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:50:25.889197 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:25.889197 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:25.889197 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 172/345] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:50:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:50:25.889197 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75147e-f0f2-42af-9dd4-7d85fb523952 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:25.916324 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d281f103-8f2a-4f02-b9f2-e91de5b595c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:25.917289 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281f103-8f2a-4f02-b9f2-e91de5b595c2 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:25.917576 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281f103-8f2a-4f02-b9f2-e91de5b595c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:25.917998 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281f103-8f2a-4f02-b9f2-e91de5b595c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:25.929362 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d281f103-8f2a-4f02-b9f2-e91de5b595c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:25.930815 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d281f103-8f2a-4f02-b9f2-e91de5b595c2 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:25.946976 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-d281f103-8f2a-4f02-b9f2-e91de5b595c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:25.946976 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:25.946976 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:25.946976 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:25.946976 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:25.946976 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:25.946976 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:25.946976 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:25.946976 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:25.946976 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:25.946976 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:25.946976 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:25.946976 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:50:25.946976 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:50:25.946976 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:50:25.946976 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:50:25.947888 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:25.947888 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:25.947888 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:25.947888 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:25.947888 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:25.947888 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:25.947888 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:25.947888 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:25.947888 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:25.947888 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:25.947888 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:25.947888 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:25.947888 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:25.947888 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:25.947888 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:25.947888 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:25.947888 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:50:25.948802 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:50:25.948802 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:25.948802 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:25.948802 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 174/346] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:50:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:25.949307 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99df0d-f38a-4be8-806a-30c2d19a5e98 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:25.949772 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99df0d-f38a-4be8-806a-30c2d19a5e98 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:25.950196 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99df0d-f38a-4be8-806a-30c2d19a5e98 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:25.955758 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 175/347] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:50:25.955758 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99df0d-f38a-4be8-806a-30c2d19a5e98 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:26.000254 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75147e-f0f2-42af-9dd4-7d85fb523952 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:26.028985 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:26.034369 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541a552-7e24-4fb9-8be7-bfdfca919991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:26.035513 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541a552-7e24-4fb9-8be7-bfdfca919991 None admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:26.035798 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541a552-7e24-4fb9-8be7-bfdfca919991 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:26.036142 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541a552-7e24-4fb9-8be7-bfdfca919991 None admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:26.036794 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4541a552-7e24-4fb9-8be7-bfdfca919991 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:26.038234 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4541a552-7e24-4fb9-8be7-bfdfca919991 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:26.064229 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99df0d-f38a-4be8-806a-30c2d19a5e98 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:26.099416 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98ba79-2957-40c8-9dc9-95cfecf64710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:26.100314 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98ba79-2957-40c8-9dc9-95cfecf64710 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:26.100604 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98ba79-2957-40c8-9dc9-95cfecf64710 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:26.100885 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98ba79-2957-40c8-9dc9-95cfecf64710 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:26.101531 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e98ba79-2957-40c8-9dc9-95cfecf64710 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:26.101835 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e98ba79-2957-40c8-9dc9-95cfecf64710 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:26.103208 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e98ba79-2957-40c8-9dc9-95cfecf64710 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:26.116337 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 173/348] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Oct 26 10:50:25 2022] POST /identity/v3/users => generated 246 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:50:26.116337 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541a552-7e24-4fb9-8be7-bfdfca919991 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:26.116603 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 176/349] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:26.116952 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11afb2-48f7-478f-86a2-61bc6b4561fb None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:26.117423 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11afb2-48f7-478f-86a2-61bc6b4561fb None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:26.117724 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11afb2-48f7-478f-86a2-61bc6b4561fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:26.137997 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-ea11afb2-48f7-478f-86a2-61bc6b4561fb None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:26.139215 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ea11afb2-48f7-478f-86a2-61bc6b4561fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:26.142440 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:26.232619 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 177/350] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:50:26.233820 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11afb2-48f7-478f-86a2-61bc6b4561fb None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:26.250864 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541a552-7e24-4fb9-8be7-bfdfca919991 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:26.290918 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a293179-44df-497e-a060-b53f5ea92f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:26.291595 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a293179-44df-497e-a060-b53f5ea92f77 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:26.291885 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a293179-44df-497e-a060-b53f5ea92f77 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:26.292301 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a293179-44df-497e-a060-b53f5ea92f77 None admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:26.293018 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a293179-44df-497e-a060-b53f5ea92f77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:26.293326 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a293179-44df-497e-a060-b53f5ea92f77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:26.294827 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a293179-44df-497e-a060-b53f5ea92f77 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:26.315742 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 174/351] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:26.321761 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a293179-44df-497e-a060-b53f5ea92f77 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:26.377426 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11afb2-48f7-478f-86a2-61bc6b4561fb None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:26.419296 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:26.422676 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a5ebc-272d-40ca-a552-df71f1023d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:26.423319 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a5ebc-272d-40ca-a552-df71f1023d19 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:26.423601 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a5ebc-272d-40ca-a552-df71f1023d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:26.423877 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a5ebc-272d-40ca-a552-df71f1023d19 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:26.426094 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a5ebc-272d-40ca-a552-df71f1023d19 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:26.427870 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a5ebc-272d-40ca-a552-df71f1023d19 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:26.439903 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:26.485086 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a293179-44df-497e-a060-b53f5ea92f77 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:26.521662 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 178/352] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Oct 26 10:50:26 2022] POST /identity/v3/users => generated 248 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:50:26.526310 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26cd49-e22c-4e1e-9570-0ac60c3edae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:26.527206 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26cd49-e22c-4e1e-9570-0ac60c3edae3 None admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:26.527706 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26cd49-e22c-4e1e-9570-0ac60c3edae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:26.528274 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26cd49-e22c-4e1e-9570-0ac60c3edae3 None admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:26.529144 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26cd49-e22c-4e1e-9570-0ac60c3edae3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:26.532209 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b042b-51fe-4b05-b0f8-ad8f851ff352 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:26.532767 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b042b-51fe-4b05-b0f8-ad8f851ff352 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:26.533223 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b042b-51fe-4b05-b0f8-ad8f851ff352 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:26.535636 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 179/353] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:50:26.536364 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26cd49-e22c-4e1e-9570-0ac60c3edae3 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:26.541748 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced6396-7ff2-4ad9-b658-a95f72f959c5 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:26.542370 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced6396-7ff2-4ad9-b658-a95f72f959c5 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:26.542848 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced6396-7ff2-4ad9-b658-a95f72f959c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:26.571518 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-fced6396-7ff2-4ad9-b658-a95f72f959c5 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:26.573137 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-fced6396-7ff2-4ad9-b658-a95f72f959c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:26.646922 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 180/354] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:50:26.648177 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced6396-7ff2-4ad9-b658-a95f72f959c5 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:26.668139 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 175/355] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Oct 26 10:50:26 2022] POST /identity/v3/users => generated 248 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:50:26.789609 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced6396-7ff2-4ad9-b658-a95f72f959c5 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:26.824883 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:26.829953 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce991f6f-dfc9-414b-8ec2-8879ca317d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:26.830616 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce991f6f-dfc9-414b-8ec2-8879ca317d70 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:26.830895 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce991f6f-dfc9-414b-8ec2-8879ca317d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:26.831168 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce991f6f-dfc9-414b-8ec2-8879ca317d70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:26.842976 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce991f6f-dfc9-414b-8ec2-8879ca317d70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:26.844534 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce991f6f-dfc9-414b-8ec2-8879ca317d70 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:26.861315 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-ce991f6f-dfc9-414b-8ec2-8879ca317d70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:26.861315 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:26.861315 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:26.861315 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:26.861315 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:26.861315 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:26.861315 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:26.861315 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:26.861315 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:26.861315 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:26.861315 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:26.861315 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:26.861315 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:50:26.861315 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:50:26.861315 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:50:26.861315 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:50:26.862284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:26.862284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:26.862284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:26.862284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:26.862284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:26.862284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:26.862284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:26.862284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:26.862284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:26.862284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:26.862284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:26.862284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:26.862284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:26.862284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:26.862284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:26.862284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:26.862284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:50:26.863840 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:50:26.863840 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:26.863840 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:26.866538 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 181/356] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:50:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:26.872486 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26cd49-e22c-4e1e-9570-0ac60c3edae3 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:26.953092 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce991f6f-dfc9-414b-8ec2-8879ca317d70 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:27.020450 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26cd49-e22c-4e1e-9570-0ac60c3edae3 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:27.024087 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:27.061380 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e0aeb-e3ae-41cf-9310-a391d3df0303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:27.062762 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e0aeb-e3ae-41cf-9310-a391d3df0303 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:27.063188 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e0aeb-e3ae-41cf-9310-a391d3df0303 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:27.063598 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e0aeb-e3ae-41cf-9310-a391d3df0303 None admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:27.064437 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e0aeb-e3ae-41cf-9310-a391d3df0303 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:27.064877 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e0aeb-e3ae-41cf-9310-a391d3df0303 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:27.066580 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e0aeb-e3ae-41cf-9310-a391d3df0303 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:27.080561 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 176/357] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:27.087315 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e0aeb-e3ae-41cf-9310-a391d3df0303 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:27.178724 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce991f6f-dfc9-414b-8ec2-8879ca317d70 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:27.240708 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e0aeb-e3ae-41cf-9310-a391d3df0303 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:27.267895 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69260149-7d52-4823-876e-18a539dc9fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:27.268567 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69260149-7d52-4823-876e-18a539dc9fc3 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:27.268856 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69260149-7d52-4823-876e-18a539dc9fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:27.269209 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69260149-7d52-4823-876e-18a539dc9fc3 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:27.269901 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69260149-7d52-4823-876e-18a539dc9fc3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:27.271333 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69260149-7d52-4823-876e-18a539dc9fc3 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:27.294589 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea67678-c010-4cd2-8668-13843a2b4cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:27.295210 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea67678-c010-4cd2-8668-13843a2b4cf4 None admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:27.295681 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea67678-c010-4cd2-8668-13843a2b4cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:27.295969 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea67678-c010-4cd2-8668-13843a2b4cf4 None admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:27.296746 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea67678-c010-4cd2-8668-13843a2b4cf4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:27.298267 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea67678-c010-4cd2-8668-13843a2b4cf4 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:27.315468 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.sql.core [None req-69260149-7d52-4823-876e-18a539dc9fc3 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 26 10:50:27.315468 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 26 10:50:27.315468 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [parameters: {'id': '1c0b0b9a4056477ba35681b6098a3cfc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 26 10:50:27.315468 dv-cinder-862679-1-smb devstack@keystone.service[81623]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81623) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 26 10:50:27.323699 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-69260149-7d52-4823-876e-18a539dc9fc3 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 26 10:50:27.323699 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:27.323699 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 26 10:50:27.323699 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 26 10:50:27.323699 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 26 10:50:27.323699 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 26 10:50:27.323699 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 26 10:50:27.323699 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application result = self._query(query) Oct 26 10:50:27.323699 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 26 10:50:27.323699 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application conn.query(q) Oct 26 10:50:27.323699 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 26 10:50:27.323699 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 26 10:50:27.323699 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 26 10:50:27.323699 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application result.read() Oct 26 10:50:27.323699 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 26 10:50:27.329309 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 26 10:50:27.329309 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 26 10:50:27.329309 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 26 10:50:27.329309 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 26 10:50:27.329309 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 26 10:50:27.329309 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 26 10:50:27.329309 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 26 10:50:27.329309 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 26 10:50:27.329309 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:27.329309 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 26 10:50:27.329309 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:27.329309 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:27.329309 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 26 10:50:27.329309 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 26 10:50:27.329309 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 26 10:50:27.329309 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return ref.to_dict() Oct 26 10:50:27.329309 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 26 10:50:27.329309 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application next(self.gen) Oct 26 10:50:27.330787 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 26 10:50:27.330787 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application yield resource Oct 26 10:50:27.330787 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 26 10:50:27.330787 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application next(self.gen) Oct 26 10:50:27.330787 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 26 10:50:27.330787 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.session.rollback() Oct 26 10:50:27.330787 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 10:50:27.330787 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.force_reraise() Oct 26 10:50:27.330787 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 10:50:27.330787 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise self.value Oct 26 10:50:27.330787 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 26 10:50:27.330787 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 26 10:50:27.330787 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 26 10:50:27.330787 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application session.commit() Oct 26 10:50:27.330787 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 26 10:50:27.330787 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 26 10:50:27.330787 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 26 10:50:27.331759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._prepare_impl() Oct 26 10:50:27.331759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 26 10:50:27.331759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.session.flush() Oct 26 10:50:27.331759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 26 10:50:27.331759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._flush(objects) Oct 26 10:50:27.331759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 26 10:50:27.331759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 26 10:50:27.331759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 26 10:50:27.331759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application compat.raise_( Oct 26 10:50:27.331759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 26 10:50:27.331759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception Oct 26 10:50:27.331759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 26 10:50:27.331759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application flush_context.execute() Oct 26 10:50:27.331759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 26 10:50:27.331759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rec.execute(self) Oct 26 10:50:27.331759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 26 10:50:27.331759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 26 10:50:27.332732 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 26 10:50:27.332732 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 26 10:50:27.332732 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 26 10:50:27.332732 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 26 10:50:27.332732 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 26 10:50:27.332732 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 26 10:50:27.332732 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 26 10:50:27.332732 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 26 10:50:27.332732 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 26 10:50:27.332732 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 26 10:50:27.332732 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 26 10:50:27.332732 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 26 10:50:27.332732 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 26 10:50:27.332732 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 26 10:50:27.332732 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 26 10:50:27.332732 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception Oct 26 10:50:27.333527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 26 10:50:27.333527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 26 10:50:27.333527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 26 10:50:27.333527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 26 10:50:27.333527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 26 10:50:27.333527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application result = self._query(query) Oct 26 10:50:27.333527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 26 10:50:27.333527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application conn.query(q) Oct 26 10:50:27.333527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 26 10:50:27.333527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 26 10:50:27.333527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 26 10:50:27.333527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application result.read() Oct 26 10:50:27.333527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 26 10:50:27.333527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 26 10:50:27.333527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 26 10:50:27.333527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 26 10:50:27.337284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 26 10:50:27.337284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 26 10:50:27.337284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 26 10:50:27.337284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 26 10:50:27.337284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 26 10:50:27.337284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 26 10:50:27.337284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [parameters: {'id': '1c0b0b9a4056477ba35681b6098a3cfc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 26 10:50:27.337284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 26 10:50:27.337284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:27.337284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:50:27.337284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:27.337284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:27.337284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:27.337284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:27.337284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:27.337284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:27.339209 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:27.339209 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:27.339209 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:27.339209 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:27.339209 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:27.339209 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:27.339209 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 26 10:50:27.339209 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 26 10:50:27.339209 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:27.339209 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:27.339209 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 26 10:50:27.339209 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 26 10:50:27.339209 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 26 10:50:27.339209 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 26 10:50:27.339209 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 26 10:50:27.339209 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:27.349195 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 182/358] 10.222.0.45 () {60 vars in 1131 bytes} [Wed Oct 26 10:50:26 2022] POST /identity/v3/roles => generated 144 bytes in 372 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:27.349195 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69260149-7d52-4823-876e-18a539dc9fc3 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:27.384145 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:27.398814 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 177/359] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Oct 26 10:50:27 2022] POST /identity/v3/users => generated 249 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 10:50:27.472918 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69260149-7d52-4823-876e-18a539dc9fc3 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:27.531679 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1197d4-d12a-4c39-b230-96cb8bf9a568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:27.532694 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1197d4-d12a-4c39-b230-96cb8bf9a568 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:27.533158 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1197d4-d12a-4c39-b230-96cb8bf9a568 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:27.533581 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1197d4-d12a-4c39-b230-96cb8bf9a568 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:27.550946 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1197d4-d12a-4c39-b230-96cb8bf9a568 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:50:27.557061 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-0c1197d4-d12a-4c39-b230-96cb8bf9a568 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 26 10:50:27.557061 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:27.557061 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:27.557061 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:27.557061 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:27.557061 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:27.557061 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:27.557061 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:27.557061 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:27.557061 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:27.557061 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:27.557061 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:27.557061 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:50:27.557061 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:50:27.557061 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:50:27.557061 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:50:27.558217 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:50:27.558217 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:50:27.558217 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:50:27.558217 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:50:27.558217 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:27.558217 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:27.558217 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:27.558217 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:27.558217 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:27.558217 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:27.558217 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:27.558217 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:27.558217 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:27.558217 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:27.558217 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:27.558217 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:27.559259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:27.559259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:27.559259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:27.559259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:27.559259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:50:27.559259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:50:27.559259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:50:27.559259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:50:27.559259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:50:27.559259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:50:27.559259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 26 10:50:27.559259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:27.561632 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 183/360] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Oct 26 10:50:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:50:27.567975 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea67678-c010-4cd2-8668-13843a2b4cf4 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:27.596444 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:27.685128 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea67678-c010-4cd2-8668-13843a2b4cf4 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:27.720924 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33787280-4564-45d1-98e5-42002891c18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:27.721567 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33787280-4564-45d1-98e5-42002891c18b None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:27.721847 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33787280-4564-45d1-98e5-42002891c18b None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:27.722150 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33787280-4564-45d1-98e5-42002891c18b None admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:27.722848 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33787280-4564-45d1-98e5-42002891c18b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:27.723161 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33787280-4564-45d1-98e5-42002891c18b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:27.724626 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33787280-4564-45d1-98e5-42002891c18b None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:27.734173 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 178/361] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 26 10:50:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:28.844295 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d91c2b-7123-4e31-a09b-00747cbad18c None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:28.845184 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d91c2b-7123-4e31-a09b-00747cbad18c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:28.845620 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d91c2b-7123-4e31-a09b-00747cbad18c None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:28.847150 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 184/362] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:50:28.853202 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e6cf7-cf3f-4970-a35e-e470398031de None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:28.853990 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e6cf7-cf3f-4970-a35e-e470398031de None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:28.854415 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e6cf7-cf3f-4970-a35e-e470398031de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:28.881138 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-d27e6cf7-cf3f-4970-a35e-e470398031de None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:28.882587 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-d27e6cf7-cf3f-4970-a35e-e470398031de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:28.971973 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 179/363] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:50:29.174092 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c5b04-936d-4a10-bb4f-462d338a77c3 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:29.174601 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c5b04-936d-4a10-bb4f-462d338a77c3 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:29.175039 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c5b04-936d-4a10-bb4f-462d338a77c3 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:29.177190 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 185/364] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:50:29.193716 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5263c13-e830-43d0-b81e-38557b7b9fef None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:29.194260 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5263c13-e830-43d0-b81e-38557b7b9fef None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:29.194710 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5263c13-e830-43d0-b81e-38557b7b9fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:29.221096 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-e5263c13-e830-43d0-b81e-38557b7b9fef None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:29.222377 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-e5263c13-e830-43d0-b81e-38557b7b9fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:29.234496 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:29.283769 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77fcca-53f3-433f-a9bd-32ec4e389be2 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:29.284144 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77fcca-53f3-433f-a9bd-32ec4e389be2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:29.284364 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77fcca-53f3-433f-a9bd-32ec4e389be2 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:29.285750 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 186/365] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:50:29.291154 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7863d3-2730-4cad-9854-fad092133aec None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:29.291438 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7863d3-2730-4cad-9854-fad092133aec None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:29.291712 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7863d3-2730-4cad-9854-fad092133aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:29.318126 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 180/366] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:50:29.333132 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-fe7863d3-2730-4cad-9854-fad092133aec None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:29.334349 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-fe7863d3-2730-4cad-9854-fad092133aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:29.419910 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5263c13-e830-43d0-b81e-38557b7b9fef None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:29.437345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 187/367] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:50:29.523453 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5263c13-e830-43d0-b81e-38557b7b9fef None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:29.558223 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b2cc14-6d68-4dc7-9715-b90abe7d477e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:29.558863 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2cc14-6d68-4dc7-9715-b90abe7d477e None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:29.559143 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2cc14-6d68-4dc7-9715-b90abe7d477e None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:29.559413 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2cc14-6d68-4dc7-9715-b90abe7d477e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:29.570040 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b2cc14-6d68-4dc7-9715-b90abe7d477e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:50:29.574805 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-16b2cc14-6d68-4dc7-9715-b90abe7d477e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:50:29.574805 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:29.574805 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:29.574805 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:29.574805 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:29.574805 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:29.574805 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:29.574805 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:29.574805 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:29.574805 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:29.574805 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:29.574805 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:29.574805 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:50:29.574805 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:50:29.574805 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:50:29.574805 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:50:29.575723 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:50:29.575723 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:50:29.575723 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:50:29.575723 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:50:29.575723 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:29.575723 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:29.575723 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:29.575723 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:29.575723 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:29.575723 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:29.575723 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:29.575723 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:29.575723 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:29.575723 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:29.575723 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:29.575723 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:29.576546 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:29.576546 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:29.576546 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:29.576546 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:29.576546 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:50:29.576546 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:50:29.576546 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:50:29.576546 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:50:29.576546 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:50:29.576546 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:50:29.576546 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:50:29.576546 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:29.580179 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 181/368] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Oct 26 10:50:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:50:29.582164 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7863d3-2730-4cad-9854-fad092133aec None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:29.614192 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:29.646193 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b2cc14-6d68-4dc7-9715-b90abe7d477e None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:29.660714 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:29.714589 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7863d3-2730-4cad-9854-fad092133aec None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:29.769951 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b2cc14-6d68-4dc7-9715-b90abe7d477e None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:29.782590 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448cda05-9708-483f-83f5-f494c1e43a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:29.783520 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cda05-9708-483f-83f5-f494c1e43a5e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:29.783983 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cda05-9708-483f-83f5-f494c1e43a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:29.784422 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cda05-9708-483f-83f5-f494c1e43a5e None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:29.785790 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448cda05-9708-483f-83f5-f494c1e43a5e None admin] RBAC: Adding query filter params (name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:29.786314 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448cda05-9708-483f-83f5-f494c1e43a5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:29.787946 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448cda05-9708-483f-83f5-f494c1e43a5e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:29.806575 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 188/369] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Oct 26 10:50:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:29.809232 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706cbb8-2204-4e2f-bbee-579e985d795f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:29.810056 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706cbb8-2204-4e2f-bbee-579e985d795f None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:29.810339 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706cbb8-2204-4e2f-bbee-579e985d795f None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:29.810669 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706cbb8-2204-4e2f-bbee-579e985d795f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:29.816322 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448cda05-9708-483f-83f5-f494c1e43a5e None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:29.822358 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706cbb8-2204-4e2f-bbee-579e985d795f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:50:29.832179 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-2706cbb8-2204-4e2f-bbee-579e985d795f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:50:29.832179 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:29.832179 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:29.832179 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:29.832179 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:29.832179 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:29.832179 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:29.832179 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:29.832179 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:29.832179 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:29.832179 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:29.832179 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:29.832179 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:50:29.832179 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:50:29.832179 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:50:29.832179 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:50:29.833233 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:50:29.833233 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:50:29.833233 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:50:29.833233 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:50:29.833233 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:29.833233 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:29.833233 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:29.833233 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:29.833233 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:29.833233 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:29.833233 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:29.833233 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:29.833233 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:29.833233 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:29.833233 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:29.833233 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:29.834232 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:29.834232 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:29.834232 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:29.834232 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:29.834232 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:50:29.834232 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:50:29.834232 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:50:29.834232 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:50:29.834232 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:50:29.834232 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:50:29.834232 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:50:29.834232 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:29.834232 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 182/370] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Oct 26 10:50:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:50:29.836650 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706cbb8-2204-4e2f-bbee-579e985d795f None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:29.916413 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:29.977431 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706cbb8-2204-4e2f-bbee-579e985d795f None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:29.978844 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:29.991134 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448cda05-9708-483f-83f5-f494c1e43a5e None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:30.015636 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af78a6a-9e1b-4854-b9c5-282f4fec6d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:30.016766 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af78a6a-9e1b-4854-b9c5-282f4fec6d3a None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:30.017192 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af78a6a-9e1b-4854-b9c5-282f4fec6d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:30.017769 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af78a6a-9e1b-4854-b9c5-282f4fec6d3a None admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:30.019045 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af78a6a-9e1b-4854-b9c5-282f4fec6d3a None admin] RBAC: Adding query filter params (name=service) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:30.020127 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af78a6a-9e1b-4854-b9c5-282f4fec6d3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:30.021655 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af78a6a-9e1b-4854-b9c5-282f4fec6d3a None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:30.031723 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c9728-912f-463c-8713-cdbc8ef856fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:30.032223 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 183/371] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Oct 26 10:50:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:30.032808 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c9728-912f-463c-8713-cdbc8ef856fb None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:30.033168 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c9728-912f-463c-8713-cdbc8ef856fb None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:30.033487 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af78a6a-9e1b-4854-b9c5-282f4fec6d3a None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:30.033598 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c9728-912f-463c-8713-cdbc8ef856fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:30.045156 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c9728-912f-463c-8713-cdbc8ef856fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:30.046821 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c9728-912f-463c-8713-cdbc8ef856fb None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:30.063589 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-e86c9728-912f-463c-8713-cdbc8ef856fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:30.063589 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:30.063589 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:30.063589 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:30.063589 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:30.063589 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:30.063589 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:30.063589 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:30.063589 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:30.063589 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:30.063589 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:30.063589 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:30.063589 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:50:30.063589 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:50:30.063589 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:50:30.063589 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:50:30.064770 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:30.064770 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:30.064770 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:30.064770 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:30.064770 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:30.064770 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:30.064770 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:30.064770 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:30.064770 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:30.064770 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:30.064770 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:30.064770 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:30.064770 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:30.064770 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:30.064770 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:30.064770 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:30.064770 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:50:30.065878 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:50:30.065878 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:30.065878 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:30.071432 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 189/372] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:50:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:50:30.071432 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c9728-912f-463c-8713-cdbc8ef856fb None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:30.162821 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af78a6a-9e1b-4854-b9c5-282f4fec6d3a None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:30.191828 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:30.195617 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c9728-912f-463c-8713-cdbc8ef856fb None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:30.203286 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e9b57-4e9c-424c-a365-d5c0661430e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:30.204043 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e9b57-4e9c-424c-a365-d5c0661430e5 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:30.206909 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e9b57-4e9c-424c-a365-d5c0661430e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:30.206909 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e9b57-4e9c-424c-a365-d5c0661430e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:30.216019 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e9b57-4e9c-424c-a365-d5c0661430e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:50:30.221156 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-b72e9b57-4e9c-424c-a365-d5c0661430e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:50:30.221156 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:30.221156 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:30.221156 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:30.221156 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:30.221156 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:30.221156 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:30.221156 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:30.221156 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:30.221156 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:30.221156 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:30.221156 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:30.221156 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:50:30.221156 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:50:30.221156 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:50:30.221156 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:50:30.222833 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:50:30.222833 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:50:30.222833 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:50:30.222833 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:50:30.222833 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:30.222833 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:30.222833 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:30.222833 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:30.222833 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:30.222833 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:30.222833 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:30.222833 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:30.222833 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:30.222833 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:30.222833 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:30.222833 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:30.223739 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:30.223739 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:30.223739 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:30.223739 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:30.223739 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:50:30.223739 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:50:30.223739 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:50:30.223739 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:50:30.223739 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:50:30.223739 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:50:30.223739 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:50:30.223739 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:30.224385 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 184/373] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Oct 26 10:50:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:30.225464 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e9b57-4e9c-424c-a365-d5c0661430e5 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:30.243283 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ae3d6-17a5-434f-ac10-59c4e40f779f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:30.244611 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ae3d6-17a5-434f-ac10-59c4e40f779f None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:30.245330 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ae3d6-17a5-434f-ac10-59c4e40f779f None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:30.245938 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ae3d6-17a5-434f-ac10-59c4e40f779f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:30.258817 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ae3d6-17a5-434f-ac10-59c4e40f779f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:30.260603 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ae3d6-17a5-434f-ac10-59c4e40f779f None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:30.264252 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:30.277177 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-7a0ae3d6-17a5-434f-ac10-59c4e40f779f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:30.277177 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:30.277177 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:30.277177 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:30.277177 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:30.277177 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:30.277177 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:30.277177 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:30.277177 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:30.277177 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:30.277177 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:30.277177 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:30.277177 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:50:30.277177 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:50:30.277177 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:50:30.277177 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:50:30.282116 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:30.282116 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:30.282116 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:30.282116 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:30.282116 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:30.282116 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:30.282116 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:30.282116 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:30.282116 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:30.282116 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:30.282116 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:30.282116 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:30.282116 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:30.282116 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:30.282116 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:30.282116 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:30.282116 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:50:30.283005 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:50:30.283005 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:30.283005 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:30.283005 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 190/374] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:50:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:30.283005 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ae3d6-17a5-434f-ac10-59c4e40f779f None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:30.342310 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e9b57-4e9c-424c-a365-d5c0661430e5 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:30.378070 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37346cd6-654a-4646-a045-0f601fe31808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:30.378717 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37346cd6-654a-4646-a045-0f601fe31808 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:30.379000 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37346cd6-654a-4646-a045-0f601fe31808 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:30.379275 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37346cd6-654a-4646-a045-0f601fe31808 None admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:30.379916 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37346cd6-654a-4646-a045-0f601fe31808 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:30.380251 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37346cd6-654a-4646-a045-0f601fe31808 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:30.381634 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37346cd6-654a-4646-a045-0f601fe31808 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:30.392229 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ae3d6-17a5-434f-ac10-59c4e40f779f None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:30.394471 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 185/375] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:30.395542 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1b0c3-93b5-4381-9c26-eefc6da42908 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:30.395751 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1b0c3-93b5-4381-9c26-eefc6da42908 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:30.396033 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1b0c3-93b5-4381-9c26-eefc6da42908 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:30.397259 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 186/376] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:50:30.397953 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1b0c3-93b5-4381-9c26-eefc6da42908 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:30.433647 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d41d2b-645d-40a9-8204-8fa4cf3065d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:30.434273 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d41d2b-645d-40a9-8204-8fa4cf3065d2 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:30.434556 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d41d2b-645d-40a9-8204-8fa4cf3065d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:30.434832 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d41d2b-645d-40a9-8204-8fa4cf3065d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:30.435502 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d41d2b-645d-40a9-8204-8fa4cf3065d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:30.435805 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d41d2b-645d-40a9-8204-8fa4cf3065d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:30.437281 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d41d2b-645d-40a9-8204-8fa4cf3065d2 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:30.447885 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 191/377] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Oct 26 10:50:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:30.447885 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d41d2b-645d-40a9-8204-8fa4cf3065d2 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:30.458015 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:30.516103 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1b0c3-93b5-4381-9c26-eefc6da42908 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:30.520714 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:30.552131 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3abdde-0a5c-40c9-886a-ce322ea6f683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:30.552748 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3abdde-0a5c-40c9-886a-ce322ea6f683 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:30.553028 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3abdde-0a5c-40c9-886a-ce322ea6f683 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:30.553309 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3abdde-0a5c-40c9-886a-ce322ea6f683 None admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:30.553950 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3abdde-0a5c-40c9-886a-ce322ea6f683 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:30.554260 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3abdde-0a5c-40c9-886a-ce322ea6f683 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:30.555630 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3abdde-0a5c-40c9-886a-ce322ea6f683 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:30.566633 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d41d2b-645d-40a9-8204-8fa4cf3065d2 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:30.567272 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 187/378] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:30.568482 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd73e9-bdde-4473-8733-6d83aa5b3e7a None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:30.568767 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd73e9-bdde-4473-8733-6d83aa5b3e7a None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:30.569664 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd73e9-bdde-4473-8733-6d83aa5b3e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:30.586805 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-14dd73e9-bdde-4473-8733-6d83aa5b3e7a None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:30.589754 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-14dd73e9-bdde-4473-8733-6d83aa5b3e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:30.602185 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9210af-321c-41c3-8700-332d1d646e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:30.602829 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9210af-321c-41c3-8700-332d1d646e62 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:30.603113 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9210af-321c-41c3-8700-332d1d646e62 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:30.603394 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9210af-321c-41c3-8700-332d1d646e62 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:30.610803 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9210af-321c-41c3-8700-332d1d646e62 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:30.612279 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9210af-321c-41c3-8700-332d1d646e62 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:30.624994 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-7c9210af-321c-41c3-8700-332d1d646e62 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 26 10:50:30.624994 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:30.624994 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:30.624994 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:30.624994 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:30.624994 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:30.624994 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:30.624994 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:30.624994 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:30.624994 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:30.624994 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:30.624994 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:30.624994 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:50:30.624994 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:50:30.624994 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:50:30.624994 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:50:30.625959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:30.625959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:30.625959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:50:30.625959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:50:30.625959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:50:30.625959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:50:30.625959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:30.625959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:30.625959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:30.625959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:30.625959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:30.625959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:30.625959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:30.625959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:30.625959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:30.625959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:30.625959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:30.625959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:30.626856 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:30.626856 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:30.626856 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:50:30.626856 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:50:30.626856 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:50:30.626856 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:50:30.626856 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:50:30.626856 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:50:30.626856 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 26 10:50:30.626856 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:30.626856 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 192/379] 10.222.0.45 () {56 vars in 1093 bytes} [Wed Oct 26 10:50:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:30.626856 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9210af-321c-41c3-8700-332d1d646e62 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:30.654906 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 188/380] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:50:30.656332 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b82f4-a87a-4f38-b751-29c181eb1277 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:30.656626 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b82f4-a87a-4f38-b751-29c181eb1277 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:30.656905 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b82f4-a87a-4f38-b751-29c181eb1277 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:30.658154 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 189/381] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:50:30.658857 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b82f4-a87a-4f38-b751-29c181eb1277 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:30.694858 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:30.748514 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9210af-321c-41c3-8700-332d1d646e62 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:30.767159 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b82f4-a87a-4f38-b751-29c181eb1277 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:30.767967 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:30.787346 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33a801-7499-4660-b3bd-9b61e2226098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:30.788506 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33a801-7499-4660-b3bd-9b61e2226098 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:30.788881 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33a801-7499-4660-b3bd-9b61e2226098 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:30.789231 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33a801-7499-4660-b3bd-9b61e2226098 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:30.801272 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b33a801-7499-4660-b3bd-9b61e2226098 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:30.802821 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b33a801-7499-4660-b3bd-9b61e2226098 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:30.804613 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d0db1-117a-495c-9037-8ab2a591d138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:30.805335 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d0db1-117a-495c-9037-8ab2a591d138 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:30.805914 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d0db1-117a-495c-9037-8ab2a591d138 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:30.806187 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d0db1-117a-495c-9037-8ab2a591d138 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:30.814531 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d0db1-117a-495c-9037-8ab2a591d138 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:30.815948 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d0db1-117a-495c-9037-8ab2a591d138 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:30.818244 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-3b33a801-7499-4660-b3bd-9b61e2226098 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:30.818244 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:30.818244 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:30.818244 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:30.818244 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:30.818244 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:30.818244 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:30.818244 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:30.818244 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:30.818244 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:30.818244 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:30.818244 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:30.818244 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:50:30.818244 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:50:30.818244 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:50:30.818244 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:50:30.819269 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:30.819269 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:30.819269 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:30.819269 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:30.819269 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:30.819269 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:30.819269 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:30.819269 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:30.819269 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:30.819269 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:30.819269 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:30.819269 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:30.819269 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:30.819269 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:30.819269 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:30.819269 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:30.819269 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:50:30.820373 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:50:30.820373 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:30.820373 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:30.821082 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 193/382] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:50:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:30.821861 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33a801-7499-4660-b3bd-9b61e2226098 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:30.838784 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-505d0db1-117a-495c-9037-8ab2a591d138 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 26 10:50:30.838784 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:30.838784 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:30.838784 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:30.838784 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:30.838784 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:30.838784 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:30.838784 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:30.838784 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:30.838784 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:30.838784 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:30.838784 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:30.838784 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:50:30.838784 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:50:30.838784 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:50:30.838784 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:50:30.839719 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:30.839719 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:30.839719 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:50:30.839719 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:50:30.839719 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:50:30.839719 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:50:30.839719 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:30.839719 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:30.839719 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:30.839719 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:30.839719 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:30.839719 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:30.839719 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:30.839719 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:30.839719 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:30.839719 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:30.839719 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:30.839719 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:30.845707 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:30.845707 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:30.845707 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:50:30.845707 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:50:30.845707 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:50:30.845707 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:50:30.845707 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:50:30.845707 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:50:30.845707 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 26 10:50:30.845707 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:30.845707 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 190/383] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 26 10:50:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:30.845707 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befffbfb-d41a-411b-b66b-13f456d654a7 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:30.845707 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befffbfb-d41a-411b-b66b-13f456d654a7 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:30.846944 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befffbfb-d41a-411b-b66b-13f456d654a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:30.866099 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-befffbfb-d41a-411b-b66b-13f456d654a7 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:30.867583 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-befffbfb-d41a-411b-b66b-13f456d654a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:30.925180 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33a801-7499-4660-b3bd-9b61e2226098 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:30.938507 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 191/384] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:50:30.939731 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befffbfb-d41a-411b-b66b-13f456d654a7 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:30.961763 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af2ad2-47fc-4e0b-840b-dd3b383df72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:30.962464 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af2ad2-47fc-4e0b-840b-dd3b383df72e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:30.962801 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af2ad2-47fc-4e0b-840b-dd3b383df72e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:30.963086 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af2ad2-47fc-4e0b-840b-dd3b383df72e None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:30.963820 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af2ad2-47fc-4e0b-840b-dd3b383df72e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:30.964159 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af2ad2-47fc-4e0b-840b-dd3b383df72e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:30.965834 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af2ad2-47fc-4e0b-840b-dd3b383df72e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:30.966227 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:31.015333 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 194/385] 10.222.0.45 () {56 vars in 1133 bytes} [Wed Oct 26 10:50:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:31.016106 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af2ad2-47fc-4e0b-840b-dd3b383df72e None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:31.043282 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befffbfb-d41a-411b-b66b-13f456d654a7 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:31.048851 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:31.082538 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa422b-1496-4ae5-a9c2-9ea4ef64163c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:31.083160 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa422b-1496-4ae5-a9c2-9ea4ef64163c None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:31.083765 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa422b-1496-4ae5-a9c2-9ea4ef64163c None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:31.084049 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa422b-1496-4ae5-a9c2-9ea4ef64163c None admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:31.084742 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa422b-1496-4ae5-a9c2-9ea4ef64163c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:31.085033 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa422b-1496-4ae5-a9c2-9ea4ef64163c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:31.086419 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa422b-1496-4ae5-a9c2-9ea4ef64163c None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:31.103073 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 192/386] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:31.103938 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa422b-1496-4ae5-a9c2-9ea4ef64163c None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:31.132005 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af2ad2-47fc-4e0b-840b-dd3b383df72e None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:31.169546 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f4399-af22-48f8-bae0-c65ab669dd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:31.170154 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f4399-af22-48f8-bae0-c65ab669dd93 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:31.170485 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f4399-af22-48f8-bae0-c65ab669dd93 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:31.170767 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f4399-af22-48f8-bae0-c65ab669dd93 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:31.171498 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f4399-af22-48f8-bae0-c65ab669dd93 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:31.171804 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f4399-af22-48f8-bae0-c65ab669dd93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:31.173280 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f4399-af22-48f8-bae0-c65ab669dd93 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:31.191003 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:31.192400 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 195/387] 10.222.0.45 () {56 vars in 1137 bytes} [Wed Oct 26 10:50:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:31.193141 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f4399-af22-48f8-bae0-c65ab669dd93 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:31.211194 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa422b-1496-4ae5-a9c2-9ea4ef64163c None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:31.245408 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce181f5-7115-4457-aca9-55b54970ea28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:31.246046 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce181f5-7115-4457-aca9-55b54970ea28 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:31.246328 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce181f5-7115-4457-aca9-55b54970ea28 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:31.246604 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce181f5-7115-4457-aca9-55b54970ea28 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:31.256652 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce181f5-7115-4457-aca9-55b54970ea28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:50:31.261580 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-3ce181f5-7115-4457-aca9-55b54970ea28 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:50:31.261580 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:31.261580 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:31.261580 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:31.261580 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:31.261580 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:31.261580 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:31.261580 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:31.261580 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:31.261580 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:31.261580 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:31.261580 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:31.261580 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:50:31.261580 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:50:31.261580 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:50:31.261580 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:50:31.262496 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:50:31.262496 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:50:31.262496 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:50:31.262496 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:50:31.262496 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:31.262496 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:31.262496 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:31.262496 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:31.262496 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:31.262496 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:31.262496 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:31.262496 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:31.262496 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:31.262496 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:31.262496 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:31.262496 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:31.264000 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:31.264000 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:31.264000 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:31.264000 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:31.264000 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:50:31.264000 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:50:31.264000 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:50:31.264000 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:50:31.264000 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:50:31.264000 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:50:31.264000 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:50:31.264000 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:31.264000 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 193/388] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Oct 26 10:50:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:31.264000 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce181f5-7115-4457-aca9-55b54970ea28 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:31.281280 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:31.296689 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f4399-af22-48f8-bae0-c65ab669dd93 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:31.330928 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5951f1-48c4-4908-b1a8-1d81f717ec9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:31.331555 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5951f1-48c4-4908-b1a8-1d81f717ec9d None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:31.332390 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5951f1-48c4-4908-b1a8-1d81f717ec9d None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:31.332667 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5951f1-48c4-4908-b1a8-1d81f717ec9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:31.342749 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5951f1-48c4-4908-b1a8-1d81f717ec9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:31.344232 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5951f1-48c4-4908-b1a8-1d81f717ec9d None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:31.362863 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-3f5951f1-48c4-4908-b1a8-1d81f717ec9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:31.362863 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:31.362863 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:31.362863 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:31.362863 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:31.362863 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:31.362863 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:31.362863 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:31.362863 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:31.362863 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:31.362863 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:31.362863 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:31.362863 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:50:31.362863 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:50:31.362863 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:50:31.362863 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:50:31.364428 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:31.364428 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:31.364428 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:31.364428 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:31.364428 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:31.364428 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:31.364428 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:31.364428 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:31.364428 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:31.364428 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:31.364428 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:31.364428 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:31.364428 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:31.364428 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:31.364428 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:31.364428 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:31.364428 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:50:31.365297 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:50:31.365297 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:31.365297 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:31.365297 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 196/389] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:50:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:31.366210 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce181f5-7115-4457-aca9-55b54970ea28 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:31.368889 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5951f1-48c4-4908-b1a8-1d81f717ec9d None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:31.400218 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654284ee-0d57-4f3b-967e-ea7e53725f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:31.400846 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654284ee-0d57-4f3b-967e-ea7e53725f45 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:31.401129 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654284ee-0d57-4f3b-967e-ea7e53725f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:31.401402 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654284ee-0d57-4f3b-967e-ea7e53725f45 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:31.408224 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654284ee-0d57-4f3b-967e-ea7e53725f45 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:31.409665 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654284ee-0d57-4f3b-967e-ea7e53725f45 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:31.421171 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-654284ee-0d57-4f3b-967e-ea7e53725f45 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 26 10:50:31.421171 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:31.421171 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:31.421171 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:31.421171 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:31.421171 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:31.421171 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:31.421171 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:31.421171 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:31.421171 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:31.421171 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:31.421171 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:31.421171 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:50:31.421171 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:50:31.421171 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:50:31.421171 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:50:31.422055 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:31.422055 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:31.422055 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:50:31.422055 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:50:31.422055 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:50:31.422055 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:50:31.422055 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:31.422055 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:31.422055 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:31.422055 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:31.422055 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:31.422055 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:31.422055 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:31.422055 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:31.422055 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:31.422055 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:31.422055 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:31.422055 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:31.423022 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:31.423022 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:31.423022 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:50:31.423022 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:50:31.423022 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:50:31.423022 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:50:31.423022 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:50:31.423022 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:50:31.423022 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 26 10:50:31.423022 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:31.423022 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 194/390] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 26 10:50:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:31.423587 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654284ee-0d57-4f3b-967e-ea7e53725f45 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:31.427128 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:31.473712 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5951f1-48c4-4908-b1a8-1d81f717ec9d None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:31.507639 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ffd6e8-9bf1-4716-b362-04b3d5afc588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:31.508300 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffd6e8-9bf1-4716-b362-04b3d5afc588 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:31.508585 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffd6e8-9bf1-4716-b362-04b3d5afc588 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:31.508864 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffd6e8-9bf1-4716-b362-04b3d5afc588 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:31.515694 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:31.519433 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ffd6e8-9bf1-4716-b362-04b3d5afc588 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:31.520928 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ffd6e8-9bf1-4716-b362-04b3d5afc588 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:31.522362 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654284ee-0d57-4f3b-967e-ea7e53725f45 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:31.535200 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-98ffd6e8-9bf1-4716-b362-04b3d5afc588 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:31.535200 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:31.535200 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:31.535200 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:31.535200 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:31.535200 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:31.535200 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:31.535200 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:31.535200 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:31.535200 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:31.535200 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:31.535200 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:31.535200 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:50:31.535200 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:50:31.535200 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:50:31.535200 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:50:31.536138 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:31.536138 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:31.536138 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:31.536138 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:31.536138 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:31.536138 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:31.536138 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:31.536138 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:31.536138 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:31.536138 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:31.536138 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:31.536138 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:31.536138 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:31.536138 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:31.536138 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:31.536138 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:31.536138 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:50:31.537016 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:50:31.537016 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:31.537016 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:31.537016 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 197/391] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:50:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:31.537237 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ffd6e8-9bf1-4716-b362-04b3d5afc588 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:31.558307 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076c123-e423-48a8-b3ff-d23c20f4ed7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:31.558870 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076c123-e423-48a8-b3ff-d23c20f4ed7b None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:31.559152 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076c123-e423-48a8-b3ff-d23c20f4ed7b None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:31.559428 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076c123-e423-48a8-b3ff-d23c20f4ed7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:31.569768 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076c123-e423-48a8-b3ff-d23c20f4ed7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:31.571217 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076c123-e423-48a8-b3ff-d23c20f4ed7b None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:31.585648 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-8076c123-e423-48a8-b3ff-d23c20f4ed7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:31.585648 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:31.585648 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:31.585648 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:31.585648 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:31.585648 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:31.585648 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:31.585648 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:31.585648 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:31.585648 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:31.585648 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:31.585648 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:31.585648 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:50:31.585648 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:50:31.585648 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:50:31.585648 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:50:31.586560 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:31.586560 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:31.586560 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:31.586560 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:31.586560 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:31.586560 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:31.586560 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:31.586560 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:31.586560 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:31.586560 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:31.586560 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:31.586560 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:31.586560 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:31.586560 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:31.586560 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:31.586560 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:31.586560 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:50:31.587458 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:50:31.587458 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:31.587458 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:31.587458 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 195/392] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:50:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:31.587688 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076c123-e423-48a8-b3ff-d23c20f4ed7b None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:31.639449 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ffd6e8-9bf1-4716-b362-04b3d5afc588 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:31.642044 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:31.676875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a472b-b6ae-4efb-b479-bd8d77c97fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:31.677574 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a472b-b6ae-4efb-b479-bd8d77c97fad None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:31.677852 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a472b-b6ae-4efb-b479-bd8d77c97fad None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:31.678126 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a472b-b6ae-4efb-b479-bd8d77c97fad None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:31.678779 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a472b-b6ae-4efb-b479-bd8d77c97fad None admin] RBAC: Adding query filter params (name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:31.679081 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a472b-b6ae-4efb-b479-bd8d77c97fad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:31.680492 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a472b-b6ae-4efb-b479-bd8d77c97fad None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:31.688327 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076c123-e423-48a8-b3ff-d23c20f4ed7b None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:31.693380 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 198/393] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Oct 26 10:50:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:31.693380 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a472b-b6ae-4efb-b479-bd8d77c97fad None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:31.722216 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f319680-7bfa-4a89-a8df-7a737b6768b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:31.722864 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f319680-7bfa-4a89-a8df-7a737b6768b6 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:31.723148 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f319680-7bfa-4a89-a8df-7a737b6768b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:31.723425 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f319680-7bfa-4a89-a8df-7a737b6768b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:31.724085 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f319680-7bfa-4a89-a8df-7a737b6768b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:31.724398 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f319680-7bfa-4a89-a8df-7a737b6768b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:31.725775 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f319680-7bfa-4a89-a8df-7a737b6768b6 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:31.737127 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 196/394] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:50:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:31.737909 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f319680-7bfa-4a89-a8df-7a737b6768b6 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:31.742114 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:31.789279 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a472b-b6ae-4efb-b479-bd8d77c97fad None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:31.822719 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d8df7-80e6-474f-aa0f-e92192a150f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:31.823255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d8df7-80e6-474f-aa0f-e92192a150f0 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:31.823535 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d8df7-80e6-474f-aa0f-e92192a150f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:31.823809 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d8df7-80e6-474f-aa0f-e92192a150f0 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:31.824553 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d8df7-80e6-474f-aa0f-e92192a150f0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:31.824861 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d8df7-80e6-474f-aa0f-e92192a150f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:31.826281 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d8df7-80e6-474f-aa0f-e92192a150f0 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:31.836323 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f319680-7bfa-4a89-a8df-7a737b6768b6 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:31.842953 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 199/395] 10.222.0.45 () {56 vars in 1137 bytes} [Wed Oct 26 10:50:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:31.843755 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d8df7-80e6-474f-aa0f-e92192a150f0 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:31.857522 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:31.874642 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1bd6fa-1e67-439d-8526-1c65e4e1cf6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:31.875245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bd6fa-1e67-439d-8526-1c65e4e1cf6a None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:31.875521 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bd6fa-1e67-439d-8526-1c65e4e1cf6a None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:31.875792 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bd6fa-1e67-439d-8526-1c65e4e1cf6a None admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:31.876460 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1bd6fa-1e67-439d-8526-1c65e4e1cf6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:31.876760 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1bd6fa-1e67-439d-8526-1c65e4e1cf6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:31.878118 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1bd6fa-1e67-439d-8526-1c65e4e1cf6a None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:31.890163 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 197/396] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:50:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:31.890947 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1bd6fa-1e67-439d-8526-1c65e4e1cf6a None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:31.945163 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d8df7-80e6-474f-aa0f-e92192a150f0 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:31.955978 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:31.978808 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c9cec-150d-4c0c-b936-d624458a6ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:31.979486 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c9cec-150d-4c0c-b936-d624458a6ca5 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:31.979776 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c9cec-150d-4c0c-b936-d624458a6ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:31.980050 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c9cec-150d-4c0c-b936-d624458a6ca5 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:31.980712 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c9cec-150d-4c0c-b936-d624458a6ca5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:31.981018 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c9cec-150d-4c0c-b936-d624458a6ca5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:31.982469 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c9cec-150d-4c0c-b936-d624458a6ca5 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:31.988263 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1bd6fa-1e67-439d-8526-1c65e4e1cf6a None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:31.993785 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 200/397] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:50:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:31.994581 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c9cec-150d-4c0c-b936-d624458a6ca5 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:32.024337 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d0ac0-795a-4746-ab01-82b5cfc09ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:32.024967 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d0ac0-795a-4746-ab01-82b5cfc09ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:32.025249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d0ac0-795a-4746-ab01-82b5cfc09ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:32.025525 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d0ac0-795a-4746-ab01-82b5cfc09ad6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:32.035649 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d0ac0-795a-4746-ab01-82b5cfc09ad6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:32.037134 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d0ac0-795a-4746-ab01-82b5cfc09ad6 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:32.051539 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-b21d0ac0-795a-4746-ab01-82b5cfc09ad6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:32.051539 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:32.051539 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:32.051539 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:32.051539 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:32.051539 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:32.051539 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:32.051539 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:32.051539 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:32.051539 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:32.051539 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:32.051539 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:32.051539 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:50:32.051539 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:50:32.051539 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:50:32.051539 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:50:32.052517 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:32.052517 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:32.052517 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:32.052517 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:32.052517 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:32.052517 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:32.052517 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:32.052517 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:32.052517 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:32.052517 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:32.052517 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:32.052517 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:32.052517 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:32.052517 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:32.052517 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:32.052517 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:32.052517 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:50:32.053357 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:50:32.053357 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:32.053357 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:32.053357 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 198/398] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:50:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:32.053580 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d0ac0-795a-4746-ab01-82b5cfc09ad6 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:32.081733 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:32.096563 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c9cec-150d-4c0c-b936-d624458a6ca5 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:32.130108 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab5abf-06fc-47df-b886-2fa8aba177b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:32.130742 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab5abf-06fc-47df-b886-2fa8aba177b0 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:32.131027 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab5abf-06fc-47df-b886-2fa8aba177b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:32.131305 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab5abf-06fc-47df-b886-2fa8aba177b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:32.137831 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ab5abf-06fc-47df-b886-2fa8aba177b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:32.139274 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ab5abf-06fc-47df-b886-2fa8aba177b0 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:32.151221 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-02ab5abf-06fc-47df-b886-2fa8aba177b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:50:32.151221 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:32.151221 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:32.151221 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:32.151221 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:32.151221 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:32.151221 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:32.151221 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:32.151221 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:32.151221 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:32.151221 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:32.151221 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:32.151221 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:50:32.151221 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:50:32.151221 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:50:32.152274 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:50:32.152274 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:32.152274 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:32.152274 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:32.152274 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:32.152274 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:32.152274 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:32.152274 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:32.152274 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:32.152274 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:32.152274 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:32.152274 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:32.152274 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:32.152274 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:32.152274 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:32.152274 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:32.152274 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:32.153230 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:50:32.153230 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:50:32.153230 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:50:32.153230 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:50:32.153230 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:50:32.153230 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:50:32.153230 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:50:32.153230 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:32.153650 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d0ac0-795a-4746-ab01-82b5cfc09ad6 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:32.153730 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 201/399] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 26 10:50:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:32.153730 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab5abf-06fc-47df-b886-2fa8aba177b0 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:32.185596 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:32.187416 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e9938-7c76-4841-b67d-848a49d60084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:32.188124 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e9938-7c76-4841-b67d-848a49d60084 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:32.188408 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e9938-7c76-4841-b67d-848a49d60084 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:32.188681 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e9938-7c76-4841-b67d-848a49d60084 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:32.198557 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e9938-7c76-4841-b67d-848a49d60084 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:32.200093 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e9938-7c76-4841-b67d-848a49d60084 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:32.214823 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-5c3e9938-7c76-4841-b67d-848a49d60084 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:32.214823 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:32.214823 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:32.214823 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:32.214823 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:32.214823 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:32.214823 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:32.214823 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:32.214823 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:32.214823 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:32.214823 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:32.214823 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:32.214823 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:50:32.214823 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:50:32.214823 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:50:32.214823 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:50:32.215770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:32.215770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:32.215770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:32.215770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:32.215770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:32.215770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:32.215770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:32.215770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:32.215770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:32.215770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:32.215770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:32.215770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:32.215770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:32.215770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:32.215770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:32.215770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:32.215770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:50:32.216682 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:50:32.216682 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:32.216682 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:32.216682 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 199/400] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:50:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:32.217563 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e9938-7c76-4841-b67d-848a49d60084 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:32.258384 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab5abf-06fc-47df-b886-2fa8aba177b0 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:32.292884 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf6db8-3633-47a8-9104-ca855058024e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:32.293512 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf6db8-3633-47a8-9104-ca855058024e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:32.293803 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf6db8-3633-47a8-9104-ca855058024e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:32.294080 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf6db8-3633-47a8-9104-ca855058024e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:32.297822 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:32.300596 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf6db8-3633-47a8-9104-ca855058024e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:32.302063 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf6db8-3633-47a8-9104-ca855058024e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:32.313041 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-8eaf6db8-3633-47a8-9104-ca855058024e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:50:32.313041 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:32.313041 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:32.313041 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:32.313041 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:32.313041 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:32.313041 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:32.313041 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:32.313041 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:32.313041 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:32.313041 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:32.313041 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:32.313041 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:50:32.313041 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:50:32.313041 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:50:32.325719 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:50:32.325719 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:32.325719 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:32.325719 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:32.325719 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:32.325719 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:32.325719 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:32.325719 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:32.325719 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:32.325719 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:32.325719 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:32.325719 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:32.325719 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:32.325719 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:32.325719 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:32.325719 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:32.325719 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:32.326763 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:50:32.326763 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:50:32.326763 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:50:32.326763 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:50:32.326763 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:50:32.326763 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:50:32.326763 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:50:32.326763 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:32.326763 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 202/401] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 26 10:50:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:32.326763 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf6db8-3633-47a8-9104-ca855058024e None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:32.327384 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e9938-7c76-4841-b67d-848a49d60084 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:32.354843 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6604429-be1b-4aa2-94ef-43d7dced2692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:32.355456 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6604429-be1b-4aa2-94ef-43d7dced2692 None admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:32.355739 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6604429-be1b-4aa2-94ef-43d7dced2692 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:32.356012 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6604429-be1b-4aa2-94ef-43d7dced2692 None admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:32.356682 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6604429-be1b-4aa2-94ef-43d7dced2692 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:32.358537 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6604429-be1b-4aa2-94ef-43d7dced2692 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:32.406772 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:32.416983 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf6db8-3633-47a8-9104-ca855058024e None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:32.440850 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 200/402] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Oct 26 10:50:32 2022] POST /identity/v3/users => generated 247 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:50:32.442243 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6604429-be1b-4aa2-94ef-43d7dced2692 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:32.451742 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3da6b2-e2fd-4788-ac0b-0bcc3b198fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:32.452506 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3da6b2-e2fd-4788-ac0b-0bcc3b198fd2 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:32.452853 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3da6b2-e2fd-4788-ac0b-0bcc3b198fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:32.453190 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3da6b2-e2fd-4788-ac0b-0bcc3b198fd2 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:32.453928 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3da6b2-e2fd-4788-ac0b-0bcc3b198fd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:32.454310 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3da6b2-e2fd-4788-ac0b-0bcc3b198fd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:32.455833 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3da6b2-e2fd-4788-ac0b-0bcc3b198fd2 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:32.472247 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 203/403] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:50:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:32.474614 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3da6b2-e2fd-4788-ac0b-0bcc3b198fd2 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:32.563194 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6604429-be1b-4aa2-94ef-43d7dced2692 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:32.591648 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3da6b2-e2fd-4788-ac0b-0bcc3b198fd2 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:32.602557 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052d674-3514-4f37-a8dd-dec98ca13d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:32.603182 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052d674-3514-4f37-a8dd-dec98ca13d5c None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:32.603462 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052d674-3514-4f37-a8dd-dec98ca13d5c None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:32.603737 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052d674-3514-4f37-a8dd-dec98ca13d5c None admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:32.604547 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e052d674-3514-4f37-a8dd-dec98ca13d5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:32.604857 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e052d674-3514-4f37-a8dd-dec98ca13d5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:32.606308 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e052d674-3514-4f37-a8dd-dec98ca13d5c None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:32.611501 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:32.626152 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 201/404] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 26 10:50:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:32.627066 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052d674-3514-4f37-a8dd-dec98ca13d5c None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:32.631175 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c1f6a-7a8f-47f2-af0b-73915b0c0587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:32.631795 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c1f6a-7a8f-47f2-af0b-73915b0c0587 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:32.632141 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c1f6a-7a8f-47f2-af0b-73915b0c0587 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:32.632373 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c1f6a-7a8f-47f2-af0b-73915b0c0587 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:32.633020 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345c1f6a-7a8f-47f2-af0b-73915b0c0587 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:32.633348 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345c1f6a-7a8f-47f2-af0b-73915b0c0587 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:32.634711 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345c1f6a-7a8f-47f2-af0b-73915b0c0587 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:32.647322 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 204/405] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:50:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:32.648179 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c1f6a-7a8f-47f2-af0b-73915b0c0587 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:32.661646 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:32.735421 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052d674-3514-4f37-a8dd-dec98ca13d5c None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:32.762661 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c1f6a-7a8f-47f2-af0b-73915b0c0587 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:32.771628 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80adc17d-0177-45c3-93c3-1137ad7b33c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:32.772368 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80adc17d-0177-45c3-93c3-1137ad7b33c8 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:32.772720 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80adc17d-0177-45c3-93c3-1137ad7b33c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:32.773083 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80adc17d-0177-45c3-93c3-1137ad7b33c8 None admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:32.773853 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80adc17d-0177-45c3-93c3-1137ad7b33c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:32.774282 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80adc17d-0177-45c3-93c3-1137ad7b33c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:32.775792 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80adc17d-0177-45c3-93c3-1137ad7b33c8 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:32.793258 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 202/406] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 26 10:50:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:32.793258 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80adc17d-0177-45c3-93c3-1137ad7b33c8 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:32.806453 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127694f9-dc98-45c5-9761-97e547f2c927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:32.807182 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127694f9-dc98-45c5-9761-97e547f2c927 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:32.807536 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127694f9-dc98-45c5-9761-97e547f2c927 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:32.807885 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127694f9-dc98-45c5-9761-97e547f2c927 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:32.816203 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127694f9-dc98-45c5-9761-97e547f2c927 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:32.817808 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127694f9-dc98-45c5-9761-97e547f2c927 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:32.829998 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-127694f9-dc98-45c5-9761-97e547f2c927 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 26 10:50:32.829998 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:32.829998 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:32.829998 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:32.829998 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:32.829998 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:32.829998 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:32.829998 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:32.829998 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:32.829998 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:32.829998 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:32.829998 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:32.829998 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:50:32.829998 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:50:32.829998 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:50:32.829998 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:50:32.831078 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:32.831078 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:32.831078 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:50:32.831078 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:50:32.831078 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:50:32.831078 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:50:32.831078 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:32.831078 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:32.831078 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:32.831078 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:32.831078 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:32.831078 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:32.831078 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:32.831078 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:32.831078 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:32.831078 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:32.831078 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:32.831078 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:32.832713 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:32.832713 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:32.832713 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:50:32.832713 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:50:32.832713 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:50:32.832713 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:50:32.832713 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:50:32.832713 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:50:32.832713 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 26 10:50:32.832713 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:32.836285 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 205/407] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Oct 26 10:50:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:32.837130 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127694f9-dc98-45c5-9761-97e547f2c927 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:32.854521 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:32.899852 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80adc17d-0177-45c3-93c3-1137ad7b33c8 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:32.911594 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:32.933845 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494f5da-f288-41a5-a72e-31cb3bddb58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:32.934511 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494f5da-f288-41a5-a72e-31cb3bddb58a None admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:32.934797 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494f5da-f288-41a5-a72e-31cb3bddb58a None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:32.935076 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494f5da-f288-41a5-a72e-31cb3bddb58a None admin] PATH_INFO: `/v3/projects/e8f0f02a607a49e0b88c75019795b726/users/a852a777cb6a4863bebdb949cc71ea65/roles/9102b6e1623a43e99513d6ad55d55c7b` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:32.949015 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127694f9-dc98-45c5-9761-97e547f2c927 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:32.951537 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2494f5da-f288-41a5-a72e-31cb3bddb58a None admin] RBAC: Authorizing `identity:create_grant(project_id=e8f0f02a607a49e0b88c75019795b726, user_id=a852a777cb6a4863bebdb949cc71ea65, role_id=9102b6e1623a43e99513d6ad55d55c7b)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:32.953028 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2494f5da-f288-41a5-a72e-31cb3bddb58a None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:32.983124 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faffc07-44d7-4b7d-a805-66d8e2ab4615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:32.983804 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faffc07-44d7-4b7d-a805-66d8e2ab4615 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:32.984111 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faffc07-44d7-4b7d-a805-66d8e2ab4615 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:32.984390 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faffc07-44d7-4b7d-a805-66d8e2ab4615 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:32.991432 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faffc07-44d7-4b7d-a805-66d8e2ab4615 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:32.992925 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faffc07-44d7-4b7d-a805-66d8e2ab4615 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:33.004754 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-0faffc07-44d7-4b7d-a805-66d8e2ab4615 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:50:33.004754 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:33.004754 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:33.004754 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:33.004754 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:33.004754 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:33.004754 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:33.004754 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:33.004754 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:33.004754 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:33.004754 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:33.004754 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:33.004754 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:50:33.004754 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:50:33.004754 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:50:33.005789 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:50:33.005789 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:33.005789 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:33.005789 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:33.005789 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:33.005789 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:33.005789 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:33.005789 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:33.005789 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:33.005789 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:33.005789 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:33.005789 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:33.005789 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:33.005789 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:33.005789 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:33.005789 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:33.005789 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:33.006691 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:50:33.006691 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:50:33.006691 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:50:33.006691 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:50:33.006691 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:50:33.006691 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:50:33.006691 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:50:33.006691 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:33.006691 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 206/408] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 26 10:50:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:33.006691 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faffc07-44d7-4b7d-a805-66d8e2ab4615 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:33.022274 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 203/409] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 26 10:50:32 2022] PUT /identity/v3/projects/e8f0f02a607a49e0b88c75019795b726/users/a852a777cb6a4863bebdb949cc71ea65/roles/9102b6e1623a43e99513d6ad55d55c7b => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:50:33.022996 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494f5da-f288-41a5-a72e-31cb3bddb58a None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:33.158910 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494f5da-f288-41a5-a72e-31cb3bddb58a None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:33.161332 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faffc07-44d7-4b7d-a805-66d8e2ab4615 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:33.169089 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:33.196591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:33.203262 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf7942-992b-4c3a-8614-bcf3d8d77e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:33.203499 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b9d3f-53c9-4659-a3e8-ba18079e2575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:33.204363 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf7942-992b-4c3a-8614-bcf3d8d77e07 None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:33.204795 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf7942-992b-4c3a-8614-bcf3d8d77e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:33.205219 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf7942-992b-4c3a-8614-bcf3d8d77e07 None admin] PATH_INFO: `/v3/projects/e8f0f02a607a49e0b88c75019795b726/users/29d0e8cc074b4e36acc2162aebeac169/roles/9102b6e1623a43e99513d6ad55d55c7b` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:33.205532 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b9d3f-53c9-4659-a3e8-ba18079e2575 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:33.205839 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b9d3f-53c9-4659-a3e8-ba18079e2575 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:33.206114 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b9d3f-53c9-4659-a3e8-ba18079e2575 None admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:33.206940 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b9d3f-53c9-4659-a3e8-ba18079e2575 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:33.207260 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b9d3f-53c9-4659-a3e8-ba18079e2575 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:33.208959 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b9d3f-53c9-4659-a3e8-ba18079e2575 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:33.223846 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cf7942-992b-4c3a-8614-bcf3d8d77e07 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8f0f02a607a49e0b88c75019795b726, user_id=29d0e8cc074b4e36acc2162aebeac169, role_id=9102b6e1623a43e99513d6ad55d55c7b)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:33.225579 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cf7942-992b-4c3a-8614-bcf3d8d77e07 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:33.249409 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 204/410] 10.222.0.45 () {56 vars in 1139 bytes} [Wed Oct 26 10:50:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:33.250653 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b9d3f-53c9-4659-a3e8-ba18079e2575 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:33.323126 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 207/411] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 26 10:50:33 2022] PUT /identity/v3/projects/e8f0f02a607a49e0b88c75019795b726/users/29d0e8cc074b4e36acc2162aebeac169/roles/9102b6e1623a43e99513d6ad55d55c7b => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:50:33.325164 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf7942-992b-4c3a-8614-bcf3d8d77e07 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:33.398733 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b9d3f-53c9-4659-a3e8-ba18079e2575 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:33.474359 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4d7b7-6845-48cb-9ede-ec360c170753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:33.475258 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4d7b7-6845-48cb-9ede-ec360c170753 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:33.475855 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4d7b7-6845-48cb-9ede-ec360c170753 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:33.477697 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4d7b7-6845-48cb-9ede-ec360c170753 None admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:33.478634 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f4d7b7-6845-48cb-9ede-ec360c170753 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:33.479883 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f4d7b7-6845-48cb-9ede-ec360c170753 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:33.484292 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f4d7b7-6845-48cb-9ede-ec360c170753 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:33.503055 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 205/412] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 26 10:50:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:33.509805 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4d7b7-6845-48cb-9ede-ec360c170753 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:33.547289 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf7942-992b-4c3a-8614-bcf3d8d77e07 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:33.568458 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:33.595679 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d66fa-f806-4d23-b8ec-f619d858248c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:33.597539 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d66fa-f806-4d23-b8ec-f619d858248c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:33.598048 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d66fa-f806-4d23-b8ec-f619d858248c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:33.598457 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d66fa-f806-4d23-b8ec-f619d858248c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:33.612538 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d66fa-f806-4d23-b8ec-f619d858248c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:33.615880 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d66fa-f806-4d23-b8ec-f619d858248c None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:33.633501 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-497d66fa-f806-4d23-b8ec-f619d858248c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:33.633501 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:33.633501 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:33.633501 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:33.633501 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:33.633501 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:33.633501 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:33.633501 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:33.633501 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:33.633501 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:33.633501 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:33.633501 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:33.633501 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:50:33.633501 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:50:33.633501 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:50:33.633501 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:50:33.634453 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:33.634453 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:33.634453 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:33.634453 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:33.634453 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:33.634453 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:33.634453 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:33.634453 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:33.634453 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:33.634453 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:33.634453 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:33.634453 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:33.634453 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:33.634453 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:33.634453 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:33.634453 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:33.634453 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:50:33.635361 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:50:33.635361 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:33.635361 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:33.637097 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 208/413] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:50:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:33.642668 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d66fa-f806-4d23-b8ec-f619d858248c None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:33.675087 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4d7b7-6845-48cb-9ede-ec360c170753 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:33.699013 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:33.747504 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9222b-c095-47f8-a08a-a239d53fe4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:33.749151 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9222b-c095-47f8-a08a-a239d53fe4fa None admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:33.750254 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9222b-c095-47f8-a08a-a239d53fe4fa None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:33.750705 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9222b-c095-47f8-a08a-a239d53fe4fa None admin] PATH_INFO: `/v3/projects/e8f0f02a607a49e0b88c75019795b726/users/c06f827607194b6dbd196a8fbf717b05/roles/9102b6e1623a43e99513d6ad55d55c7b` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:33.771552 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9222b-c095-47f8-a08a-a239d53fe4fa None admin] RBAC: Authorizing `identity:create_grant(project_id=e8f0f02a607a49e0b88c75019795b726, user_id=c06f827607194b6dbd196a8fbf717b05, role_id=9102b6e1623a43e99513d6ad55d55c7b)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:33.778063 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9222b-c095-47f8-a08a-a239d53fe4fa None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:33.816590 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d66fa-f806-4d23-b8ec-f619d858248c None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:33.850518 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 206/414] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 26 10:50:33 2022] PUT /identity/v3/projects/e8f0f02a607a49e0b88c75019795b726/users/c06f827607194b6dbd196a8fbf717b05/roles/9102b6e1623a43e99513d6ad55d55c7b => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 10:50:33.857472 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d9f25-8695-4117-929a-ca36e0fc5ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:33.858259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d9f25-8695-4117-929a-ca36e0fc5ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:33.858644 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d9f25-8695-4117-929a-ca36e0fc5ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:33.859019 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d9f25-8695-4117-929a-ca36e0fc5ca7 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:33.859766 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d9f25-8695-4117-929a-ca36e0fc5ca7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:33.860202 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d9f25-8695-4117-929a-ca36e0fc5ca7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:33.861706 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d9f25-8695-4117-929a-ca36e0fc5ca7 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:33.881683 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 209/415] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:33.887616 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9222b-c095-47f8-a08a-a239d53fe4fa None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:34.006564 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:34.037050 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9222b-c095-47f8-a08a-a239d53fe4fa None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:34.085879 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69477640-e7dc-4e2b-934e-0f249bcb36d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:34.086479 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69477640-e7dc-4e2b-934e-0f249bcb36d4 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:34.086756 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69477640-e7dc-4e2b-934e-0f249bcb36d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:34.087026 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69477640-e7dc-4e2b-934e-0f249bcb36d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:34.097160 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69477640-e7dc-4e2b-934e-0f249bcb36d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:34.099156 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69477640-e7dc-4e2b-934e-0f249bcb36d4 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:34.113051 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-69477640-e7dc-4e2b-934e-0f249bcb36d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:50:34.113051 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:34.113051 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:34.113051 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:34.113051 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:34.113051 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:34.113051 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:34.113051 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:34.113051 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:34.113051 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:34.113051 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:34.113051 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:34.113051 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:50:34.113051 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:50:34.113051 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:50:34.114050 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:50:34.114050 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:34.114050 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:34.114050 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:34.114050 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:34.114050 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:34.114050 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:34.114050 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:34.114050 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:34.114050 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:34.114050 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:34.114050 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:34.114050 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:34.114050 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:34.114050 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:34.114050 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:34.114050 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:34.114910 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:50:34.114910 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:50:34.114910 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:50:34.114910 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:50:34.114910 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:50:34.114910 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:50:34.114910 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:50:34.114910 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:34.114910 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 207/416] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 26 10:50:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:34.121876 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d9f25-8695-4117-929a-ca36e0fc5ca7 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:34.242575 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:34.254750 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d9f25-8695-4117-929a-ca36e0fc5ca7 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:34.304906 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca32a40-3a81-41b7-a273-10631062119a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:34.305528 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca32a40-3a81-41b7-a273-10631062119a None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:34.305815 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca32a40-3a81-41b7-a273-10631062119a None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:34.306095 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca32a40-3a81-41b7-a273-10631062119a None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:34.306795 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca32a40-3a81-41b7-a273-10631062119a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:34.307107 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca32a40-3a81-41b7-a273-10631062119a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:34.308595 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca32a40-3a81-41b7-a273-10631062119a None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:34.342244 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 210/417] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 26 10:50:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:34.347673 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69477640-e7dc-4e2b-934e-0f249bcb36d4 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:34.539832 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69477640-e7dc-4e2b-934e-0f249bcb36d4 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:34.581830 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee18110-de3b-46f1-9477-5587864a987f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:34.583292 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee18110-de3b-46f1-9477-5587864a987f None admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:34.583578 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee18110-de3b-46f1-9477-5587864a987f None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:34.583863 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee18110-de3b-46f1-9477-5587864a987f None admin] PATH_INFO: `/v3/projects/e8f0f02a607a49e0b88c75019795b726/users/522b4232cb4d430988d76a1cdb281e72/roles/9102b6e1623a43e99513d6ad55d55c7b` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:34.590227 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:34.608893 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee18110-de3b-46f1-9477-5587864a987f None admin] RBAC: Authorizing `identity:create_grant(project_id=e8f0f02a607a49e0b88c75019795b726, user_id=522b4232cb4d430988d76a1cdb281e72, role_id=9102b6e1623a43e99513d6ad55d55c7b)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:34.610397 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee18110-de3b-46f1-9477-5587864a987f None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:34.720249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 208/418] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 26 10:50:34 2022] PUT /identity/v3/projects/e8f0f02a607a49e0b88c75019795b726/users/522b4232cb4d430988d76a1cdb281e72/roles/9102b6e1623a43e99513d6ad55d55c7b => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:50:34.753791 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dad6af-020b-41f3-9f49-6ff8ce0e1011 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:34.754672 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dad6af-020b-41f3-9f49-6ff8ce0e1011 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:34.754891 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dad6af-020b-41f3-9f49-6ff8ce0e1011 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:34.756332 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 211/419] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:50:34.763337 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d336f0-b32c-42b2-8878-0a2fa034a600 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:34.764690 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d336f0-b32c-42b2-8878-0a2fa034a600 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:34.764979 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d336f0-b32c-42b2-8878-0a2fa034a600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:34.855472 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-51d336f0-b32c-42b2-8878-0a2fa034a600 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:34.858090 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-51d336f0-b32c-42b2-8878-0a2fa034a600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:34.948393 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 209/420] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:50:35.290747 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dad6af-020b-41f3-9f49-6ff8ce0e1011 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:35.433668 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dad6af-020b-41f3-9f49-6ff8ce0e1011 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:35.470415 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9c4e8-6a2e-44f0-b47d-81f0620ca7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:35.471284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9c4e8-6a2e-44f0-b47d-81f0620ca7bd None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:35.471705 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9c4e8-6a2e-44f0-b47d-81f0620ca7bd None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:35.472169 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9c4e8-6a2e-44f0-b47d-81f0620ca7bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:35.483230 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9c4e8-6a2e-44f0-b47d-81f0620ca7bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:50:35.488192 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-59a9c4e8-6a2e-44f0-b47d-81f0620ca7bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:50:35.488192 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:35.488192 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:35.488192 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:35.488192 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:35.488192 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:35.488192 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:35.488192 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:35.488192 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:35.488192 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:35.488192 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:35.488192 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:35.488192 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:50:35.488192 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:50:35.488192 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:50:35.488192 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:50:35.489300 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:50:35.489300 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:50:35.489300 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:50:35.489300 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:50:35.489300 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:35.489300 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:35.489300 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:35.489300 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:35.489300 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:35.489300 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:35.489300 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:35.489300 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:35.489300 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:35.489300 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:35.489300 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:35.489300 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:35.490265 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:35.490265 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:35.490265 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:35.490265 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:35.490265 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:50:35.490265 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:50:35.490265 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:50:35.490265 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:50:35.490265 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:50:35.490265 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:50:35.490265 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:50:35.490265 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:35.492328 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 212/421] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Oct 26 10:50:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:35.501190 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d336f0-b32c-42b2-8878-0a2fa034a600 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:35.655012 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d336f0-b32c-42b2-8878-0a2fa034a600 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:35.680552 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:35.692924 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf83c25-ba2d-4d09-a44f-21ab8d85fe8a None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:35.693218 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf83c25-ba2d-4d09-a44f-21ab8d85fe8a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:35.693500 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf83c25-ba2d-4d09-a44f-21ab8d85fe8a None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:35.696301 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 213/422] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:50:35.700452 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306527e-e16b-4d99-8db4-4f7da1ea3a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:35.701099 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306527e-e16b-4d99-8db4-4f7da1ea3a6b None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:35.701386 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306527e-e16b-4d99-8db4-4f7da1ea3a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:35.701569 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444bb008-6159-467b-86fb-dcbe743bcf0d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:35.701661 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306527e-e16b-4d99-8db4-4f7da1ea3a6b None admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:35.701804 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444bb008-6159-467b-86fb-dcbe743bcf0d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:35.702085 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444bb008-6159-467b-86fb-dcbe743bcf0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:35.702337 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b306527e-e16b-4d99-8db4-4f7da1ea3a6b None admin] RBAC: Adding query filter params (name=service) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:35.702644 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b306527e-e16b-4d99-8db4-4f7da1ea3a6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:35.704012 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b306527e-e16b-4d99-8db4-4f7da1ea3a6b None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:35.714937 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 210/423] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Oct 26 10:50:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:35.720079 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306527e-e16b-4d99-8db4-4f7da1ea3a6b None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:35.722012 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-444bb008-6159-467b-86fb-dcbe743bcf0d None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:35.723765 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-444bb008-6159-467b-86fb-dcbe743bcf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:35.736053 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:35.802067 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 214/424] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:50:35.929921 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306527e-e16b-4d99-8db4-4f7da1ea3a6b None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:35.976805 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4a384-3ad9-4133-9906-f72b33c57dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:35.977459 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4a384-3ad9-4133-9906-f72b33c57dcf None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:35.977745 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4a384-3ad9-4133-9906-f72b33c57dcf None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:35.978021 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4a384-3ad9-4133-9906-f72b33c57dcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:35.995718 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b4a384-3ad9-4133-9906-f72b33c57dcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:35.997213 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b4a384-3ad9-4133-9906-f72b33c57dcf None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:36.015913 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-21b4a384-3ad9-4133-9906-f72b33c57dcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:36.015913 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:36.015913 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:36.015913 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:36.015913 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:36.015913 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:36.015913 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:36.015913 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:36.015913 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:36.015913 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:36.015913 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:36.015913 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:36.015913 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:50:36.015913 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:50:36.015913 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:50:36.015913 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:50:36.016890 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:36.016890 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:36.016890 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:36.016890 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:36.016890 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:36.016890 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:36.016890 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:36.016890 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:36.016890 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:36.016890 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:36.016890 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:36.016890 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:36.016890 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:36.016890 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:36.016890 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:36.016890 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:36.016890 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:50:36.017769 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:50:36.017769 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:36.017769 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:36.019537 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 211/425] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:50:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:50:36.025803 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444bb008-6159-467b-86fb-dcbe743bcf0d None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:36.164417 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444bb008-6159-467b-86fb-dcbe743bcf0d None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:36.189495 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4a384-3ad9-4133-9906-f72b33c57dcf None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:36.202503 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b8c60-21df-4b69-97ed-d10c27ce8d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:36.203448 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b8c60-21df-4b69-97ed-d10c27ce8d34 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:36.203740 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b8c60-21df-4b69-97ed-d10c27ce8d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:36.204019 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b8c60-21df-4b69-97ed-d10c27ce8d34 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:36.204981 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b8c60-21df-4b69-97ed-d10c27ce8d34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:36.205296 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b8c60-21df-4b69-97ed-d10c27ce8d34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:36.206885 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b8c60-21df-4b69-97ed-d10c27ce8d34 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:36.220425 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:36.221202 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 215/426] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:36.223381 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea67ef-b940-45dc-aa70-a7530eed106a None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:36.223670 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea67ef-b940-45dc-aa70-a7530eed106a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:36.223947 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea67ef-b940-45dc-aa70-a7530eed106a None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:36.228112 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 216/427] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:50:36.231758 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea67ef-b940-45dc-aa70-a7530eed106a None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:36.244432 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:36.324864 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4a384-3ad9-4133-9906-f72b33c57dcf None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:36.352580 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea67ef-b940-45dc-aa70-a7530eed106a None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:36.370013 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901de466-bd0c-4789-b70b-b36b8cf4cd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:36.371045 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901de466-bd0c-4789-b70b-b36b8cf4cd4c None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:36.371503 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901de466-bd0c-4789-b70b-b36b8cf4cd4c None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:36.372244 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901de466-bd0c-4789-b70b-b36b8cf4cd4c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:36.386152 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901de466-bd0c-4789-b70b-b36b8cf4cd4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:50:36.390427 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b33b4-1a0d-4e8f-a3d3-e08486ce7a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:36.391136 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b33b4-1a0d-4e8f-a3d3-e08486ce7a85 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:36.391487 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b33b4-1a0d-4e8f-a3d3-e08486ce7a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:36.391808 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-901de466-bd0c-4789-b70b-b36b8cf4cd4c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:50:36.391808 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:36.391808 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:36.391808 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:36.391808 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:36.391808 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:36.391808 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:36.391808 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:36.391808 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:36.391808 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:36.391808 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:36.391808 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:36.391808 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:50:36.391808 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:50:36.391808 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:50:36.391808 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:50:36.392706 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:50:36.392706 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:50:36.392706 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:50:36.392706 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:50:36.392706 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:36.392706 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:36.392706 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:36.392706 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:36.392706 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:36.392706 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:36.392706 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:36.392706 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:36.392706 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:36.392706 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:36.392706 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:36.392706 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:36.393530 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:36.393530 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:36.393530 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:36.393530 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:36.393530 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:50:36.393530 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:50:36.393530 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:50:36.393530 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:50:36.393530 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:50:36.393530 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:50:36.393530 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:50:36.393530 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:36.394139 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b33b4-1a0d-4e8f-a3d3-e08486ce7a85 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:36.396139 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 212/428] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Oct 26 10:50:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:50:36.397607 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bc0a7-c92b-4120-a048-fed7164fe187 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:36.398037 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bc0a7-c92b-4120-a048-fed7164fe187 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:36.398458 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bc0a7-c92b-4120-a048-fed7164fe187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:36.401382 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b33b4-1a0d-4e8f-a3d3-e08486ce7a85 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:36.402999 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b33b4-1a0d-4e8f-a3d3-e08486ce7a85 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:36.417703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-803b33b4-1a0d-4e8f-a3d3-e08486ce7a85 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 26 10:50:36.417703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:36.417703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:36.417703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:36.417703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:36.417703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:36.417703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:36.417703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:36.417703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:36.417703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:36.417703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:36.417703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:36.417703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:50:36.417703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:50:36.417703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:50:36.417703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:50:36.418669 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:36.418669 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:36.418669 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:50:36.418669 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:50:36.418669 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:50:36.418669 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:50:36.418669 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:36.418669 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:36.418669 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:36.418669 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:36.418669 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:36.418669 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:36.418669 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:36.418669 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:36.418669 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:36.418669 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:36.418669 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:36.418669 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:36.419938 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:36.419938 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:36.419938 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:50:36.419938 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:50:36.419938 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:50:36.419938 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:50:36.419938 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:50:36.419938 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:50:36.419938 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 26 10:50:36.419938 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:36.424022 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 217/429] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 26 10:50:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:36.424933 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b33b4-1a0d-4e8f-a3d3-e08486ce7a85 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:36.425292 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-a54bc0a7-c92b-4120-a048-fed7164fe187 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:36.426760 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-a54bc0a7-c92b-4120-a048-fed7164fe187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:36.494853 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:36.522393 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 213/430] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:50:36.524270 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54bc0a7-c92b-4120-a048-fed7164fe187 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:36.543298 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b33b4-1a0d-4e8f-a3d3-e08486ce7a85 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:36.551013 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:36.591093 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c08d2-8f94-4bd6-8d2c-2c389072d070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:36.591708 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c08d2-8f94-4bd6-8d2c-2c389072d070 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:36.591993 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c08d2-8f94-4bd6-8d2c-2c389072d070 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:36.592295 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c08d2-8f94-4bd6-8d2c-2c389072d070 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:36.592959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c08d2-8f94-4bd6-8d2c-2c389072d070 None admin] RBAC: Adding query filter params (name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:36.593263 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c08d2-8f94-4bd6-8d2c-2c389072d070 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:36.594659 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c08d2-8f94-4bd6-8d2c-2c389072d070 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:36.615385 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 218/431] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Oct 26 10:50:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:36.619625 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c08d2-8f94-4bd6-8d2c-2c389072d070 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:36.698506 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54bc0a7-c92b-4120-a048-fed7164fe187 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:36.733818 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c08d2-8f94-4bd6-8d2c-2c389072d070 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:36.751774 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace374b-e8b4-4d16-9fbc-96c51cd97876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:36.752642 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace374b-e8b4-4d16-9fbc-96c51cd97876 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:36.753013 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace374b-e8b4-4d16-9fbc-96c51cd97876 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:36.753692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace374b-e8b4-4d16-9fbc-96c51cd97876 None admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:36.754542 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace374b-e8b4-4d16-9fbc-96c51cd97876 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:36.754928 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace374b-e8b4-4d16-9fbc-96c51cd97876 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:36.757072 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace374b-e8b4-4d16-9fbc-96c51cd97876 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:36.760225 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:36.771970 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58de89-1442-4be4-b66c-4c2513a4dfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:36.773181 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58de89-1442-4be4-b66c-4c2513a4dfe7 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:36.773572 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58de89-1442-4be4-b66c-4c2513a4dfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:36.773922 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58de89-1442-4be4-b66c-4c2513a4dfe7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:36.782332 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 214/432] 10.222.0.45 () {56 vars in 1135 bytes} [Wed Oct 26 10:50:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:36.784302 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc726e9-8ea1-4081-bff7-d29f88984b0a None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:36.785006 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc726e9-8ea1-4081-bff7-d29f88984b0a None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:36.785311 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc726e9-8ea1-4081-bff7-d29f88984b0a None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:36.785765 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58de89-1442-4be4-b66c-4c2513a4dfe7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:36.787056 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 215/433] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:50:36.787243 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58de89-1442-4be4-b66c-4c2513a4dfe7 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:36.787824 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc726e9-8ea1-4081-bff7-d29f88984b0a None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:36.808522 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-db58de89-1442-4be4-b66c-4c2513a4dfe7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:36.808522 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:36.808522 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:36.808522 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:36.808522 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:36.808522 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:36.808522 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:36.808522 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:36.808522 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:36.808522 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:36.808522 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:36.808522 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:36.808522 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:50:36.808522 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:50:36.808522 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:50:36.808522 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:50:36.812480 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:36.812480 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:36.812480 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:36.812480 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:36.812480 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:36.812480 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:36.812480 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:36.812480 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:36.812480 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:36.812480 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:36.812480 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:36.812480 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:36.812480 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:36.812480 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:36.812480 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:36.812480 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:36.812480 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:50:36.813340 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:50:36.813340 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:36.813340 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:36.813340 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 219/434] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:50:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:50:36.813340 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e16977-7931-4f63-a6e9-5aca8b3f0934 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:36.813340 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e16977-7931-4f63-a6e9-5aca8b3f0934 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:36.813340 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e16977-7931-4f63-a6e9-5aca8b3f0934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:36.851771 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-53e16977-7931-4f63-a6e9-5aca8b3f0934 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:36.853067 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-53e16977-7931-4f63-a6e9-5aca8b3f0934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:36.880739 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:36.905658 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc726e9-8ea1-4081-bff7-d29f88984b0a None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:36.924287 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 220/435] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:50:36.925323 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e16977-7931-4f63-a6e9-5aca8b3f0934 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:36.955551 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e221c7-1c9e-4244-9728-4a38eace9e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:36.956516 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e221c7-1c9e-4244-9728-4a38eace9e8f None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:36.956804 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e221c7-1c9e-4244-9728-4a38eace9e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:36.957240 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e221c7-1c9e-4244-9728-4a38eace9e8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:36.968097 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e221c7-1c9e-4244-9728-4a38eace9e8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:36.969668 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e221c7-1c9e-4244-9728-4a38eace9e8f None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:36.986055 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-20e221c7-1c9e-4244-9728-4a38eace9e8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:36.986055 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:36.986055 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:36.986055 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:36.986055 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:36.986055 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:36.986055 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:36.986055 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:36.986055 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:36.986055 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:36.986055 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:36.986055 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:36.986055 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:50:36.986055 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:50:36.986055 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:50:36.986055 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:50:36.987199 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:36.987199 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:36.987199 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:36.987199 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:36.987199 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:36.987199 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:36.987199 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:36.987199 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:36.987199 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:36.987199 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:36.987199 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:36.987199 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:36.987199 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:36.987199 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:36.987199 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:36.987199 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:36.987199 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:50:36.988292 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:50:36.988292 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:36.988292 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:36.989445 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 216/436] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:50:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:36.990323 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e221c7-1c9e-4244-9728-4a38eace9e8f None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:37.043560 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e16977-7931-4f63-a6e9-5aca8b3f0934 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:37.053422 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:37.087075 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa43c1-98f3-465f-8d45-1661b404cfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:37.088227 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa43c1-98f3-465f-8d45-1661b404cfec None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:37.088661 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa43c1-98f3-465f-8d45-1661b404cfec None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:37.089082 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa43c1-98f3-465f-8d45-1661b404cfec None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:37.090038 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa43c1-98f3-465f-8d45-1661b404cfec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:37.090811 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa43c1-98f3-465f-8d45-1661b404cfec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:37.092376 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa43c1-98f3-465f-8d45-1661b404cfec None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:37.108307 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 221/437] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:37.109298 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa43c1-98f3-465f-8d45-1661b404cfec None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:37.112357 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e221c7-1c9e-4244-9728-4a38eace9e8f None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:37.148241 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:37.158074 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89cda29-f315-484a-8f32-c3c759327bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:37.159347 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cda29-f315-484a-8f32-c3c759327bac None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:37.159687 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cda29-f315-484a-8f32-c3c759327bac None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:37.160017 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cda29-f315-484a-8f32-c3c759327bac None admin] PATH_INFO: `/v3/roles/service` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:37.179290 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89cda29-f315-484a-8f32-c3c759327bac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:50:37.184214 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-d89cda29-f315-484a-8f32-c3c759327bac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:50:37.184214 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:37.184214 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:37.184214 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:37.184214 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:37.184214 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:37.184214 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:37.184214 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:37.184214 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:37.184214 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:37.184214 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:37.184214 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:37.184214 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:50:37.184214 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:50:37.184214 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:50:37.184214 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:50:37.185089 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:50:37.185089 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:50:37.185089 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:50:37.185089 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:50:37.185089 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:37.185089 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:37.185089 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:37.185089 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:37.185089 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:37.185089 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:37.185089 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:37.185089 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:37.185089 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:37.185089 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:37.185089 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:37.185089 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:37.185959 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:37.185959 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:37.185959 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:37.185959 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:37.185959 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:50:37.185959 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:50:37.185959 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:50:37.185959 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:50:37.185959 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:50:37.185959 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:50:37.185959 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:50:37.185959 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:37.188903 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 217/438] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Oct 26 10:50:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:37.190011 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89cda29-f315-484a-8f32-c3c759327bac None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:37.241680 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa43c1-98f3-465f-8d45-1661b404cfec None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:37.275030 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f60df0-fbcc-426c-84ec-346fe26cb589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:37.275636 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f60df0-fbcc-426c-84ec-346fe26cb589 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:37.275920 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f60df0-fbcc-426c-84ec-346fe26cb589 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:37.276215 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f60df0-fbcc-426c-84ec-346fe26cb589 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:37.276848 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f60df0-fbcc-426c-84ec-346fe26cb589 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:37.277149 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f60df0-fbcc-426c-84ec-346fe26cb589 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:37.278616 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f60df0-fbcc-426c-84ec-346fe26cb589 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:37.293124 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 222/439] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:50:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:37.294022 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f60df0-fbcc-426c-84ec-346fe26cb589 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:37.305469 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89cda29-f315-484a-8f32-c3c759327bac None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:37.326021 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:37.346044 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610726a8-6225-4368-9b47-9971f6ade6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:37.346686 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610726a8-6225-4368-9b47-9971f6ade6b2 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:37.346971 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610726a8-6225-4368-9b47-9971f6ade6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:37.347246 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610726a8-6225-4368-9b47-9971f6ade6b2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:37.355626 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610726a8-6225-4368-9b47-9971f6ade6b2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:37.357118 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610726a8-6225-4368-9b47-9971f6ade6b2 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:37.368193 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-610726a8-6225-4368-9b47-9971f6ade6b2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 26 10:50:37.368193 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:37.368193 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:37.368193 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:37.368193 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:37.368193 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:37.368193 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:37.368193 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:37.368193 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:37.368193 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:37.368193 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:37.368193 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:37.368193 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:50:37.368193 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:50:37.368193 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:50:37.368193 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:50:37.369221 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:37.369221 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:37.369221 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:50:37.369221 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:50:37.369221 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:50:37.369221 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:50:37.369221 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:37.369221 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:37.369221 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:37.369221 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:37.369221 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:37.369221 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:37.369221 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:37.369221 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:37.369221 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:37.369221 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:37.369221 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:37.369221 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:37.374957 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:37.374957 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:37.374957 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:50:37.374957 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:50:37.374957 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:50:37.374957 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:50:37.374957 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:50:37.374957 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:50:37.374957 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 26 10:50:37.374957 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:37.374957 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 218/440] 10.222.0.45 () {56 vars in 1093 bytes} [Wed Oct 26 10:50:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:37.374957 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610726a8-6225-4368-9b47-9971f6ade6b2 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:37.403336 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f60df0-fbcc-426c-84ec-346fe26cb589 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:37.423662 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:37.438431 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc1c6e-98e4-45ab-a31b-5515c3e25b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:37.439042 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc1c6e-98e4-45ab-a31b-5515c3e25b74 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:37.439327 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc1c6e-98e4-45ab-a31b-5515c3e25b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:37.439604 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc1c6e-98e4-45ab-a31b-5515c3e25b74 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:37.440301 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc1c6e-98e4-45ab-a31b-5515c3e25b74 None admin] RBAC: Adding query filter params (name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:37.440606 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc1c6e-98e4-45ab-a31b-5515c3e25b74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:37.442024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc1c6e-98e4-45ab-a31b-5515c3e25b74 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:37.449952 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 223/441] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Oct 26 10:50:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:37.450749 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc1c6e-98e4-45ab-a31b-5515c3e25b74 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:37.474740 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610726a8-6225-4368-9b47-9971f6ade6b2 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:37.507251 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0b822-80f5-4b24-8386-7ecc763a74c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:37.507880 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0b822-80f5-4b24-8386-7ecc763a74c5 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:37.508187 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0b822-80f5-4b24-8386-7ecc763a74c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:37.508707 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0b822-80f5-4b24-8386-7ecc763a74c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:37.518171 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a0b822-80f5-4b24-8386-7ecc763a74c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:50:37.523912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-e0a0b822-80f5-4b24-8386-7ecc763a74c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:50:37.523912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:37.523912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:37.523912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:37.523912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:37.523912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:37.523912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:37.523912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:37.523912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:37.523912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:37.523912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:37.523912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:37.523912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:50:37.523912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:50:37.523912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:50:37.523912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:50:37.525343 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:50:37.525343 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:50:37.525343 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:50:37.525343 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:50:37.525343 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:37.525343 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:37.525343 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:37.525343 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:37.525343 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:37.525343 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:37.525343 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:37.525343 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:37.525343 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:37.525343 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:37.525343 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:37.525343 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:37.526149 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:37.526149 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:37.526149 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:37.526149 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:37.526149 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:50:37.526149 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:50:37.526149 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:50:37.526149 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:50:37.526149 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:50:37.526149 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:50:37.526149 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:50:37.526149 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:37.526149 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 219/442] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Oct 26 10:50:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:37.526149 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0d739-e2b2-4cc9-a753-b40b580e28ff None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:37.526856 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0d739-e2b2-4cc9-a753-b40b580e28ff None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:37.526856 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0d739-e2b2-4cc9-a753-b40b580e28ff None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:37.528036 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 220/443] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:50:37.528556 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0d739-e2b2-4cc9-a753-b40b580e28ff None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:37.539472 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:37.555084 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc1c6e-98e4-45ab-a31b-5515c3e25b74 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:37.585805 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4aebca-c85f-41b5-9572-c3ab40d438c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:37.586438 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4aebca-c85f-41b5-9572-c3ab40d438c8 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:37.586722 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4aebca-c85f-41b5-9572-c3ab40d438c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:37.586995 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4aebca-c85f-41b5-9572-c3ab40d438c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:37.593540 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4aebca-c85f-41b5-9572-c3ab40d438c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:37.594984 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4aebca-c85f-41b5-9572-c3ab40d438c8 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:37.606672 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-aa4aebca-c85f-41b5-9572-c3ab40d438c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:50:37.606672 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:37.606672 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:37.606672 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:37.606672 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:37.606672 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:37.606672 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:37.606672 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:37.606672 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:37.606672 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:37.606672 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:37.606672 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:37.606672 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:50:37.606672 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:50:37.606672 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:50:37.607541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:50:37.607541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:37.607541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:37.607541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:37.607541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:37.607541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:37.607541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:37.607541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:37.607541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:37.607541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:37.607541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:37.607541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:37.607541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:37.607541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:37.607541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:37.607541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:37.607541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:37.608991 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:50:37.608991 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:50:37.608991 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:50:37.608991 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:50:37.608991 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:50:37.608991 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:50:37.608991 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:50:37.608991 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:37.608991 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 224/444] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 26 10:50:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:37.608991 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4aebca-c85f-41b5-9572-c3ab40d438c8 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:37.634759 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0d739-e2b2-4cc9-a753-b40b580e28ff None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:37.643458 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:37.668165 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b3b9b-1b15-44d6-b256-e9fe2e7a3c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:37.670238 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b3b9b-1b15-44d6-b256-e9fe2e7a3c1f None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:37.670238 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b3b9b-1b15-44d6-b256-e9fe2e7a3c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:37.670238 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b3b9b-1b15-44d6-b256-e9fe2e7a3c1f None admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:37.670238 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b3b9b-1b15-44d6-b256-e9fe2e7a3c1f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:37.670517 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b3b9b-1b15-44d6-b256-e9fe2e7a3c1f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:37.671861 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b3b9b-1b15-44d6-b256-e9fe2e7a3c1f None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:37.689138 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 221/445] 10.222.0.45 () {56 vars in 1133 bytes} [Wed Oct 26 10:50:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:37.690123 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b3b9b-1b15-44d6-b256-e9fe2e7a3c1f None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:37.709730 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4aebca-c85f-41b5-9572-c3ab40d438c8 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:37.743938 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde54ce3-77ed-4eba-ba7b-e62260b5a5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:37.744593 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde54ce3-77ed-4eba-ba7b-e62260b5a5a8 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:37.744879 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde54ce3-77ed-4eba-ba7b-e62260b5a5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:37.745157 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde54ce3-77ed-4eba-ba7b-e62260b5a5a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:37.755641 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde54ce3-77ed-4eba-ba7b-e62260b5a5a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:37.757143 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde54ce3-77ed-4eba-ba7b-e62260b5a5a8 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:37.765408 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:37.771937 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-bde54ce3-77ed-4eba-ba7b-e62260b5a5a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:37.771937 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:37.771937 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:37.771937 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:37.771937 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:37.771937 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:37.771937 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:37.771937 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:37.771937 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:37.771937 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:37.771937 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:37.771937 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:37.771937 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:50:37.771937 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:50:37.771937 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:50:37.771937 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:50:37.772905 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:37.772905 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:37.772905 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:37.772905 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:37.772905 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:37.772905 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:37.772905 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:37.772905 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:37.772905 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:37.772905 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:37.772905 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:37.772905 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:37.772905 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:37.772905 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:37.772905 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:37.772905 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:37.772905 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:50:37.773752 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:50:37.773752 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:37.773752 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:37.773752 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 225/446] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:50:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:37.774480 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f911853-54e1-436e-8488-e7b7a64ff8fc None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:37.774769 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f911853-54e1-436e-8488-e7b7a64ff8fc None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:37.775046 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f911853-54e1-436e-8488-e7b7a64ff8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:37.793447 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-7f911853-54e1-436e-8488-e7b7a64ff8fc None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:37.794630 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7f911853-54e1-436e-8488-e7b7a64ff8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:37.796209 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b3b9b-1b15-44d6-b256-e9fe2e7a3c1f None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:37.829571 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7d2a1-2cf5-406f-954d-f6d9b39694a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:37.830108 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7d2a1-2cf5-406f-954d-f6d9b39694a8 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:37.830390 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7d2a1-2cf5-406f-954d-f6d9b39694a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:37.830673 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7d2a1-2cf5-406f-954d-f6d9b39694a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:37.831335 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7d2a1-2cf5-406f-954d-f6d9b39694a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:37.831640 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7d2a1-2cf5-406f-954d-f6d9b39694a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:37.833044 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7d2a1-2cf5-406f-954d-f6d9b39694a8 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:37.841277 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 222/447] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Oct 26 10:50:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:37.842148 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7d2a1-2cf5-406f-954d-f6d9b39694a8 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:37.861428 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 226/448] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:50:37.862514 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f911853-54e1-436e-8488-e7b7a64ff8fc None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:37.876018 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:37.949553 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7d2a1-2cf5-406f-954d-f6d9b39694a8 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:37.966991 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f911853-54e1-436e-8488-e7b7a64ff8fc None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:37.984315 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483df1a-7268-4c9b-969a-4465e970fe52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:37.984982 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483df1a-7268-4c9b-969a-4465e970fe52 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:37.985264 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483df1a-7268-4c9b-969a-4465e970fe52 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:37.985538 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483df1a-7268-4c9b-969a-4465e970fe52 None admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:37.986273 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483df1a-7268-4c9b-969a-4465e970fe52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:37.986590 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483df1a-7268-4c9b-969a-4465e970fe52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:37.988009 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483df1a-7268-4c9b-969a-4465e970fe52 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:37.997851 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:38.005879 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 223/449] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 26 10:50:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:38.005879 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483df1a-7268-4c9b-969a-4465e970fe52 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:38.015050 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b794c7e-8f3b-43a4-8182-df2716a782c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:38.015050 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b794c7e-8f3b-43a4-8182-df2716a782c3 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:38.015050 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b794c7e-8f3b-43a4-8182-df2716a782c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:38.015050 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b794c7e-8f3b-43a4-8182-df2716a782c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:38.077228 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b794c7e-8f3b-43a4-8182-df2716a782c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:38.078730 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b794c7e-8f3b-43a4-8182-df2716a782c3 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:38.098590 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:38.111529 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483df1a-7268-4c9b-969a-4465e970fe52 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:38.145908 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b4951-1236-4575-8ec3-74bcf7375511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:38.146522 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b4951-1236-4575-8ec3-74bcf7375511 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:38.146807 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b4951-1236-4575-8ec3-74bcf7375511 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:38.147084 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b4951-1236-4575-8ec3-74bcf7375511 None admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:38.147724 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b4951-1236-4575-8ec3-74bcf7375511 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:38.148028 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b4951-1236-4575-8ec3-74bcf7375511 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:38.149436 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b4951-1236-4575-8ec3-74bcf7375511 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:38.160343 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 224/450] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:50:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:38.161670 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b4951-1236-4575-8ec3-74bcf7375511 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:38.184297 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 227/451] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 26 10:50:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 26 10:50:38.184297 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b794c7e-8f3b-43a4-8182-df2716a782c3 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:38.210355 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:38.261141 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b4951-1236-4575-8ec3-74bcf7375511 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:38.278442 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b794c7e-8f3b-43a4-8182-df2716a782c3 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:38.294888 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc0c17-6a60-49bc-b26c-317f09505ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:38.295518 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc0c17-6a60-49bc-b26c-317f09505ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:38.295797 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc0c17-6a60-49bc-b26c-317f09505ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:38.296081 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc0c17-6a60-49bc-b26c-317f09505ad6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:38.306348 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc0c17-6a60-49bc-b26c-317f09505ad6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:38.307886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc0c17-6a60-49bc-b26c-317f09505ad6 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:38.313232 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed425d9-fe0b-4346-aa53-169baca1ed70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:38.313891 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed425d9-fe0b-4346-aa53-169baca1ed70 None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:38.314209 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed425d9-fe0b-4346-aa53-169baca1ed70 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:38.314496 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed425d9-fe0b-4346-aa53-169baca1ed70 None admin] PATH_INFO: `/v3/projects/e8f0f02a607a49e0b88c75019795b726/users/d21b84cc38a848de8d19a41e1eb04a58/roles/9102b6e1623a43e99513d6ad55d55c7b` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:38.315924 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:38.322321 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-53bc0c17-6a60-49bc-b26c-317f09505ad6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:38.322321 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:38.322321 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:38.322321 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:38.322321 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:38.322321 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:38.322321 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:38.322321 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:38.322321 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:38.322321 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:38.322321 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:38.322321 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:38.322321 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:50:38.322321 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:50:38.322321 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:50:38.322321 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:50:38.323200 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:38.323200 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:38.323200 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:38.323200 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:38.323200 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:38.323200 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:38.323200 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:38.323200 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:38.323200 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:38.323200 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:38.323200 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:38.323200 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:38.323200 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:38.323200 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:38.323200 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:38.323200 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:38.323200 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:50:38.324041 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:50:38.324041 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:38.324041 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:38.324041 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 225/452] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:50:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:38.324297 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc0c17-6a60-49bc-b26c-317f09505ad6 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:38.335150 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed425d9-fe0b-4346-aa53-169baca1ed70 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8f0f02a607a49e0b88c75019795b726, user_id=d21b84cc38a848de8d19a41e1eb04a58, role_id=9102b6e1623a43e99513d6ad55d55c7b)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:38.336714 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed425d9-fe0b-4346-aa53-169baca1ed70 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:38.417244 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 228/453] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 26 10:50:38 2022] PUT /identity/v3/projects/e8f0f02a607a49e0b88c75019795b726/users/d21b84cc38a848de8d19a41e1eb04a58/roles/9102b6e1623a43e99513d6ad55d55c7b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:50:38.418739 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed425d9-fe0b-4346-aa53-169baca1ed70 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:38.426917 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc0c17-6a60-49bc-b26c-317f09505ad6 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:38.465085 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade46c96-efec-4e9c-82e1-cc3352817b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:38.465734 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade46c96-efec-4e9c-82e1-cc3352817b8f None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:38.466018 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade46c96-efec-4e9c-82e1-cc3352817b8f None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:38.466295 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade46c96-efec-4e9c-82e1-cc3352817b8f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:38.478216 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade46c96-efec-4e9c-82e1-cc3352817b8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:50:38.483757 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-ade46c96-efec-4e9c-82e1-cc3352817b8f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:50:38.483757 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:38.483757 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:38.483757 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:38.483757 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:38.483757 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:38.483757 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:38.483757 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:38.483757 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:38.483757 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:38.483757 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:38.483757 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:38.483757 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:50:38.483757 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:50:38.483757 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:50:38.483757 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:50:38.484997 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:50:38.484997 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:50:38.484997 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:50:38.484997 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:50:38.484997 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:38.484997 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:38.484997 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:38.484997 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:38.484997 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:38.484997 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:38.484997 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:38.484997 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:38.484997 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:38.484997 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:38.484997 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:38.484997 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:38.485802 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:38.485802 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:38.485802 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:38.485802 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:38.485802 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:50:38.485802 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:50:38.485802 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:50:38.485802 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:50:38.485802 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:50:38.485802 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:50:38.485802 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:50:38.485802 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:38.485802 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 226/454] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Oct 26 10:50:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:38.486465 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade46c96-efec-4e9c-82e1-cc3352817b8f None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:38.527036 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:38.547795 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed425d9-fe0b-4346-aa53-169baca1ed70 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:38.553352 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:38.589727 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d442719-acaf-43c8-8b43-c94f96d1d68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:38.590658 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d442719-acaf-43c8-8b43-c94f96d1d68a None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:38.591381 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d442719-acaf-43c8-8b43-c94f96d1d68a None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:38.591665 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d442719-acaf-43c8-8b43-c94f96d1d68a None admin] PATH_INFO: `/v3/users/glance` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:38.599515 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d442719-acaf-43c8-8b43-c94f96d1d68a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:38.600389 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade46c96-efec-4e9c-82e1-cc3352817b8f None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:38.600689 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d442719-acaf-43c8-8b43-c94f96d1d68a None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:38.614389 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-4d442719-acaf-43c8-8b43-c94f96d1d68a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 26 10:50:38.614389 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:38.614389 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:38.614389 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:38.614389 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:38.614389 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:38.614389 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:38.614389 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:38.614389 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:38.614389 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:38.614389 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:38.614389 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:38.614389 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:50:38.614389 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:50:38.614389 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:50:38.614389 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:50:38.615516 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:38.615516 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:38.615516 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:50:38.615516 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:50:38.615516 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:50:38.615516 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:50:38.615516 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:38.615516 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:38.615516 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:38.615516 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:38.615516 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:38.615516 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:38.615516 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:38.615516 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:38.615516 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:38.615516 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:38.615516 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:38.615516 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:38.616746 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:38.616746 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:38.616746 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:50:38.616746 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:50:38.616746 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:50:38.616746 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:50:38.616746 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:50:38.616746 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:50:38.616746 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 26 10:50:38.616746 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:38.619157 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 229/455] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 26 10:50:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:38.620167 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d442719-acaf-43c8-8b43-c94f96d1d68a None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:38.639495 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edecac-415e-450e-8b71-6fcc9608e451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:38.640313 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edecac-415e-450e-8b71-6fcc9608e451 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:38.640789 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edecac-415e-450e-8b71-6fcc9608e451 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:38.641196 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edecac-415e-450e-8b71-6fcc9608e451 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:38.653496 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1edecac-415e-450e-8b71-6fcc9608e451 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:38.655131 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1edecac-415e-450e-8b71-6fcc9608e451 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:38.670596 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-b1edecac-415e-450e-8b71-6fcc9608e451 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:38.670596 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:38.670596 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:38.670596 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:38.670596 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:38.670596 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:38.670596 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:38.670596 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:38.670596 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:38.670596 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:38.670596 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:38.670596 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:38.670596 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:50:38.670596 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:50:38.670596 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:50:38.670596 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:50:38.671684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:38.671684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:38.671684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:38.671684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:38.671684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:38.671684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:38.671684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:38.671684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:38.671684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:38.671684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:38.671684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:38.671684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:38.671684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:38.671684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:38.671684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:38.671684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:38.671684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:50:38.672769 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:50:38.672769 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:38.672769 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:38.677812 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 227/456] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:50:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:38.677812 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edecac-415e-450e-8b71-6fcc9608e451 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:38.738055 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d442719-acaf-43c8-8b43-c94f96d1d68a None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:38.773390 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53655714-0390-469f-9c10-7bbcdd3874c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:38.774006 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53655714-0390-469f-9c10-7bbcdd3874c7 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:38.774290 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53655714-0390-469f-9c10-7bbcdd3874c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:38.774566 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53655714-0390-469f-9c10-7bbcdd3874c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:38.775390 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53655714-0390-469f-9c10-7bbcdd3874c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:38.776030 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53655714-0390-469f-9c10-7bbcdd3874c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:38.777459 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53655714-0390-469f-9c10-7bbcdd3874c7 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:38.786196 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edecac-415e-450e-8b71-6fcc9608e451 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:38.787181 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:38.795224 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 230/457] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:50:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:38.795224 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53655714-0390-469f-9c10-7bbcdd3874c7 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:38.802220 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:38.825506 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa8fb2-8f8f-46fb-b0ea-84c4d941b278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:38.826108 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa8fb2-8f8f-46fb-b0ea-84c4d941b278 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:38.826389 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa8fb2-8f8f-46fb-b0ea-84c4d941b278 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:38.826663 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa8fb2-8f8f-46fb-b0ea-84c4d941b278 None admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:38.827326 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa8fb2-8f8f-46fb-b0ea-84c4d941b278 None admin] RBAC: Adding query filter params (name=service) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:38.827733 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa8fb2-8f8f-46fb-b0ea-84c4d941b278 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:38.829067 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa8fb2-8f8f-46fb-b0ea-84c4d941b278 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:38.842828 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 228/458] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Oct 26 10:50:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:38.842828 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa8fb2-8f8f-46fb-b0ea-84c4d941b278 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:38.906643 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53655714-0390-469f-9c10-7bbcdd3874c7 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:38.943022 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e69b2b-b0f1-45dd-9cf9-b16dd9515d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:38.943535 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e69b2b-b0f1-45dd-9cf9-b16dd9515d77 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:38.943813 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e69b2b-b0f1-45dd-9cf9-b16dd9515d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:38.944098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e69b2b-b0f1-45dd-9cf9-b16dd9515d77 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:38.944818 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e69b2b-b0f1-45dd-9cf9-b16dd9515d77 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:38.945118 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e69b2b-b0f1-45dd-9cf9-b16dd9515d77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:38.946556 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e69b2b-b0f1-45dd-9cf9-b16dd9515d77 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:38.947351 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa8fb2-8f8f-46fb-b0ea-84c4d941b278 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:38.968949 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 231/459] 10.222.0.45 () {56 vars in 1137 bytes} [Wed Oct 26 10:50:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:38.968949 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e69b2b-b0f1-45dd-9cf9-b16dd9515d77 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:38.986362 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7914a9-2b6d-433c-99f6-e075ca7b7b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:38.987072 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7914a9-2b6d-433c-99f6-e075ca7b7b00 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:38.987582 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7914a9-2b6d-433c-99f6-e075ca7b7b00 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:38.987933 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7914a9-2b6d-433c-99f6-e075ca7b7b00 None admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:38.989137 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7914a9-2b6d-433c-99f6-e075ca7b7b00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:38.989468 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7914a9-2b6d-433c-99f6-e075ca7b7b00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:38.990848 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7914a9-2b6d-433c-99f6-e075ca7b7b00 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:39.002352 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 229/460] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:50:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:39.007961 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7914a9-2b6d-433c-99f6-e075ca7b7b00 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:39.029677 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:39.042388 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:39.073755 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e69b2b-b0f1-45dd-9cf9-b16dd9515d77 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:39.110229 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf497b51-b7ad-40ce-9064-82081c61316a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:39.110463 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7914a9-2b6d-433c-99f6-e075ca7b7b00 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:39.110866 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf497b51-b7ad-40ce-9064-82081c61316a None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:39.111149 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf497b51-b7ad-40ce-9064-82081c61316a None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:39.111426 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf497b51-b7ad-40ce-9064-82081c61316a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:39.119364 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf497b51-b7ad-40ce-9064-82081c61316a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:39.120857 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf497b51-b7ad-40ce-9064-82081c61316a None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:39.132289 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-cf497b51-b7ad-40ce-9064-82081c61316a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 26 10:50:39.132289 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:39.132289 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:39.132289 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:39.132289 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:39.132289 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:39.132289 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:39.132289 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:39.132289 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:39.132289 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:39.132289 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:39.132289 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:39.132289 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:50:39.132289 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:50:39.132289 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:50:39.132289 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:50:39.133204 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:39.133204 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:39.133204 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:50:39.133204 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:50:39.133204 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:50:39.133204 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:50:39.133204 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:39.133204 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:39.133204 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:39.133204 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:39.133204 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:39.133204 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:39.133204 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:39.133204 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:39.133204 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:39.133204 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:39.133204 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:39.133204 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:39.134128 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:39.134128 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:39.134128 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:50:39.134128 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:50:39.134128 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:50:39.134128 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:50:39.134128 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:50:39.134128 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:50:39.134128 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 26 10:50:39.134128 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:39.134128 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 232/461] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 26 10:50:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:39.134699 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf497b51-b7ad-40ce-9064-82081c61316a None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:39.149650 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00396660-3554-428e-b6ba-71857a9b6102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:39.150283 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00396660-3554-428e-b6ba-71857a9b6102 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:39.150563 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00396660-3554-428e-b6ba-71857a9b6102 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:39.150836 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00396660-3554-428e-b6ba-71857a9b6102 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:39.161785 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00396660-3554-428e-b6ba-71857a9b6102 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:39.163229 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00396660-3554-428e-b6ba-71857a9b6102 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:39.178437 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-00396660-3554-428e-b6ba-71857a9b6102 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:39.178437 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:39.178437 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:39.178437 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:39.178437 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:39.178437 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:39.178437 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:39.178437 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:39.178437 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:39.178437 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:39.178437 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:39.178437 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:39.178437 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:50:39.178437 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:50:39.178437 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:50:39.178437 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:50:39.179376 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:39.179376 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:39.179376 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:39.179376 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:39.179376 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:39.179376 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:39.179376 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:39.179376 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:39.179376 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:39.179376 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:39.179376 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:39.179376 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:39.179376 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:39.179376 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:39.179376 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:39.179376 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:39.179376 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:50:39.180289 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:50:39.180289 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:39.180289 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:39.180289 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 230/462] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:50:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:39.180289 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00396660-3554-428e-b6ba-71857a9b6102 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:39.243781 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf497b51-b7ad-40ce-9064-82081c61316a None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:39.262825 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:39.266923 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:39.280546 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7eca61-7291-4512-b309-c04cd02a5ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:39.280851 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00396660-3554-428e-b6ba-71857a9b6102 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:39.281215 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7eca61-7291-4512-b309-c04cd02a5ffc None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:39.281556 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7eca61-7291-4512-b309-c04cd02a5ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:39.281837 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7eca61-7291-4512-b309-c04cd02a5ffc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:39.318381 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdcb280-5baa-4f52-929b-733de2c27903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:39.319022 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcb280-5baa-4f52-929b-733de2c27903 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:39.319303 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcb280-5baa-4f52-929b-733de2c27903 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:39.319577 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcb280-5baa-4f52-929b-733de2c27903 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:39.326506 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdcb280-5baa-4f52-929b-733de2c27903 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:39.329620 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdcb280-5baa-4f52-929b-733de2c27903 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:39.345341 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-efdcb280-5baa-4f52-929b-733de2c27903 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:50:39.345341 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:39.345341 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:39.345341 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:39.345341 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:39.345341 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:39.345341 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:39.345341 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:39.345341 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:39.345341 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:39.345341 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:39.345341 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:39.345341 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:50:39.345341 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:50:39.345341 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:50:39.346333 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:50:39.346333 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:39.346333 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:39.346333 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:39.346333 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:39.346333 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:39.346333 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:39.346333 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:39.346333 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:39.346333 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:39.346333 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:39.346333 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:39.346333 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:39.346333 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:39.346333 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:39.346333 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:39.346333 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:39.352113 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:50:39.352113 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:50:39.352113 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:50:39.352113 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:50:39.352113 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:50:39.352113 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:50:39.352113 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:50:39.352113 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:39.352113 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 231/463] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 26 10:50:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:39.352113 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdcb280-5baa-4f52-929b-733de2c27903 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:39.373584 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7eca61-7291-4512-b309-c04cd02a5ffc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:39.375131 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7eca61-7291-4512-b309-c04cd02a5ffc None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:39.450166 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdcb280-5baa-4f52-929b-733de2c27903 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:39.480816 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 233/464] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 26 10:50:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 26 10:50:39.481498 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7eca61-7291-4512-b309-c04cd02a5ffc None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:39.489403 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c54fc-aef5-4af7-b7af-93f7eb329870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:39.490542 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c54fc-aef5-4af7-b7af-93f7eb329870 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:39.490919 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c54fc-aef5-4af7-b7af-93f7eb329870 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:39.491292 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c54fc-aef5-4af7-b7af-93f7eb329870 None admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:39.492497 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c54fc-aef5-4af7-b7af-93f7eb329870 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:39.492926 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c54fc-aef5-4af7-b7af-93f7eb329870 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:39.494829 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c54fc-aef5-4af7-b7af-93f7eb329870 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:39.500470 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:39.513254 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 232/465] 10.222.0.45 () {56 vars in 1137 bytes} [Wed Oct 26 10:50:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:39.518519 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c54fc-aef5-4af7-b7af-93f7eb329870 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:39.523426 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:39.587529 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7eca61-7291-4512-b309-c04cd02a5ffc None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:39.621315 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c54fc-aef5-4af7-b7af-93f7eb329870 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:39.626325 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13cb99-e888-40f6-b01a-2d758f017ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:39.627003 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13cb99-e888-40f6-b01a-2d758f017ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:39.627360 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13cb99-e888-40f6-b01a-2d758f017ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:39.627695 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13cb99-e888-40f6-b01a-2d758f017ca7 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:39.628444 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13cb99-e888-40f6-b01a-2d758f017ca7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:39.628808 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13cb99-e888-40f6-b01a-2d758f017ca7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:39.630730 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13cb99-e888-40f6-b01a-2d758f017ca7 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:39.644106 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 234/466] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:39.649133 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13cb99-e888-40f6-b01a-2d758f017ca7 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:39.660536 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c8087-2bf8-4520-bba5-8089a5dc063c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:39.662160 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c8087-2bf8-4520-bba5-8089a5dc063c None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:39.662450 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c8087-2bf8-4520-bba5-8089a5dc063c None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:39.662759 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c8087-2bf8-4520-bba5-8089a5dc063c None admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:39.663710 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c8087-2bf8-4520-bba5-8089a5dc063c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:39.664019 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c8087-2bf8-4520-bba5-8089a5dc063c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:39.666176 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c8087-2bf8-4520-bba5-8089a5dc063c None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:39.679476 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 233/467] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 26 10:50:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:39.680419 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c8087-2bf8-4520-bba5-8089a5dc063c None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:39.736125 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:39.757222 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:39.757528 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13cb99-e888-40f6-b01a-2d758f017ca7 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:39.788285 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c8087-2bf8-4520-bba5-8089a5dc063c None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:39.793819 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb1f4b-66b8-4577-9a42-2fb087aab41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:39.794457 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb1f4b-66b8-4577-9a42-2fb087aab41f None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:39.794740 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb1f4b-66b8-4577-9a42-2fb087aab41f None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:39.795014 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb1f4b-66b8-4577-9a42-2fb087aab41f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:39.806170 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb1f4b-66b8-4577-9a42-2fb087aab41f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:39.807637 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb1f4b-66b8-4577-9a42-2fb087aab41f None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:39.822503 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982cff8c-07c6-411a-b5d0-0e79d30552f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:39.823052 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-4dcb1f4b-66b8-4577-9a42-2fb087aab41f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:39.823052 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:39.823052 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:39.823052 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:39.823052 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:39.823052 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:39.823052 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:39.823052 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:39.823052 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:39.823052 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:39.823052 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:39.823052 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:39.823052 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:50:39.823052 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:50:39.823052 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:50:39.823052 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:50:39.823951 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:39.823951 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:39.823951 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:39.823951 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:39.823951 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:39.823951 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:39.823951 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:39.823951 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:39.823951 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:39.823951 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:39.823951 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:39.823951 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:39.823951 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:39.823951 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:39.823951 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:39.823951 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:39.823951 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:50:39.832987 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:50:39.832987 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:39.832987 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:39.833190 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cff8c-07c6-411a-b5d0-0e79d30552f6 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:39.833190 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cff8c-07c6-411a-b5d0-0e79d30552f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:39.833190 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cff8c-07c6-411a-b5d0-0e79d30552f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:39.833402 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 235/468] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:50:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:39.833402 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb1f4b-66b8-4577-9a42-2fb087aab41f None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:39.900259 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982cff8c-07c6-411a-b5d0-0e79d30552f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:39.901724 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982cff8c-07c6-411a-b5d0-0e79d30552f6 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:39.945593 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb1f4b-66b8-4577-9a42-2fb087aab41f None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:39.963589 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:39.980828 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:39.986819 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922147cb-be5a-4d46-8aaa-945e067e1ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:39.987480 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922147cb-be5a-4d46-8aaa-945e067e1ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:39.987766 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922147cb-be5a-4d46-8aaa-945e067e1ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:39.988046 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922147cb-be5a-4d46-8aaa-945e067e1ee5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:39.995785 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922147cb-be5a-4d46-8aaa-945e067e1ee5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:39.997271 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922147cb-be5a-4d46-8aaa-945e067e1ee5 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:40.006365 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 234/469] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 26 10:50:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 26 10:50:40.007439 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982cff8c-07c6-411a-b5d0-0e79d30552f6 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:40.008948 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-922147cb-be5a-4d46-8aaa-945e067e1ee5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 26 10:50:40.008948 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:40.008948 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:40.008948 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:40.008948 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:40.008948 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:40.008948 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:40.008948 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:40.008948 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:40.008948 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:40.008948 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:40.008948 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:40.008948 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:50:40.008948 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:50:40.008948 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:50:40.008948 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:50:40.010047 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:40.010047 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:40.010047 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:50:40.010047 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:50:40.010047 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:50:40.010047 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:50:40.010047 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:40.010047 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:40.010047 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:40.010047 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:40.010047 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:40.010047 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:40.010047 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:40.010047 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:40.010047 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:40.010047 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:40.010047 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:40.010047 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:40.010926 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:40.010926 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:40.010926 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:50:40.010926 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:50:40.010926 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:50:40.010926 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:50:40.010926 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:50:40.010926 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:50:40.010926 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 26 10:50:40.010926 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:40.010926 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 236/470] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Oct 26 10:50:39 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:40.010926 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922147cb-be5a-4d46-8aaa-945e067e1ee5 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:40.120611 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922147cb-be5a-4d46-8aaa-945e067e1ee5 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:40.125006 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982cff8c-07c6-411a-b5d0-0e79d30552f6 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:40.155921 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1571a7c-dc80-45b0-b892-d18def192651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:40.156582 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1571a7c-dc80-45b0-b892-d18def192651 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:40.156863 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1571a7c-dc80-45b0-b892-d18def192651 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:40.157139 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1571a7c-dc80-45b0-b892-d18def192651 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:40.157784 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1571a7c-dc80-45b0-b892-d18def192651 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:40.158088 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1571a7c-dc80-45b0-b892-d18def192651 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:40.159481 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1571a7c-dc80-45b0-b892-d18def192651 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:40.163393 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb56daa-f178-4dac-90c7-4ed95f43797e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:40.164228 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb56daa-f178-4dac-90c7-4ed95f43797e None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:40.164699 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb56daa-f178-4dac-90c7-4ed95f43797e None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:40.165149 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb56daa-f178-4dac-90c7-4ed95f43797e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:40.166043 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb56daa-f178-4dac-90c7-4ed95f43797e None admin] RBAC: Adding query filter params (role.id=9102b6e1623a43e99513d6ad55d55c7b, scope.project.id=e8f0f02a607a49e0b88c75019795b726, user.id=a852a777cb6a4863bebdb949cc71ea65) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:40.166782 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb56daa-f178-4dac-90c7-4ed95f43797e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:40.168390 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb56daa-f178-4dac-90c7-4ed95f43797e None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:40.172999 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 237/471] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:40.173824 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1571a7c-dc80-45b0-b892-d18def192651 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:40.188115 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 235/472] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 26 10:50:40 2022] GET /identity/v3/role_assignments?user.id=a852a777cb6a4863bebdb949cc71ea65&scope.project.id=e8f0f02a607a49e0b88c75019795b726&role.id=9102b6e1623a43e99513d6ad55d55c7b => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:40.188115 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb56daa-f178-4dac-90c7-4ed95f43797e None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:40.222007 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:40.253045 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:40.307668 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb56daa-f178-4dac-90c7-4ed95f43797e None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:40.329976 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1571a7c-dc80-45b0-b892-d18def192651 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:40.357999 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511cbab0-f0e1-42de-a7bb-c85670006d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:40.358624 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511cbab0-f0e1-42de-a7bb-c85670006d14 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:40.358907 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511cbab0-f0e1-42de-a7bb-c85670006d14 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:40.359182 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511cbab0-f0e1-42de-a7bb-c85670006d14 None admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:40.359931 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511cbab0-f0e1-42de-a7bb-c85670006d14 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:40.360263 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511cbab0-f0e1-42de-a7bb-c85670006d14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:40.361728 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511cbab0-f0e1-42de-a7bb-c85670006d14 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:40.385163 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f008c-b8ae-4ce5-8d38-d3a3eba8dbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:40.385992 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 236/473] 10.222.0.45 () {56 vars in 1139 bytes} [Wed Oct 26 10:50:40 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:40.386464 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f008c-b8ae-4ce5-8d38-d3a3eba8dbbe None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:40.386928 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511cbab0-f0e1-42de-a7bb-c85670006d14 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:40.387136 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f008c-b8ae-4ce5-8d38-d3a3eba8dbbe None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:40.387430 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f008c-b8ae-4ce5-8d38-d3a3eba8dbbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:40.401928 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f008c-b8ae-4ce5-8d38-d3a3eba8dbbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:40.403669 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f008c-b8ae-4ce5-8d38-d3a3eba8dbbe None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:40.427110 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-cf3f008c-b8ae-4ce5-8d38-d3a3eba8dbbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:40.427110 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:40.427110 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:40.427110 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:40.427110 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:40.427110 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:40.427110 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:40.427110 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:40.427110 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:40.427110 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:40.427110 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:40.427110 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:40.427110 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:50:40.427110 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:50:40.427110 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:50:40.427110 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:50:40.428105 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:40.428105 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:40.428105 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:40.428105 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:40.428105 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:40.428105 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:40.428105 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:40.428105 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:40.428105 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:40.428105 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:40.428105 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:40.428105 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:40.428105 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:40.428105 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:40.428105 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:40.428105 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:40.428105 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:50:40.428968 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:50:40.428968 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:40.428968 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:40.429570 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 238/474] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:50:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:40.430183 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f008c-b8ae-4ce5-8d38-d3a3eba8dbbe None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:40.501061 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:40.519386 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511cbab0-f0e1-42de-a7bb-c85670006d14 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:40.549276 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f008c-b8ae-4ce5-8d38-d3a3eba8dbbe None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:40.552361 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:40.565717 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76bfb8-817b-4e1c-bdc1-750ac04e6088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:40.566284 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76bfb8-817b-4e1c-bdc1-750ac04e6088 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:40.566571 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76bfb8-817b-4e1c-bdc1-750ac04e6088 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:40.567061 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76bfb8-817b-4e1c-bdc1-750ac04e6088 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:40.575734 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76bfb8-817b-4e1c-bdc1-750ac04e6088 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:40.577501 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76bfb8-817b-4e1c-bdc1-750ac04e6088 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:40.591525 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b74e8-dd38-448a-8c43-8e0ec671db7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:40.592511 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b74e8-dd38-448a-8c43-8e0ec671db7b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:40.592874 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-0f76bfb8-817b-4e1c-bdc1-750ac04e6088 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:50:40.592874 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:40.592874 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:40.592874 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:40.592874 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:40.592874 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:40.592874 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:40.592874 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:40.592874 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:40.592874 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:40.592874 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:40.592874 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:40.592874 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:50:40.592874 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:50:40.592874 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:50:40.593724 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:50:40.593724 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:40.593724 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:40.593724 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:40.593724 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:40.593724 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:40.593724 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:40.593724 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:40.593724 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:40.593724 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:40.593724 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:40.593724 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:40.593724 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:40.593724 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:40.593724 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:40.593724 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:40.593724 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:40.594587 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:50:40.594587 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:50:40.594587 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:50:40.594587 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:50:40.594587 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:50:40.594587 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:50:40.594587 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:50:40.594587 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:40.594587 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 237/475] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 26 10:50:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:40.595468 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76bfb8-817b-4e1c-bdc1-750ac04e6088 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:40.595953 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b74e8-dd38-448a-8c43-8e0ec671db7b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:40.596443 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b74e8-dd38-448a-8c43-8e0ec671db7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:40.669260 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581b74e8-dd38-448a-8c43-8e0ec671db7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:40.670753 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581b74e8-dd38-448a-8c43-8e0ec671db7b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:40.710650 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76bfb8-817b-4e1c-bdc1-750ac04e6088 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:40.752781 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e3311-7687-4f15-8427-b1d547da44ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:40.753657 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e3311-7687-4f15-8427-b1d547da44ba None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:40.754835 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e3311-7687-4f15-8427-b1d547da44ba None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:40.755139 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e3311-7687-4f15-8427-b1d547da44ba None admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:40.755870 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798e3311-7687-4f15-8427-b1d547da44ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:40.758668 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798e3311-7687-4f15-8427-b1d547da44ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:40.758668 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798e3311-7687-4f15-8427-b1d547da44ba None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:40.774229 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 238/476] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:40.774229 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e3311-7687-4f15-8427-b1d547da44ba None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:40.780032 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:40.784369 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 239/477] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 26 10:50:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 26 10:50:40.786574 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5e6ff-4225-453d-a3f5-7bab65a54f93 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:40.786866 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5e6ff-4225-453d-a3f5-7bab65a54f93 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:40.787144 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5e6ff-4225-453d-a3f5-7bab65a54f93 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:40.788545 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 240/478] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:50:40.792841 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5e6ff-4225-453d-a3f5-7bab65a54f93 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:40.810549 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:40.881482 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e3311-7687-4f15-8427-b1d547da44ba None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:40.903305 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5e6ff-4225-453d-a3f5-7bab65a54f93 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:40.916197 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ba425-4d74-4648-8cf8-5601c5248cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:40.917057 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ba425-4d74-4648-8cf8-5601c5248cfd None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:40.917342 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ba425-4d74-4648-8cf8-5601c5248cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:40.917607 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ba425-4d74-4648-8cf8-5601c5248cfd None admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:40.918299 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ba425-4d74-4648-8cf8-5601c5248cfd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:40.918602 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ba425-4d74-4648-8cf8-5601c5248cfd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:40.920038 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ba425-4d74-4648-8cf8-5601c5248cfd None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:40.931351 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 239/479] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 26 10:50:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:40.932196 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ba425-4d74-4648-8cf8-5601c5248cfd None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:40.949555 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0796af51-5f7d-4575-a568-cb846aa92f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:40.950460 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796af51-5f7d-4575-a568-cb846aa92f98 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:40.950923 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796af51-5f7d-4575-a568-cb846aa92f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:40.951617 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796af51-5f7d-4575-a568-cb846aa92f98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:40.959164 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0796af51-5f7d-4575-a568-cb846aa92f98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:40.960698 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0796af51-5f7d-4575-a568-cb846aa92f98 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:40.971921 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-0796af51-5f7d-4575-a568-cb846aa92f98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:50:40.971921 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:40.971921 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:40.971921 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:40.971921 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:40.971921 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:40.971921 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:40.971921 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:40.971921 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:40.971921 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:40.971921 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:40.971921 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:40.971921 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:50:40.971921 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:50:40.971921 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:50:40.972791 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:50:40.972791 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:40.972791 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:40.972791 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:40.972791 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:40.972791 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:40.972791 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:40.972791 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:40.972791 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:40.972791 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:40.972791 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:40.972791 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:40.972791 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:40.972791 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:40.972791 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:40.972791 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:40.972791 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:40.975006 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:50:40.975006 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:50:40.975006 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:50:40.975006 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:50:40.975006 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:50:40.975006 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:50:40.975006 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:50:40.975006 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:40.975006 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 241/480] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 26 10:50:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:40.975484 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ddf3ef-76f7-4ff7-8637-33792483ae32 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:40.975484 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ddf3ef-76f7-4ff7-8637-33792483ae32 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:40.975778 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ddf3ef-76f7-4ff7-8637-33792483ae32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:40.994185 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-f4ddf3ef-76f7-4ff7-8637-33792483ae32 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:40.995390 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f4ddf3ef-76f7-4ff7-8637-33792483ae32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:41.006903 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:41.043603 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ba425-4d74-4648-8cf8-5601c5248cfd None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:41.055996 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:41.076204 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 242/481] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:50:41.077140 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ddf3ef-76f7-4ff7-8637-33792483ae32 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:41.078273 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed160ceb-64f0-4a27-8544-50b87262deaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:41.078909 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed160ceb-64f0-4a27-8544-50b87262deaf None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:41.079190 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed160ceb-64f0-4a27-8544-50b87262deaf None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:41.079472 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed160ceb-64f0-4a27-8544-50b87262deaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:41.090984 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed160ceb-64f0-4a27-8544-50b87262deaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:41.092465 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed160ceb-64f0-4a27-8544-50b87262deaf None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:41.106981 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-ed160ceb-64f0-4a27-8544-50b87262deaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:41.106981 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:41.106981 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:41.106981 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:41.106981 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:41.106981 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:41.106981 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:41.106981 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:41.106981 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:41.106981 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:41.106981 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:41.106981 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:41.106981 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:50:41.106981 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:50:41.106981 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:50:41.106981 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:50:41.107896 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:41.107896 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:41.107896 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:41.107896 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:41.107896 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:41.107896 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:41.107896 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:41.107896 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:41.107896 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:41.107896 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:41.107896 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:41.107896 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:41.107896 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:41.107896 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:41.107896 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:41.107896 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:41.107896 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:50:41.108872 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:50:41.108872 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:41.108872 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:41.112595 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 240/482] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:50:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:41.113441 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed160ceb-64f0-4a27-8544-50b87262deaf None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:41.212956 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ddf3ef-76f7-4ff7-8637-33792483ae32 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:41.232357 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed160ceb-64f0-4a27-8544-50b87262deaf None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:41.255798 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862b3ba-aef0-4a06-b22c-a9919eb30c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:41.256435 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862b3ba-aef0-4a06-b22c-a9919eb30c9d None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:41.256717 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862b3ba-aef0-4a06-b22c-a9919eb30c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:41.256990 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862b3ba-aef0-4a06-b22c-a9919eb30c9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:41.257713 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862b3ba-aef0-4a06-b22c-a9919eb30c9d None admin] RBAC: Adding query filter params (role.id=9102b6e1623a43e99513d6ad55d55c7b, scope.project.id=e8f0f02a607a49e0b88c75019795b726, user.id=29d0e8cc074b4e36acc2162aebeac169) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:41.258020 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862b3ba-aef0-4a06-b22c-a9919eb30c9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:41.259447 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862b3ba-aef0-4a06-b22c-a9919eb30c9d None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:41.261269 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:41.269349 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 243/483] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 26 10:50:41 2022] GET /identity/v3/role_assignments?user.id=29d0e8cc074b4e36acc2162aebeac169&scope.project.id=e8f0f02a607a49e0b88c75019795b726&role.id=9102b6e1623a43e99513d6ad55d55c7b => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:41.269349 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862b3ba-aef0-4a06-b22c-a9919eb30c9d None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:41.301831 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3cbb3-7768-4ee6-bf08-132513d2b1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:41.302521 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3cbb3-7768-4ee6-bf08-132513d2b1fe None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:41.302800 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3cbb3-7768-4ee6-bf08-132513d2b1fe None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:41.303120 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3cbb3-7768-4ee6-bf08-132513d2b1fe None admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:41.303878 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3cbb3-7768-4ee6-bf08-132513d2b1fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:41.304221 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3cbb3-7768-4ee6-bf08-132513d2b1fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:41.307620 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3cbb3-7768-4ee6-bf08-132513d2b1fe None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:41.331539 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 241/484] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 26 10:50:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:41.344116 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3cbb3-7768-4ee6-bf08-132513d2b1fe None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:41.368292 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:41.421764 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862b3ba-aef0-4a06-b22c-a9919eb30c9d None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:41.464486 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbe505-ecf6-4d7b-8691-22cc1a85d8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:41.465457 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbe505-ecf6-4d7b-8691-22cc1a85d8c5 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:41.465943 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbe505-ecf6-4d7b-8691-22cc1a85d8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:41.466441 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbe505-ecf6-4d7b-8691-22cc1a85d8c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:41.467301 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfbe505-ecf6-4d7b-8691-22cc1a85d8c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:41.467830 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfbe505-ecf6-4d7b-8691-22cc1a85d8c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:41.469500 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfbe505-ecf6-4d7b-8691-22cc1a85d8c5 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:41.478610 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3cbb3-7768-4ee6-bf08-132513d2b1fe None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:41.485897 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 244/485] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:41.487147 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbe505-ecf6-4d7b-8691-22cc1a85d8c5 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:41.522980 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d5d39-2a1d-48b2-b08e-346c60db9980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:41.523775 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d5d39-2a1d-48b2-b08e-346c60db9980 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:41.524131 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d5d39-2a1d-48b2-b08e-346c60db9980 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:41.524550 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d5d39-2a1d-48b2-b08e-346c60db9980 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:41.525434 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07d5d39-2a1d-48b2-b08e-346c60db9980 None admin] RBAC: Adding query filter params (role.id=9102b6e1623a43e99513d6ad55d55c7b, scope.project.id=e8f0f02a607a49e0b88c75019795b726, user.id=c06f827607194b6dbd196a8fbf717b05) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:41.526031 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07d5d39-2a1d-48b2-b08e-346c60db9980 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:41.527950 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07d5d39-2a1d-48b2-b08e-346c60db9980 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:41.536932 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 242/486] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 26 10:50:41 2022] GET /identity/v3/role_assignments?user.id=c06f827607194b6dbd196a8fbf717b05&scope.project.id=e8f0f02a607a49e0b88c75019795b726&role.id=9102b6e1623a43e99513d6ad55d55c7b => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:50:41.537818 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d5d39-2a1d-48b2-b08e-346c60db9980 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:41.612631 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:41.635078 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbe505-ecf6-4d7b-8691-22cc1a85d8c5 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:41.655200 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:41.675682 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baddfd07-0dae-43fe-9dc5-4e24e4b9058a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:41.676423 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baddfd07-0dae-43fe-9dc5-4e24e4b9058a None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:41.676709 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baddfd07-0dae-43fe-9dc5-4e24e4b9058a None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:41.676986 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baddfd07-0dae-43fe-9dc5-4e24e4b9058a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:41.693466 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baddfd07-0dae-43fe-9dc5-4e24e4b9058a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:50:41.699997 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-baddfd07-0dae-43fe-9dc5-4e24e4b9058a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:50:41.699997 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:41.699997 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:41.699997 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:41.699997 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:41.699997 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:41.699997 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:41.699997 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:41.699997 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:41.699997 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:41.699997 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:41.699997 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:41.699997 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:50:41.699997 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:50:41.699997 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:50:41.699997 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:50:41.701029 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:50:41.701029 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:50:41.701029 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:50:41.701029 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:50:41.701029 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:41.701029 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:41.701029 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:41.701029 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:41.701029 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:41.701029 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:41.701029 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:41.701029 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:41.701029 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:41.701029 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:41.701029 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:41.701029 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:41.701849 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:41.701849 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:41.701849 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:41.701849 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:41.701849 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:50:41.701849 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:50:41.701849 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:50:41.701849 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:50:41.701849 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:50:41.701849 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:50:41.701849 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:50:41.701849 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:41.705692 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 245/487] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Oct 26 10:50:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:41.708667 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d5d39-2a1d-48b2-b08e-346c60db9980 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:41.711706 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baddfd07-0dae-43fe-9dc5-4e24e4b9058a None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:41.775382 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f747bbfd-e120-48b4-8761-7c8e5615e91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:41.776052 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747bbfd-e120-48b4-8761-7c8e5615e91f None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:41.776412 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747bbfd-e120-48b4-8761-7c8e5615e91f None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:41.776691 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747bbfd-e120-48b4-8761-7c8e5615e91f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:41.785301 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f747bbfd-e120-48b4-8761-7c8e5615e91f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:41.787510 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f747bbfd-e120-48b4-8761-7c8e5615e91f None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:41.799972 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-f747bbfd-e120-48b4-8761-7c8e5615e91f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:50:41.799972 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:41.799972 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:41.799972 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:41.799972 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:41.799972 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:41.799972 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:41.799972 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:41.799972 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:41.799972 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:41.799972 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:41.799972 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:41.799972 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:50:41.799972 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:50:41.799972 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:50:41.800891 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:50:41.800891 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:41.800891 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:41.800891 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:41.800891 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:41.800891 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:41.800891 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:41.800891 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:41.800891 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:41.800891 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:41.800891 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:41.800891 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:41.800891 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:41.800891 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:41.800891 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:41.800891 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:41.800891 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:41.801848 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:50:41.801848 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:50:41.801848 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:50:41.801848 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:50:41.801848 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:50:41.801848 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:50:41.801848 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:50:41.801848 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:41.802715 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 243/488] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 26 10:50:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:41.808008 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f747bbfd-e120-48b4-8761-7c8e5615e91f None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:41.854510 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baddfd07-0dae-43fe-9dc5-4e24e4b9058a None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:41.892283 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dfb529-39ce-42a1-adb8-9e748d191684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:41.893320 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfb529-39ce-42a1-adb8-9e748d191684 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:41.893828 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfb529-39ce-42a1-adb8-9e748d191684 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:41.894304 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfb529-39ce-42a1-adb8-9e748d191684 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:41.895786 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dfb529-39ce-42a1-adb8-9e748d191684 None admin] RBAC: Adding query filter params (name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:41.896317 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dfb529-39ce-42a1-adb8-9e748d191684 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:41.898015 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dfb529-39ce-42a1-adb8-9e748d191684 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:41.909161 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 246/489] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Oct 26 10:50:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:41.914797 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dfb529-39ce-42a1-adb8-9e748d191684 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:41.920471 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f747bbfd-e120-48b4-8761-7c8e5615e91f None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:41.922085 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:41.958988 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64f120-738b-4da6-b13f-962c59776220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:41.959698 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64f120-738b-4da6-b13f-962c59776220 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:41.959986 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64f120-738b-4da6-b13f-962c59776220 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:41.960290 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64f120-738b-4da6-b13f-962c59776220 None admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:41.961285 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:41.961826 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64f120-738b-4da6-b13f-962c59776220 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:41.962293 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64f120-738b-4da6-b13f-962c59776220 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:41.963955 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64f120-738b-4da6-b13f-962c59776220 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:41.977721 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 244/490] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 26 10:50:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:50:41.984596 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64f120-738b-4da6-b13f-962c59776220 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:42.055937 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dfb529-39ce-42a1-adb8-9e748d191684 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:42.124812 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e313ab3-6d99-4861-8fa5-90fcc57df31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:42.125606 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e313ab3-6d99-4861-8fa5-90fcc57df31e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:42.126094 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e313ab3-6d99-4861-8fa5-90fcc57df31e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:42.127511 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e313ab3-6d99-4861-8fa5-90fcc57df31e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:42.148162 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e313ab3-6d99-4861-8fa5-90fcc57df31e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:42.149925 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e313ab3-6d99-4861-8fa5-90fcc57df31e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:42.175255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-8e313ab3-6d99-4861-8fa5-90fcc57df31e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:42.175255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:42.175255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:42.175255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:42.175255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:42.175255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:42.175255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:42.175255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:42.175255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:42.175255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:42.175255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:42.175255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:42.175255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:50:42.175255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:50:42.175255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:50:42.175255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:50:42.177239 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:42.177239 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:42.177239 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:42.177239 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:42.177239 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:42.177239 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:42.177239 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:42.177239 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:42.177239 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:42.177239 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:42.177239 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:42.177239 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:42.177239 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:42.177239 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:42.177239 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:42.177239 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:42.177239 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:50:42.178333 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:50:42.178333 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:42.178333 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:42.180204 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64f120-738b-4da6-b13f-962c59776220 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:42.190737 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 247/491] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:50:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:42.196151 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e313ab3-6d99-4861-8fa5-90fcc57df31e None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:42.264799 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871e620-b617-48f5-9cf9-545b6632b63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:42.265433 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871e620-b617-48f5-9cf9-545b6632b63d None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:42.265724 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871e620-b617-48f5-9cf9-545b6632b63d None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:42.266008 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871e620-b617-48f5-9cf9-545b6632b63d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:42.266750 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871e620-b617-48f5-9cf9-545b6632b63d None admin] RBAC: Adding query filter params (role.id=9102b6e1623a43e99513d6ad55d55c7b, scope.project.id=e8f0f02a607a49e0b88c75019795b726, user.id=522b4232cb4d430988d76a1cdb281e72) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:42.267062 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871e620-b617-48f5-9cf9-545b6632b63d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:42.268530 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871e620-b617-48f5-9cf9-545b6632b63d None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:42.280965 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 245/492] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 26 10:50:41 2022] GET /identity/v3/role_assignments?user.id=522b4232cb4d430988d76a1cdb281e72&scope.project.id=e8f0f02a607a49e0b88c75019795b726&role.id=9102b6e1623a43e99513d6ad55d55c7b => generated 608 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:42.309929 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:42.316180 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e313ab3-6d99-4861-8fa5-90fcc57df31e None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:42.366480 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab6bcf-8160-4b36-9bf8-8b9732a6f109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:42.367273 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab6bcf-8160-4b36-9bf8-8b9732a6f109 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:42.367795 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab6bcf-8160-4b36-9bf8-8b9732a6f109 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:42.372591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab6bcf-8160-4b36-9bf8-8b9732a6f109 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:42.373540 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ab6bcf-8160-4b36-9bf8-8b9732a6f109 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:42.374004 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ab6bcf-8160-4b36-9bf8-8b9732a6f109 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:42.375552 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ab6bcf-8160-4b36-9bf8-8b9732a6f109 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:42.389688 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 248/493] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:50:42.395236 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871e620-b617-48f5-9cf9-545b6632b63d None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:42.450266 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:42.558678 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871e620-b617-48f5-9cf9-545b6632b63d None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:42.600858 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3f94e-b49c-4653-aca4-fcc3d10ba1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:42.601571 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3f94e-b49c-4653-aca4-fcc3d10ba1c7 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:42.601958 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3f94e-b49c-4653-aca4-fcc3d10ba1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:42.602337 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3f94e-b49c-4653-aca4-fcc3d10ba1c7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:42.610493 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d3f94e-b49c-4653-aca4-fcc3d10ba1c7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:42.614600 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae0266-494e-425a-93bf-14f53c13c2f1 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:42.614600 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae0266-494e-425a-93bf-14f53c13c2f1 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:42.614600 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae0266-494e-425a-93bf-14f53c13c2f1 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:42.614875 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d3f94e-b49c-4653-aca4-fcc3d10ba1c7 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:42.615176 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 249/494] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:50:42.620267 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7244ed-e649-4c30-85b7-90f70a9acd15 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:42.620658 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7244ed-e649-4c30-85b7-90f70a9acd15 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:42.621040 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7244ed-e649-4c30-85b7-90f70a9acd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:42.627430 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-a4d3f94e-b49c-4653-aca4-fcc3d10ba1c7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 26 10:50:42.627430 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:42.627430 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:42.627430 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:42.627430 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:42.627430 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:42.627430 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:42.627430 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:42.627430 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:42.627430 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:42.627430 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:42.627430 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:42.627430 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:50:42.627430 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:50:42.627430 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:50:42.627430 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:50:42.628589 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:42.628589 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:42.628589 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:50:42.628589 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:50:42.628589 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:50:42.628589 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:50:42.628589 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:42.628589 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:42.628589 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:42.628589 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:42.628589 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:42.628589 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:42.628589 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:42.628589 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:42.628589 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:42.628589 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:42.628589 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:42.628589 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:42.629798 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:42.629798 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:42.629798 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:50:42.629798 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:50:42.629798 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:50:42.629798 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:50:42.629798 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:50:42.629798 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:50:42.629798 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 26 10:50:42.629798 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:42.632007 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 246/495] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 26 10:50:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:42.637997 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3f94e-b49c-4653-aca4-fcc3d10ba1c7 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:42.646182 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-af7244ed-e649-4c30-85b7-90f70a9acd15 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:42.647212 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-af7244ed-e649-4c30-85b7-90f70a9acd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:42.722911 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 250/496] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:50:42.783971 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:42.803234 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3f94e-b49c-4653-aca4-fcc3d10ba1c7 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:42.851666 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307622a-ea50-42e3-bd18-311916ce5b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:42.852231 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307622a-ea50-42e3-bd18-311916ce5b14 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:42.852519 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307622a-ea50-42e3-bd18-311916ce5b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:42.852797 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307622a-ea50-42e3-bd18-311916ce5b14 None admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:42.853524 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e307622a-ea50-42e3-bd18-311916ce5b14 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:42.853833 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e307622a-ea50-42e3-bd18-311916ce5b14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:42.855267 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e307622a-ea50-42e3-bd18-311916ce5b14 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:42.874927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 247/497] 10.222.0.45 () {56 vars in 1135 bytes} [Wed Oct 26 10:50:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:42.880463 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7244ed-e649-4c30-85b7-90f70a9acd15 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:43.001995 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:43.026927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7244ed-e649-4c30-85b7-90f70a9acd15 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:43.031074 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307622a-ea50-42e3-bd18-311916ce5b14 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:43.104358 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773e2b6-c365-4666-938c-4bf61908cdf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:43.104909 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773e2b6-c365-4666-938c-4bf61908cdf0 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:43.105192 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773e2b6-c365-4666-938c-4bf61908cdf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:43.105467 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773e2b6-c365-4666-938c-4bf61908cdf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:43.221348 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307622a-ea50-42e3-bd18-311916ce5b14 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:43.232389 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4773e2b6-c365-4666-938c-4bf61908cdf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:43.234134 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4773e2b6-c365-4666-938c-4bf61908cdf0 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:43.278103 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd9df4-7ed6-4125-b24d-a4ccf94bbdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:43.278735 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd9df4-7ed6-4125-b24d-a4ccf94bbdcd None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:43.279034 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd9df4-7ed6-4125-b24d-a4ccf94bbdcd None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:43.279635 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd9df4-7ed6-4125-b24d-a4ccf94bbdcd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:43.303600 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd9df4-7ed6-4125-b24d-a4ccf94bbdcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:50:43.308685 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-d4cd9df4-7ed6-4125-b24d-a4ccf94bbdcd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:50:43.308685 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:43.308685 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:43.308685 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:43.308685 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:43.308685 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:43.308685 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:43.308685 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:43.308685 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:43.308685 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:43.308685 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:43.308685 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:43.308685 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:50:43.308685 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:50:43.308685 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:50:43.308685 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:50:43.309599 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:50:43.309599 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:50:43.309599 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:50:43.309599 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:50:43.309599 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:43.309599 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:43.309599 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:43.309599 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:43.309599 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:43.309599 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:43.309599 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:43.309599 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:43.309599 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:43.309599 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:43.309599 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:43.309599 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:43.310427 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:43.310427 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:43.310427 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:43.310427 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:43.310427 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:50:43.310427 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:50:43.310427 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:50:43.310427 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:50:43.310427 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:50:43.310427 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:50:43.310427 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:50:43.310427 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:43.310427 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 248/498] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 26 10:50:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:50:43.325760 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd9df4-7ed6-4125-b24d-a4ccf94bbdcd None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:43.330135 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:43.338930 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:43.373632 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 251/499] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 26 10:50:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 26 10:50:43.381053 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773e2b6-c365-4666-938c-4bf61908cdf0 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:43.454264 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd9df4-7ed6-4125-b24d-a4ccf94bbdcd None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:43.491900 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773e2b6-c365-4666-938c-4bf61908cdf0 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:43.499246 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a478fc7-3026-4865-925b-965fc4d662b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:43.499944 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a478fc7-3026-4865-925b-965fc4d662b4 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:43.500303 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a478fc7-3026-4865-925b-965fc4d662b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:43.500862 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a478fc7-3026-4865-925b-965fc4d662b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:43.501327 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a478fc7-3026-4865-925b-965fc4d662b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:43.501637 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a478fc7-3026-4865-925b-965fc4d662b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:43.503337 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a478fc7-3026-4865-925b-965fc4d662b4 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:43.525094 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 249/500] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 26 10:50:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:43.531969 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a478fc7-3026-4865-925b-965fc4d662b4 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:43.534283 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d01b3-b3cc-47ab-bad3-25a6c778a5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:43.535109 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d01b3-b3cc-47ab-bad3-25a6c778a5d4 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:43.535542 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d01b3-b3cc-47ab-bad3-25a6c778a5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:43.536083 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d01b3-b3cc-47ab-bad3-25a6c778a5d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:43.547485 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d01b3-b3cc-47ab-bad3-25a6c778a5d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:43.549179 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d01b3-b3cc-47ab-bad3-25a6c778a5d4 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:43.565070 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-239d01b3-b3cc-47ab-bad3-25a6c778a5d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:43.565070 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:43.565070 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:43.565070 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:43.565070 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:43.565070 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:43.565070 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:43.565070 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:43.565070 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:43.565070 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:43.565070 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:43.565070 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:43.565070 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:50:43.565070 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:50:43.565070 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:50:43.565070 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:50:43.566703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:43.566703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:43.566703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:43.566703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:43.566703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:43.566703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:43.566703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:43.566703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:43.566703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:43.566703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:43.566703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:43.566703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:43.566703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:43.566703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:43.566703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:43.566703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:43.566703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:50:43.568044 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:50:43.568044 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:43.568044 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:43.569927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 252/501] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:50:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:43.575634 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d01b3-b3cc-47ab-bad3-25a6c778a5d4 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:43.636489 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:43.660375 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:43.718883 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a478fc7-3026-4865-925b-965fc4d662b4 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:43.757098 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa26809-7045-4ba4-b24d-fd6a2db69f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:43.757987 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa26809-7045-4ba4-b24d-fd6a2db69f42 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:43.758414 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa26809-7045-4ba4-b24d-fd6a2db69f42 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:43.758859 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa26809-7045-4ba4-b24d-fd6a2db69f42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:43.771928 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa26809-7045-4ba4-b24d-fd6a2db69f42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:43.773713 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa26809-7045-4ba4-b24d-fd6a2db69f42 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:43.789816 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-4fa26809-7045-4ba4-b24d-fd6a2db69f42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:43.789816 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:43.789816 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:43.789816 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:43.789816 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:43.789816 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:43.789816 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:43.789816 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:43.789816 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:43.789816 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:43.789816 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:43.789816 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:43.789816 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:50:43.789816 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:50:43.789816 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:50:43.789816 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:50:43.791207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:43.791207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:43.791207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:43.791207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:43.791207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:43.791207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:43.791207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:43.791207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:43.791207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:43.791207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:43.791207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:43.791207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:43.791207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:43.791207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:43.791207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:43.791207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:43.791207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:50:43.792367 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:50:43.792367 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:43.792367 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:43.795578 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 250/502] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:50:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:43.801164 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa26809-7045-4ba4-b24d-fd6a2db69f42 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:43.807340 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d01b3-b3cc-47ab-bad3-25a6c778a5d4 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:43.885421 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08bf965-b957-41cb-8cd6-0182036b4aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:43.886045 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bf965-b957-41cb-8cd6-0182036b4aee None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:43.886331 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bf965-b957-41cb-8cd6-0182036b4aee None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:43.886662 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bf965-b957-41cb-8cd6-0182036b4aee None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:43.887263 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08bf965-b957-41cb-8cd6-0182036b4aee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:43.887570 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08bf965-b957-41cb-8cd6-0182036b4aee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:43.889252 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08bf965-b957-41cb-8cd6-0182036b4aee None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:43.904692 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 253/503] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:43.910772 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08bf965-b957-41cb-8cd6-0182036b4aee None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:43.996903 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa26809-7045-4ba4-b24d-fd6a2db69f42 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:44.023095 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:44.024802 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:44.032575 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08bf965-b957-41cb-8cd6-0182036b4aee None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:44.047210 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0efde-722d-4aba-8c42-e8acb67402a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:44.047996 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0efde-722d-4aba-8c42-e8acb67402a1 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:44.048695 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0efde-722d-4aba-8c42-e8acb67402a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:44.048988 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0efde-722d-4aba-8c42-e8acb67402a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:44.049922 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0efde-722d-4aba-8c42-e8acb67402a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:44.050236 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0efde-722d-4aba-8c42-e8acb67402a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:44.052216 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0efde-722d-4aba-8c42-e8acb67402a1 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:44.068947 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 251/504] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:44.070190 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced68ce-1cd1-4fbd-a21d-46678892ff83 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:44.070476 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced68ce-1cd1-4fbd-a21d-46678892ff83 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:44.070760 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced68ce-1cd1-4fbd-a21d-46678892ff83 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:44.071229 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9511fa08-09fd-45a2-bbc5-0828f25efaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:44.071970 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 252/505] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:50:44.072093 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511fa08-09fd-45a2-bbc5-0828f25efaba None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:44.076456 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511fa08-09fd-45a2-bbc5-0828f25efaba None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:44.076867 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511fa08-09fd-45a2-bbc5-0828f25efaba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:44.077524 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b4d2b-f268-4350-b7c1-fbd30bd84a5d None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:44.077816 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b4d2b-f268-4350-b7c1-fbd30bd84a5d None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:44.078098 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b4d2b-f268-4350-b7c1-fbd30bd84a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:44.085631 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9511fa08-09fd-45a2-bbc5-0828f25efaba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:44.087350 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9511fa08-09fd-45a2-bbc5-0828f25efaba None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:44.099077 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-9511fa08-09fd-45a2-bbc5-0828f25efaba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:50:44.099077 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:44.099077 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:44.099077 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:44.099077 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:44.099077 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:44.099077 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:44.099077 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:44.099077 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:44.099077 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:44.099077 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:44.099077 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:44.099077 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:50:44.099077 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:50:44.099077 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:50:44.100255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:50:44.100255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:44.100255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:44.100255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:44.100255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:44.100255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:44.100255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:44.100255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:44.100255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:44.100255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:44.100255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:44.100255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:44.100255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:44.100255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:44.100255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:44.100255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:44.100255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:44.101833 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:50:44.101833 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:50:44.101833 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:50:44.101833 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:50:44.101833 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:50:44.101833 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:50:44.101833 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:50:44.101833 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:44.102819 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-242b4d2b-f268-4350-b7c1-fbd30bd84a5d None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:44.103048 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 254/506] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 26 10:50:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:44.103196 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-242b4d2b-f268-4350-b7c1-fbd30bd84a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:44.103343 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9511fa08-09fd-45a2-bbc5-0828f25efaba None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:44.181370 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 253/507] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:50:44.188977 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b4d2b-f268-4350-b7c1-fbd30bd84a5d None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:44.210589 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9511fa08-09fd-45a2-bbc5-0828f25efaba None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:44.252611 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c086ba-77ac-40d9-aec8-4d9581a11fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:44.253282 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c086ba-77ac-40d9-aec8-4d9581a11fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:44.253571 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c086ba-77ac-40d9-aec8-4d9581a11fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:44.253855 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c086ba-77ac-40d9-aec8-4d9581a11fc9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:44.265054 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c086ba-77ac-40d9-aec8-4d9581a11fc9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:44.267213 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c086ba-77ac-40d9-aec8-4d9581a11fc9 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:44.283698 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-b5c086ba-77ac-40d9-aec8-4d9581a11fc9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 26 10:50:44.283698 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:44.283698 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:44.283698 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:44.283698 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:44.283698 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:44.283698 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:44.283698 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:44.283698 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:44.283698 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:44.283698 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:44.283698 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:44.283698 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:50:44.283698 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:50:44.283698 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:50:44.283698 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:50:44.285942 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:44.285942 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:44.285942 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:50:44.285942 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:50:44.285942 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:50:44.285942 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:50:44.285942 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:44.285942 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:44.285942 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:44.285942 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:44.285942 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:44.285942 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:44.285942 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:44.285942 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:44.285942 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:44.285942 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:44.285942 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:44.285942 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:44.288146 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:44.288146 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:44.288146 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:50:44.288146 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:50:44.288146 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:50:44.288146 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:50:44.288146 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:50:44.288146 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:50:44.288146 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 26 10:50:44.288146 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:44.288146 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 255/508] 10.222.0.45 () {56 vars in 1093 bytes} [Wed Oct 26 10:50:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:44.288146 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f38f5a-b0db-4fe1-ae79-a1c6f93f9ed7 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:44.288146 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f38f5a-b0db-4fe1-ae79-a1c6f93f9ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:44.289739 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f38f5a-b0db-4fe1-ae79-a1c6f93f9ed7 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:44.296082 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 256/509] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:50:44.296082 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f38f5a-b0db-4fe1-ae79-a1c6f93f9ed7 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:44.313211 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b4d2b-f268-4350-b7c1-fbd30bd84a5d None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:44.314430 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:44.323784 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:44.367649 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b784c-e017-42b4-9f56-d4f6b0f27f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:44.368528 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b784c-e017-42b4-9f56-d4f6b0f27f02 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:44.368817 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b784c-e017-42b4-9f56-d4f6b0f27f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:44.369097 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b784c-e017-42b4-9f56-d4f6b0f27f02 None admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:44.369798 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b784c-e017-42b4-9f56-d4f6b0f27f02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:44.370109 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b784c-e017-42b4-9f56-d4f6b0f27f02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:44.372384 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b784c-e017-42b4-9f56-d4f6b0f27f02 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:44.387931 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 254/510] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 26 10:50:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:44.393275 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b0c28-fc60-4869-8dde-e6cf0f210ba2 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:44.395881 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b0c28-fc60-4869-8dde-e6cf0f210ba2 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:44.397524 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b0c28-fc60-4869-8dde-e6cf0f210ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:44.415993 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-764b0c28-fc60-4869-8dde-e6cf0f210ba2 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:44.417729 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-764b0c28-fc60-4869-8dde-e6cf0f210ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:44.427388 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f38f5a-b0db-4fe1-ae79-a1c6f93f9ed7 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:44.466825 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9fee7-287c-4f58-8352-2058ab718383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:44.467362 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9fee7-287c-4f58-8352-2058ab718383 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:44.467646 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9fee7-287c-4f58-8352-2058ab718383 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:44.467918 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9fee7-287c-4f58-8352-2058ab718383 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:44.468667 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9fee7-287c-4f58-8352-2058ab718383 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:44.468976 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9fee7-287c-4f58-8352-2058ab718383 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:44.470407 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9fee7-287c-4f58-8352-2058ab718383 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:44.488605 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 257/511] 10.222.0.45 () {56 vars in 1133 bytes} [Wed Oct 26 10:50:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:44.489591 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 255/512] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:50:44.490584 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b0c28-fc60-4869-8dde-e6cf0f210ba2 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:44.500284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9fee7-287c-4f58-8352-2058ab718383 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:44.595333 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:44.600022 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:44.602177 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b0c28-fc60-4869-8dde-e6cf0f210ba2 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:44.632996 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9fee7-287c-4f58-8352-2058ab718383 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:44.644272 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82edff6-c0d8-43ba-8078-05c1df678a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:44.645122 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82edff6-c0d8-43ba-8078-05c1df678a54 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:44.646126 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82edff6-c0d8-43ba-8078-05c1df678a54 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:44.646773 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82edff6-c0d8-43ba-8078-05c1df678a54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:44.659601 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82edff6-c0d8-43ba-8078-05c1df678a54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:44.661418 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82edff6-c0d8-43ba-8078-05c1df678a54 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:44.676362 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346af850-230b-46d8-92cb-cc44cf9e5545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:44.677093 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346af850-230b-46d8-92cb-cc44cf9e5545 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:44.677491 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346af850-230b-46d8-92cb-cc44cf9e5545 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:44.677886 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346af850-230b-46d8-92cb-cc44cf9e5545 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:44.678680 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346af850-230b-46d8-92cb-cc44cf9e5545 None admin] RBAC: Adding query filter params (role.id=9102b6e1623a43e99513d6ad55d55c7b, scope.project.id=e8f0f02a607a49e0b88c75019795b726, user.id=d21b84cc38a848de8d19a41e1eb04a58) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:44.679062 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346af850-230b-46d8-92cb-cc44cf9e5545 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:44.679331 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-a82edff6-c0d8-43ba-8078-05c1df678a54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:44.679331 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:44.679331 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:44.679331 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:44.679331 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:44.679331 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:44.679331 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:44.679331 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:44.679331 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:44.679331 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:44.679331 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:44.679331 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:44.679331 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:50:44.679331 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:50:44.679331 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:50:44.679331 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:50:44.680260 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:44.680260 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:44.680260 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:44.680260 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:44.680260 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:44.680260 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:44.680260 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:44.680260 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:44.680260 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:44.680260 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:44.680260 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:44.680260 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:44.680260 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:44.680260 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:44.680260 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:44.680260 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:44.680260 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:50:44.681170 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:50:44.681170 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:44.681170 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:44.681343 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346af850-230b-46d8-92cb-cc44cf9e5545 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:44.684484 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 256/513] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:50:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:44.685560 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82edff6-c0d8-43ba-8078-05c1df678a54 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:44.695929 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 258/514] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 26 10:50:44 2022] GET /identity/v3/role_assignments?user.id=d21b84cc38a848de8d19a41e1eb04a58&scope.project.id=e8f0f02a607a49e0b88c75019795b726&role.id=9102b6e1623a43e99513d6ad55d55c7b => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:44.696797 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346af850-230b-46d8-92cb-cc44cf9e5545 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:44.828903 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82edff6-c0d8-43ba-8078-05c1df678a54 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:44.846347 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346af850-230b-46d8-92cb-cc44cf9e5545 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:44.867020 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb81ab9-9ee9-4736-8162-fbe2f2c389bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:44.867691 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb81ab9-9ee9-4736-8162-fbe2f2c389bb None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:44.867975 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb81ab9-9ee9-4736-8162-fbe2f2c389bb None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:44.868281 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb81ab9-9ee9-4736-8162-fbe2f2c389bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:44.880875 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb81ab9-9ee9-4736-8162-fbe2f2c389bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:44.882350 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb81ab9-9ee9-4736-8162-fbe2f2c389bb None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:44.892837 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290fe57-bc9d-499c-9314-5180afe8a12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:44.893782 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290fe57-bc9d-499c-9314-5180afe8a12e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:44.894255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290fe57-bc9d-499c-9314-5180afe8a12e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:44.894740 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290fe57-bc9d-499c-9314-5180afe8a12e None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:44.895699 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290fe57-bc9d-499c-9314-5180afe8a12e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:44.896235 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290fe57-bc9d-499c-9314-5180afe8a12e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:44.897980 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290fe57-bc9d-499c-9314-5180afe8a12e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:44.898634 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-1fb81ab9-9ee9-4736-8162-fbe2f2c389bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:44.898634 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:44.898634 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:44.898634 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:44.898634 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:44.898634 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:44.898634 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:44.898634 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:44.898634 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:44.898634 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:44.898634 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:44.898634 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:44.898634 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:50:44.898634 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:50:44.898634 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:50:44.898634 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:50:44.899556 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:44.899556 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:44.899556 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:44.899556 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:44.899556 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:44.899556 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:44.899556 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:44.899556 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:44.899556 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:44.899556 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:44.899556 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:44.899556 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:44.899556 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:44.899556 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:44.899556 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:44.899556 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:44.899556 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:50:44.900492 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:50:44.900492 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:44.900492 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:44.900492 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 257/515] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:50:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:44.900724 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb81ab9-9ee9-4736-8162-fbe2f2c389bb None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:44.907607 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:44.908916 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:44.929401 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 259/516] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:44.929401 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290fe57-bc9d-499c-9314-5180afe8a12e None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:45.045221 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb81ab9-9ee9-4736-8162-fbe2f2c389bb None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:45.046775 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290fe57-bc9d-499c-9314-5180afe8a12e None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:45.083638 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907352b-f76f-4e51-b5b3-9db70c77e7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:45.084508 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907352b-f76f-4e51-b5b3-9db70c77e7bb None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:45.084939 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907352b-f76f-4e51-b5b3-9db70c77e7bb None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:45.085361 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907352b-f76f-4e51-b5b3-9db70c77e7bb None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:45.086242 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f907352b-f76f-4e51-b5b3-9db70c77e7bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:45.086765 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f907352b-f76f-4e51-b5b3-9db70c77e7bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:45.088667 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f907352b-f76f-4e51-b5b3-9db70c77e7bb None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:45.090758 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec496d1c-d40c-4c3f-9365-bd20dcf5dbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:45.092105 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec496d1c-d40c-4c3f-9365-bd20dcf5dbfa None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:45.092405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec496d1c-d40c-4c3f-9365-bd20dcf5dbfa None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:45.092693 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec496d1c-d40c-4c3f-9365-bd20dcf5dbfa None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:45.093287 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec496d1c-d40c-4c3f-9365-bd20dcf5dbfa None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:45.094664 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec496d1c-d40c-4c3f-9365-bd20dcf5dbfa None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:45.102798 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 260/517] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:45.103902 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907352b-f76f-4e51-b5b3-9db70c77e7bb None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:45.111776 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-ec496d1c-d40c-4c3f-9365-bd20dcf5dbfa None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 26 10:50:45.111776 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:45.111776 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:50:45.111776 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:50:45.111776 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:50:45.111776 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:50:45.111776 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:50:45.111776 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:50:45.111776 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 26 10:50:45.111776 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:45.111776 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:50:45.111776 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:45.111776 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:45.111776 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:45.111776 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:45.111776 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:45.111776 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:45.112897 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:45.112897 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:45.112897 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:45.112897 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:45.112897 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:45.112897 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:45.112897 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:50:45.112897 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:50:45.112897 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:50:45.112897 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:50:45.112897 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:45.112897 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:45.112897 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:45.112897 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:45.112897 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:45.112897 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:45.113759 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:45.113759 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:45.113759 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:45.113759 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:45.113759 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:45.113759 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:45.113759 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:45.113759 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:45.113759 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:45.113759 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:45.113759 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:50:45.113759 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:50:45.113759 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 26 10:50:45.113759 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:45.113759 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 258/518] 10.222.0.45 () {56 vars in 1129 bytes} [Wed Oct 26 10:50:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:45.115102 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec496d1c-d40c-4c3f-9365-bd20dcf5dbfa None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:45.195370 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:45.207520 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:45.245089 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec496d1c-d40c-4c3f-9365-bd20dcf5dbfa None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:45.255779 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907352b-f76f-4e51-b5b3-9db70c77e7bb None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:45.281163 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a334d9-b1df-43de-9abf-6e2cfcde0b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:45.283174 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a334d9-b1df-43de-9abf-6e2cfcde0b1b None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:45.283174 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a334d9-b1df-43de-9abf-6e2cfcde0b1b None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:45.283174 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a334d9-b1df-43de-9abf-6e2cfcde0b1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:45.289730 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a334d9-b1df-43de-9abf-6e2cfcde0b1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:45.291157 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a334d9-b1df-43de-9abf-6e2cfcde0b1b None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:45.293128 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bef630-68ec-4485-9a2d-364b93022826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:45.293745 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bef630-68ec-4485-9a2d-364b93022826 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:45.294036 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bef630-68ec-4485-9a2d-364b93022826 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:45.294315 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bef630-68ec-4485-9a2d-364b93022826 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:45.294962 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bef630-68ec-4485-9a2d-364b93022826 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:45.296427 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bef630-68ec-4485-9a2d-364b93022826 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:45.303294 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-b4a334d9-b1df-43de-9abf-6e2cfcde0b1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:50:45.303294 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:45.303294 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:45.303294 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:45.303294 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:45.303294 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:45.303294 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:45.303294 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:45.303294 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:45.303294 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:45.303294 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:45.303294 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:45.303294 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:50:45.303294 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:50:45.303294 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:50:45.304228 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:50:45.304228 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:45.304228 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:45.304228 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:45.304228 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:45.304228 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:45.304228 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:45.304228 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:45.304228 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:45.304228 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:45.304228 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:45.304228 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:45.304228 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:45.304228 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:45.304228 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:45.304228 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:45.304228 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:45.305121 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:50:45.305121 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:50:45.305121 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:50:45.305121 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:50:45.305121 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:50:45.305121 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:50:45.305121 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:50:45.305121 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:45.305121 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 259/519] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 26 10:50:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:45.306255 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a334d9-b1df-43de-9abf-6e2cfcde0b1b None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:45.409555 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a334d9-b1df-43de-9abf-6e2cfcde0b1b None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:45.425318 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 261/520] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Oct 26 10:50:45 2022] POST /identity/v3/users => generated 254 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:50:45.426907 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073adb5-8177-4567-ae27-d9c47a446829 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:45.427624 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073adb5-8177-4567-ae27-d9c47a446829 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:45.427914 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073adb5-8177-4567-ae27-d9c47a446829 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:45.429774 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 262/521] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:50:45.430410 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073adb5-8177-4567-ae27-d9c47a446829 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:45.460568 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:45.470272 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e37987b-5919-44b7-b94a-501f20fc430b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:45.473566 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37987b-5919-44b7-b94a-501f20fc430b None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:45.473566 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37987b-5919-44b7-b94a-501f20fc430b None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:45.473566 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37987b-5919-44b7-b94a-501f20fc430b None admin] PATH_INFO: `/v3/services` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:45.473566 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e37987b-5919-44b7-b94a-501f20fc430b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:45.473566 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e37987b-5919-44b7-b94a-501f20fc430b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:45.474143 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e37987b-5919-44b7-b94a-501f20fc430b None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:45.484109 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 260/522] 10.222.0.45 () {56 vars in 1124 bytes} [Wed Oct 26 10:50:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:45.484109 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019eed6-014b-4209-b731-334e8a1dae19 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:45.484109 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019eed6-014b-4209-b731-334e8a1dae19 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:45.484109 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019eed6-014b-4209-b731-334e8a1dae19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:45.508513 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-a019eed6-014b-4209-b731-334e8a1dae19 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:45.509929 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-a019eed6-014b-4209-b731-334e8a1dae19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:45.590468 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 261/523] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:50:45.591387 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019eed6-014b-4209-b731-334e8a1dae19 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:45.616642 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073adb5-8177-4567-ae27-d9c47a446829 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:45.633138 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:45.664145 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d0818-7673-421a-9ac8-1ade268a5b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:45.664771 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d0818-7673-421a-9ac8-1ade268a5b1a None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:45.665057 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d0818-7673-421a-9ac8-1ade268a5b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:45.665342 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d0818-7673-421a-9ac8-1ade268a5b1a None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:45.666049 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d0818-7673-421a-9ac8-1ade268a5b1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:45.666359 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d0818-7673-421a-9ac8-1ade268a5b1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:45.668979 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d0818-7673-421a-9ac8-1ade268a5b1a None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:45.691186 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 263/524] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 26 10:50:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:45.692516 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d0818-7673-421a-9ac8-1ade268a5b1a None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:45.719976 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019eed6-014b-4209-b731-334e8a1dae19 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:45.751131 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:45.771190 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436b8b6-3d2b-4f7c-8f0d-4bbed6567417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:45.772246 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436b8b6-3d2b-4f7c-8f0d-4bbed6567417 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:45.772531 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436b8b6-3d2b-4f7c-8f0d-4bbed6567417 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:45.772804 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436b8b6-3d2b-4f7c-8f0d-4bbed6567417 None admin] PATH_INFO: `/v3/services` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:45.773728 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436b8b6-3d2b-4f7c-8f0d-4bbed6567417 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:45.774039 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436b8b6-3d2b-4f7c-8f0d-4bbed6567417 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:45.777152 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436b8b6-3d2b-4f7c-8f0d-4bbed6567417 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:45.784836 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 262/525] 10.222.0.45 () {56 vars in 1124 bytes} [Wed Oct 26 10:50:45 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:45.831430 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d0818-7673-421a-9ac8-1ade268a5b1a None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:45.870340 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105119a-5810-4f23-a4a0-9088f0e0edb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:45.870970 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105119a-5810-4f23-a4a0-9088f0e0edb9 None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:45.871215 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105119a-5810-4f23-a4a0-9088f0e0edb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:45.871497 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105119a-5810-4f23-a4a0-9088f0e0edb9 None admin] PATH_INFO: `/v3/projects/e8f0f02a607a49e0b88c75019795b726/users/a852a777cb6a4863bebdb949cc71ea65/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:45.873522 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105119a-5810-4f23-a4a0-9088f0e0edb9 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8f0f02a607a49e0b88c75019795b726, user_id=a852a777cb6a4863bebdb949cc71ea65, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:45.875016 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105119a-5810-4f23-a4a0-9088f0e0edb9 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:45.904750 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436b8b6-3d2b-4f7c-8f0d-4bbed6567417 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:45.954221 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 264/526] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 26 10:50:45 2022] PUT /identity/v3/projects/e8f0f02a607a49e0b88c75019795b726/users/a852a777cb6a4863bebdb949cc71ea65/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:50:46.040997 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436b8b6-3d2b-4f7c-8f0d-4bbed6567417 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:46.081634 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ccd4c-5248-4599-bb2b-481cc592c6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:46.082346 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ccd4c-5248-4599-bb2b-481cc592c6de None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:46.082635 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ccd4c-5248-4599-bb2b-481cc592c6de None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:46.082981 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ccd4c-5248-4599-bb2b-481cc592c6de None admin] PATH_INFO: `/v3/services/network` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:46.083584 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ccd4c-5248-4599-bb2b-481cc592c6de None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:46.085053 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ccd4c-5248-4599-bb2b-481cc592c6de None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:46.095095 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-ee0ccd4c-5248-4599-bb2b-481cc592c6de None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 26 10:50:46.095095 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:46.095095 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:50:46.095095 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:50:46.095095 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:50:46.095095 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:50:46.095095 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:50:46.095095 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:50:46.095095 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 26 10:50:46.095095 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:46.095095 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:50:46.095095 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:46.095095 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:46.095095 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:46.095095 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:46.095095 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:46.095095 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:46.096189 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:46.096189 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:46.096189 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:46.096189 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:46.096189 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:46.096189 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:46.096189 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:50:46.096189 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:50:46.096189 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:50:46.096189 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:50:46.096189 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:46.096189 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:46.096189 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:46.096189 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:46.096189 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:46.096189 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:46.097707 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:46.097707 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:46.097707 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:46.097707 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:46.097707 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:46.097707 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:46.097707 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:46.097707 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:46.097707 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:46.097707 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:46.097707 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:50:46.097707 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:50:46.097707 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 26 10:50:46.097707 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:46.097707 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 263/527] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 26 10:50:45 2022] GET /identity/v3/services/network => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:50:46.103150 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105119a-5810-4f23-a4a0-9088f0e0edb9 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:46.145148 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:46.221797 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105119a-5810-4f23-a4a0-9088f0e0edb9 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:46.258249 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8838d6b-ba8c-4f6d-a6ca-ef14481fc031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:46.258874 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8838d6b-ba8c-4f6d-a6ca-ef14481fc031 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:46.259156 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8838d6b-ba8c-4f6d-a6ca-ef14481fc031 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:46.259432 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8838d6b-ba8c-4f6d-a6ca-ef14481fc031 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:46.260089 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8838d6b-ba8c-4f6d-a6ca-ef14481fc031 None admin] RBAC: Adding query filter params (name=network) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:46.260401 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8838d6b-ba8c-4f6d-a6ca-ef14481fc031 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:46.261861 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8838d6b-ba8c-4f6d-a6ca-ef14481fc031 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:46.269231 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 265/528] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Oct 26 10:50:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:46.272545 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ccd4c-5248-4599-bb2b-481cc592c6de None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:46.326042 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:46.393556 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ccd4c-5248-4599-bb2b-481cc592c6de None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:46.440180 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f5256a-275f-4b9e-808a-9aa189ddcaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:46.440785 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5256a-275f-4b9e-808a-9aa189ddcaed None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:46.441071 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5256a-275f-4b9e-808a-9aa189ddcaed None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:46.441347 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5256a-275f-4b9e-808a-9aa189ddcaed None admin] PATH_INFO: `/v3/services` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:46.441984 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f5256a-275f-4b9e-808a-9aa189ddcaed None admin] RBAC: Adding query filter params (type=network) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:46.442352 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f5256a-275f-4b9e-808a-9aa189ddcaed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:46.443715 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f5256a-275f-4b9e-808a-9aa189ddcaed None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:46.451953 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 264/529] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Oct 26 10:50:46 2022] GET /identity/v3/services?type=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:47.041596 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc07e3f-3fcb-4d63-bdf0-ff990e0a6dc1 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:47.042372 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc07e3f-3fcb-4d63-bdf0-ff990e0a6dc1 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:47.042481 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc07e3f-3fcb-4d63-bdf0-ff990e0a6dc1 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:47.043876 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 266/530] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:50:47.049260 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bcd0a-aa62-47dd-ab9f-49928f4c4d61 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:47.049668 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bcd0a-aa62-47dd-ab9f-49928f4c4d61 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:47.049838 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bcd0a-aa62-47dd-ab9f-49928f4c4d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:47.074903 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-364bcd0a-aa62-47dd-ab9f-49928f4c4d61 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:47.076124 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-364bcd0a-aa62-47dd-ab9f-49928f4c4d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:47.165785 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 265/531] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:50:47.545607 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc07e3f-3fcb-4d63-bdf0-ff990e0a6dc1 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:47.656735 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:47.670055 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc07e3f-3fcb-4d63-bdf0-ff990e0a6dc1 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:47.714236 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7760e-b118-4466-847d-d652b4e907df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:47.715202 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7760e-b118-4466-847d-d652b4e907df None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:47.715667 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7760e-b118-4466-847d-d652b4e907df None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:47.716151 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7760e-b118-4466-847d-d652b4e907df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:47.726986 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7760e-b118-4466-847d-d652b4e907df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:50:47.732045 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-74e7760e-b118-4466-847d-d652b4e907df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:50:47.732045 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:47.732045 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:47.732045 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:47.732045 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:47.732045 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:47.732045 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:47.732045 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:47.732045 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:47.732045 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:47.732045 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:47.732045 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:47.732045 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:50:47.732045 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:50:47.732045 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:50:47.732045 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:50:47.732986 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:50:47.732986 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:50:47.732986 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:50:47.732986 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:50:47.732986 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:47.732986 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:47.732986 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:47.732986 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:47.732986 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:47.732986 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:47.732986 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:47.732986 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:47.732986 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:47.732986 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:47.732986 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:47.732986 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:47.733845 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:47.733845 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:47.733845 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:47.733845 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:47.733845 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:50:47.733845 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:50:47.733845 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:50:47.733845 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:50:47.733845 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:50:47.733845 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:50:47.733845 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:50:47.733845 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:47.735978 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 267/532] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 26 10:50:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:47.741901 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364bcd0a-aa62-47dd-ab9f-49928f4c4d61 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:47.791182 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:47.862784 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364bcd0a-aa62-47dd-ab9f-49928f4c4d61 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:47.905980 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461883d-8b38-4567-b250-25a1547f305c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:47.906851 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461883d-8b38-4567-b250-25a1547f305c None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:47.907283 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461883d-8b38-4567-b250-25a1547f305c None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:47.907700 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461883d-8b38-4567-b250-25a1547f305c None admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:47.908538 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461883d-8b38-4567-b250-25a1547f305c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:47.909006 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461883d-8b38-4567-b250-25a1547f305c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:47.910602 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461883d-8b38-4567-b250-25a1547f305c None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:47.919607 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 266/533] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 26 10:50:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:47.925323 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7760e-b118-4466-847d-d652b4e907df None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:48.047844 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7760e-b118-4466-847d-d652b4e907df None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:48.089432 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae414d-b078-40a2-813d-fd7a810d3326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:48.090316 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae414d-b078-40a2-813d-fd7a810d3326 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:48.090768 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae414d-b078-40a2-813d-fd7a810d3326 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:48.091202 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae414d-b078-40a2-813d-fd7a810d3326 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:48.107518 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae414d-b078-40a2-813d-fd7a810d3326 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:48.109317 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae414d-b078-40a2-813d-fd7a810d3326 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:48.127624 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-dbae414d-b078-40a2-813d-fd7a810d3326 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:48.127624 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:48.127624 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:48.127624 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:48.127624 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:48.127624 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:48.127624 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:48.127624 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:48.127624 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:48.127624 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:48.127624 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:48.127624 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:48.127624 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:50:48.127624 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:50:48.127624 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:50:48.127624 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:50:48.128827 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:48.128827 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:48.128827 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:48.128827 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:48.128827 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:48.128827 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:48.128827 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:48.128827 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:48.128827 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:48.128827 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:48.128827 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:48.128827 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:48.128827 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:48.128827 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:48.128827 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:48.128827 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:48.128827 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:50:48.130035 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:50:48.130035 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:48.130035 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:48.131785 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 268/534] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:50:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:48.137590 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461883d-8b38-4567-b250-25a1547f305c None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:48.269970 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461883d-8b38-4567-b250-25a1547f305c None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:48.272773 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:48.308030 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7934d09-24f5-4c31-8f77-44d48401e630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:48.308673 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7934d09-24f5-4c31-8f77-44d48401e630 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:48.308955 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7934d09-24f5-4c31-8f77-44d48401e630 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:48.309232 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7934d09-24f5-4c31-8f77-44d48401e630 None admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:48.309953 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7934d09-24f5-4c31-8f77-44d48401e630 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:48.310262 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7934d09-24f5-4c31-8f77-44d48401e630 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:48.311633 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7934d09-24f5-4c31-8f77-44d48401e630 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:48.324212 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 267/535] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:50:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:48.329814 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae414d-b078-40a2-813d-fd7a810d3326 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:48.343892 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:48.437468 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae414d-b078-40a2-813d-fd7a810d3326 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:48.484685 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc996ba4-b2db-4760-9272-ed009384c807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:48.485321 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc996ba4-b2db-4760-9272-ed009384c807 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:48.485605 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc996ba4-b2db-4760-9272-ed009384c807 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:48.485883 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc996ba4-b2db-4760-9272-ed009384c807 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:48.493260 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc996ba4-b2db-4760-9272-ed009384c807 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:48.494703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc996ba4-b2db-4760-9272-ed009384c807 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:48.507058 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-dc996ba4-b2db-4760-9272-ed009384c807 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 26 10:50:48.507058 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:48.507058 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:48.507058 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:48.507058 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:48.507058 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:48.507058 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:48.507058 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:48.507058 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:48.507058 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:48.507058 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:48.507058 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:48.507058 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:50:48.507058 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:50:48.507058 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:50:48.507058 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:50:48.508103 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:48.508103 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:48.508103 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:50:48.508103 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:50:48.508103 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:50:48.508103 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:50:48.508103 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:48.508103 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:48.508103 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:48.508103 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:48.508103 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:48.508103 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:48.508103 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:48.508103 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:48.508103 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:48.508103 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:48.508103 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:48.508103 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:48.509107 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:48.509107 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:48.509107 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:50:48.509107 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:50:48.509107 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:50:48.509107 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:50:48.509107 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:50:48.509107 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:50:48.509107 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 26 10:50:48.509107 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:48.509107 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 269/536] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 26 10:50:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:48.514273 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7934d09-24f5-4c31-8f77-44d48401e630 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:48.641830 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7934d09-24f5-4c31-8f77-44d48401e630 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:48.685237 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0bea81-888c-421a-a147-ac6212990fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:48.685885 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0bea81-888c-421a-a147-ac6212990fee None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:48.686172 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0bea81-888c-421a-a147-ac6212990fee None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:48.686450 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0bea81-888c-421a-a147-ac6212990fee None admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:48.687209 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0bea81-888c-421a-a147-ac6212990fee None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:48.687519 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0bea81-888c-421a-a147-ac6212990fee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:48.689058 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0bea81-888c-421a-a147-ac6212990fee None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:48.702641 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99f9a4-5d6a-4448-a7b5-b70d10eac117 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:48.702970 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99f9a4-5d6a-4448-a7b5-b70d10eac117 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:48.703196 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99f9a4-5d6a-4448-a7b5-b70d10eac117 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:48.704825 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 270/537] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:50:48.709640 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 268/538] 10.222.0.45 () {56 vars in 1135 bytes} [Wed Oct 26 10:50:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:48.710453 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34983658-d279-40c0-a37e-d114c2b7c3a2 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:48.710850 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34983658-d279-40c0-a37e-d114c2b7c3a2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:48.711137 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34983658-d279-40c0-a37e-d114c2b7c3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:48.715222 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0bea81-888c-421a-a147-ac6212990fee None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:48.742337 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-34983658-d279-40c0-a37e-d114c2b7c3a2 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:48.744385 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-34983658-d279-40c0-a37e-d114c2b7c3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:48.767209 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:48.816545 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:48.826357 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 271/539] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:50:48.828255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ef891-6761-41b2-bc4c-934acc754305 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:48.828543 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ef891-6761-41b2-bc4c-934acc754305 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:48.828819 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ef891-6761-41b2-bc4c-934acc754305 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:48.830214 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 272/540] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:50:48.835874 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae55f4-3ec6-4758-9571-3cf453dea8d9 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:48.836192 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae55f4-3ec6-4758-9571-3cf453dea8d9 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:48.836466 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae55f4-3ec6-4758-9571-3cf453dea8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:48.854583 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-1bae55f4-3ec6-4758-9571-3cf453dea8d9 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:48.855778 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1bae55f4-3ec6-4758-9571-3cf453dea8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:48.882502 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0bea81-888c-421a-a147-ac6212990fee None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:48.918765 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f7437-936b-4bde-b2b4-aac3c21b7137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:48.919327 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f7437-936b-4bde-b2b4-aac3c21b7137 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:48.919619 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f7437-936b-4bde-b2b4-aac3c21b7137 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:48.919931 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f7437-936b-4bde-b2b4-aac3c21b7137 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:48.930478 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 273/541] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:50:48.931330 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f7437-936b-4bde-b2b4-aac3c21b7137 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:48.932463 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d041e-9485-4b4c-aad4-6c4d647761b0 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:48.932946 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f7437-936b-4bde-b2b4-aac3c21b7137 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:48.933183 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d041e-9485-4b4c-aad4-6c4d647761b0 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:48.933711 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d041e-9485-4b4c-aad4-6c4d647761b0 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:48.935534 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 274/542] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:50:48.940453 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca58c1-4104-44f8-b792-bf879b6dc3d7 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:48.940979 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca58c1-4104-44f8-b792-bf879b6dc3d7 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:48.941473 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca58c1-4104-44f8-b792-bf879b6dc3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:48.958394 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-7b2f7437-936b-4bde-b2b4-aac3c21b7137 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:48.958394 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:48.958394 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:48.958394 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:48.958394 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:48.958394 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:48.958394 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:48.958394 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:48.958394 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:48.958394 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:48.958394 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:48.958394 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:48.958394 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:50:48.958394 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:50:48.958394 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:50:48.958394 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:50:48.959424 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:48.959424 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:48.959424 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:48.959424 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:48.959424 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:48.959424 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:48.959424 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:48.959424 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:48.959424 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:48.959424 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:48.959424 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:48.959424 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:48.959424 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:48.959424 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:48.959424 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:48.959424 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:48.959424 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:50:48.960356 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:50:48.960356 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:48.960356 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:48.963098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-53ca58c1-4104-44f8-b792-bf879b6dc3d7 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:48.964900 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-53ca58c1-4104-44f8-b792-bf879b6dc3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:48.967585 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 269/543] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:50:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:50:48.969208 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f7437-936b-4bde-b2b4-aac3c21b7137 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:49.039286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 275/544] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:50:49.122125 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:49.144987 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5b648-db97-44bc-bfcf-b0a5fa9874fa None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:49.147558 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5b648-db97-44bc-bfcf-b0a5fa9874fa None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:49.147558 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5b648-db97-44bc-bfcf-b0a5fa9874fa None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:49.148725 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 276/545] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:50:49.153404 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b3583-17bd-410e-9cca-62ba10c32c1e None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:49.153922 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b3583-17bd-410e-9cca-62ba10c32c1e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:49.154397 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b3583-17bd-410e-9cca-62ba10c32c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:49.167583 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f7437-936b-4bde-b2b4-aac3c21b7137 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:49.183782 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-a88b3583-17bd-410e-9cca-62ba10c32c1e None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:49.185294 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a88b3583-17bd-410e-9cca-62ba10c32c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:49.215895 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e58fd5-ad04-4d65-ac89-6c22d52379c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:49.217005 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e58fd5-ad04-4d65-ac89-6c22d52379c2 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:49.217810 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e58fd5-ad04-4d65-ac89-6c22d52379c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:49.218558 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e58fd5-ad04-4d65-ac89-6c22d52379c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:49.219419 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e58fd5-ad04-4d65-ac89-6c22d52379c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:49.220085 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e58fd5-ad04-4d65-ac89-6c22d52379c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:49.222281 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e58fd5-ad04-4d65-ac89-6c22d52379c2 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:49.237575 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 270/546] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:50:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:49.238757 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e58fd5-ad04-4d65-ac89-6c22d52379c2 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:49.259008 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:49.270630 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 277/547] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:50:49.271678 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b3583-17bd-410e-9cca-62ba10c32c1e None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:49.369318 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e58fd5-ad04-4d65-ac89-6c22d52379c2 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:49.390403 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b3583-17bd-410e-9cca-62ba10c32c1e None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:49.411118 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4b9c4-3e7a-4c26-b665-740ecabf7d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:49.412522 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4b9c4-3e7a-4c26-b665-740ecabf7d48 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:49.412807 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4b9c4-3e7a-4c26-b665-740ecabf7d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:49.413084 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4b9c4-3e7a-4c26-b665-740ecabf7d48 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:49.415020 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:49.425315 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b4b9c4-3e7a-4c26-b665-740ecabf7d48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:50:49.432107 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e30bf4-4710-4128-87f5-e7ae9515189f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:49.432107 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e30bf4-4710-4128-87f5-e7ae9515189f None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:49.432107 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e30bf4-4710-4128-87f5-e7ae9515189f None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:49.432107 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e30bf4-4710-4128-87f5-e7ae9515189f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:49.432624 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-89b4b9c4-3e7a-4c26-b665-740ecabf7d48 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:50:49.432624 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:49.432624 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:49.432624 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:49.432624 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:49.432624 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:49.432624 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:49.432624 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:49.432624 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:49.432624 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:49.432624 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:49.432624 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:49.432624 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:50:49.432624 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:50:49.432624 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:50:49.432624 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:50:49.433850 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:50:49.433850 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:50:49.433850 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:50:49.433850 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:50:49.433850 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:49.433850 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:49.433850 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:49.433850 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:49.433850 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:49.433850 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:49.433850 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:49.433850 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:49.433850 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:49.433850 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:49.433850 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:49.433850 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:49.434718 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:49.434718 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:49.434718 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:49.434718 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:49.434718 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:50:49.434718 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:50:49.434718 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:50:49.434718 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:50:49.434718 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:50:49.434718 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:50:49.434718 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:50:49.434718 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:49.434718 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 271/548] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Oct 26 10:50:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:49.434718 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4b9c4-3e7a-4c26-b665-740ecabf7d48 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:49.435498 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e30bf4-4710-4128-87f5-e7ae9515189f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:49.440175 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e30bf4-4710-4128-87f5-e7ae9515189f None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:49.453136 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-a9e30bf4-4710-4128-87f5-e7ae9515189f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:50:49.453136 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:49.453136 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:49.453136 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:49.453136 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:49.453136 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:49.453136 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:49.453136 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:49.453136 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:49.453136 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:49.453136 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:49.453136 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:49.453136 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:50:49.453136 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:50:49.453136 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:50:49.454024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:50:49.454024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:49.454024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:49.454024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:49.454024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:49.454024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:49.454024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:49.454024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:49.454024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:49.454024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:49.454024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:49.454024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:49.454024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:49.454024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:49.454024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:49.454024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:49.454024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:49.454919 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:50:49.454919 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:50:49.454919 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:50:49.454919 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:50:49.454919 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:50:49.454919 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:50:49.454919 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:50:49.454919 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:49.456754 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 278/549] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 26 10:50:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:49.457923 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e30bf4-4710-4128-87f5-e7ae9515189f None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:49.509353 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:49.544183 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4b9c4-3e7a-4c26-b665-740ecabf7d48 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:49.566732 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e30bf4-4710-4128-87f5-e7ae9515189f None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:49.578279 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b22cd-db4f-4d15-a03d-a3d1aa30ec74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:49.578892 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b22cd-db4f-4d15-a03d-a3d1aa30ec74 None admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:49.579172 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b22cd-db4f-4d15-a03d-a3d1aa30ec74 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:49.579444 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b22cd-db4f-4d15-a03d-a3d1aa30ec74 None admin] PATH_INFO: `/v3/services` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:49.580124 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b22cd-db4f-4d15-a03d-a3d1aa30ec74 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:49.581502 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b22cd-db4f-4d15-a03d-a3d1aa30ec74 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:49.601359 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eedd25c-cd5c-4405-9d7d-d4c74931a23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:49.601983 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eedd25c-cd5c-4405-9d7d-d4c74931a23c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:49.602260 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eedd25c-cd5c-4405-9d7d-d4c74931a23c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:49.602530 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eedd25c-cd5c-4405-9d7d-d4c74931a23c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:49.612477 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eedd25c-cd5c-4405-9d7d-d4c74931a23c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:50:49.617802 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-7eedd25c-cd5c-4405-9d7d-d4c74931a23c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:50:49.617802 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:49.617802 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:49.617802 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:49.617802 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:49.617802 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:49.617802 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:49.617802 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:49.617802 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:49.617802 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:49.617802 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:49.617802 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:49.617802 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:50:49.617802 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:50:49.617802 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:50:49.617802 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:50:49.618945 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:50:49.618945 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:50:49.618945 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:50:49.618945 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:50:49.618945 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:49.618945 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:49.618945 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:49.618945 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:49.618945 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:49.618945 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:49.618945 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:49.618945 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:49.618945 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:49.618945 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:49.618945 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:49.618945 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:49.620170 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:49.620170 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:49.620170 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:49.620170 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:49.620170 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:50:49.620170 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:50:49.620170 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:50:49.620170 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:50:49.620170 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:50:49.620170 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:50:49.620170 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:50:49.620170 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:49.620170 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 279/550] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 26 10:50:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:49.620170 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eedd25c-cd5c-4405-9d7d-d4c74931a23c None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:49.681134 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 272/551] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Oct 26 10:50:49 2022] POST /identity/v3/services => generated 251 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:50:49.681838 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b22cd-db4f-4d15-a03d-a3d1aa30ec74 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:49.725320 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eedd25c-cd5c-4405-9d7d-d4c74931a23c None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:49.732944 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:49.746286 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:49.779026 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe634d-14a5-49c5-9835-c28a05916f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:49.779776 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe634d-14a5-49c5-9835-c28a05916f4c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:49.780085 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe634d-14a5-49c5-9835-c28a05916f4c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:49.780362 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe634d-14a5-49c5-9835-c28a05916f4c None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:49.781040 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe634d-14a5-49c5-9835-c28a05916f4c None admin] RBAC: Adding query filter params (name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:49.781348 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe634d-14a5-49c5-9835-c28a05916f4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:49.782781 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe634d-14a5-49c5-9835-c28a05916f4c None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:49.796609 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b22cd-db4f-4d15-a03d-a3d1aa30ec74 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:49.798842 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 280/552] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Oct 26 10:50:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:49.798842 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe634d-14a5-49c5-9835-c28a05916f4c None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:49.837618 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781a01a-19ca-4450-9c6a-421cc05bd88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:49.838250 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781a01a-19ca-4450-9c6a-421cc05bd88d None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:49.838529 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781a01a-19ca-4450-9c6a-421cc05bd88d None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:49.838805 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781a01a-19ca-4450-9c6a-421cc05bd88d None admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:49.839546 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781a01a-19ca-4450-9c6a-421cc05bd88d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:49.839860 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781a01a-19ca-4450-9c6a-421cc05bd88d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:49.841362 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781a01a-19ca-4450-9c6a-421cc05bd88d None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:49.854465 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 273/553] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 26 10:50:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:49.855207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781a01a-19ca-4450-9c6a-421cc05bd88d None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:49.918594 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe634d-14a5-49c5-9835-c28a05916f4c None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:49.954093 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73aa49-7723-4ba4-8715-b58a32058a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:49.954707 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73aa49-7723-4ba4-8715-b58a32058a6a None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:49.954994 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73aa49-7723-4ba4-8715-b58a32058a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:49.955270 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73aa49-7723-4ba4-8715-b58a32058a6a None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:49.955925 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73aa49-7723-4ba4-8715-b58a32058a6a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:49.957329 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73aa49-7723-4ba4-8715-b58a32058a6a None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:49.967544 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781a01a-19ca-4450-9c6a-421cc05bd88d None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:49.982393 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:50.001931 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc930287-5fc5-42a7-b9ac-158012f93c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:50.002542 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc930287-5fc5-42a7-b9ac-158012f93c2b None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:50.002826 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc930287-5fc5-42a7-b9ac-158012f93c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:50.003099 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc930287-5fc5-42a7-b9ac-158012f93c2b None admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:50.003760 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc930287-5fc5-42a7-b9ac-158012f93c2b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:50.004083 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc930287-5fc5-42a7-b9ac-158012f93c2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:50.005484 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc930287-5fc5-42a7-b9ac-158012f93c2b None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:50.013505 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 274/554] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 26 10:50:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:50.014305 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc930287-5fc5-42a7-b9ac-158012f93c2b None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:50.035285 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 281/555] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Oct 26 10:50:49 2022] POST /identity/v3/services => generated 240 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:50:50.037071 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73aa49-7723-4ba4-8715-b58a32058a6a None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:50.094759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:50.143725 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc930287-5fc5-42a7-b9ac-158012f93c2b None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:50.189115 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03888cd2-435b-4611-abaa-bcd93999980c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:50.190199 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03888cd2-435b-4611-abaa-bcd93999980c None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:50.190863 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03888cd2-435b-4611-abaa-bcd93999980c None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:50.190863 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03888cd2-435b-4611-abaa-bcd93999980c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:50.195751 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73aa49-7723-4ba4-8715-b58a32058a6a None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:50.203241 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03888cd2-435b-4611-abaa-bcd93999980c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:50.204760 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03888cd2-435b-4611-abaa-bcd93999980c None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:50.222787 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-03888cd2-435b-4611-abaa-bcd93999980c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:50.222787 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:50.222787 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:50.222787 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:50.222787 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:50.222787 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:50.222787 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:50.222787 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:50.222787 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:50.222787 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:50.222787 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:50.222787 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:50.222787 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:50:50.222787 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:50:50.222787 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:50:50.222787 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:50:50.224637 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:50.224637 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:50.224637 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:50.224637 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:50.224637 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:50.224637 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:50.224637 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:50.224637 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:50.224637 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:50.224637 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:50.224637 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:50.224637 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:50.224637 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:50.224637 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:50.224637 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:50.224637 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:50.224637 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:50:50.225586 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:50:50.225586 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:50.225586 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:50.229992 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 275/556] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:50:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:50.230865 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03888cd2-435b-4611-abaa-bcd93999980c None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:50.244846 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee031c-decf-493a-b31a-93839702ed1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:50.245715 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee031c-decf-493a-b31a-93839702ed1c None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:50.246016 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee031c-decf-493a-b31a-93839702ed1c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:50.246557 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee031c-decf-493a-b31a-93839702ed1c None admin] PATH_INFO: `/v3/projects/e8f0f02a607a49e0b88c75019795b726/users/d21b84cc38a848de8d19a41e1eb04a58/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:50.249839 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee031c-decf-493a-b31a-93839702ed1c None admin] RBAC: Authorizing `identity:create_grant(project_id=e8f0f02a607a49e0b88c75019795b726, user_id=d21b84cc38a848de8d19a41e1eb04a58, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:50.251446 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee031c-decf-493a-b31a-93839702ed1c None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:50.260615 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:50.344897 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03888cd2-435b-4611-abaa-bcd93999980c None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:50.359439 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 282/557] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 26 10:50:50 2022] PUT /identity/v3/projects/e8f0f02a607a49e0b88c75019795b726/users/d21b84cc38a848de8d19a41e1eb04a58/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:50:50.366027 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee031c-decf-493a-b31a-93839702ed1c None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:50.414686 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce36c7-73bb-4c43-b501-80a22837909c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:50.415831 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce36c7-73bb-4c43-b501-80a22837909c None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:50.417097 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce36c7-73bb-4c43-b501-80a22837909c None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:50.418428 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce36c7-73bb-4c43-b501-80a22837909c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:50.438192 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce36c7-73bb-4c43-b501-80a22837909c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:50.440315 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce36c7-73bb-4c43-b501-80a22837909c None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:50.474752 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-b1ce36c7-73bb-4c43-b501-80a22837909c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:50.474752 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:50.474752 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:50.474752 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:50.474752 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:50.474752 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:50.474752 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:50.474752 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:50.474752 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:50.474752 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:50.474752 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:50.474752 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:50.474752 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:50:50.474752 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:50:50.474752 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:50:50.474752 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:50:50.475780 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:50.475780 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:50.475780 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:50.475780 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:50.475780 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:50.475780 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:50.475780 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:50.475780 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:50.475780 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:50.475780 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:50.475780 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:50.475780 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:50.475780 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:50.475780 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:50.475780 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:50.475780 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:50.475780 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:50:50.476739 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:50:50.476739 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:50.476739 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:50.481001 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 276/558] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:50:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:50.486602 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce36c7-73bb-4c43-b501-80a22837909c None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:50.553439 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:50.580236 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee031c-decf-493a-b31a-93839702ed1c None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:50.626687 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde5160-0c40-46bb-9c41-e1ee82936316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:50.627760 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:50.628505 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde5160-0c40-46bb-9c41-e1ee82936316 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:50.628795 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde5160-0c40-46bb-9c41-e1ee82936316 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:50.629072 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde5160-0c40-46bb-9c41-e1ee82936316 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:50.629749 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde5160-0c40-46bb-9c41-e1ee82936316 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:50.630622 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde5160-0c40-46bb-9c41-e1ee82936316 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:50.632074 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde5160-0c40-46bb-9c41-e1ee82936316 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:50.650717 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 283/559] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:50.655959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde5160-0c40-46bb-9c41-e1ee82936316 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:50.664280 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce36c7-73bb-4c43-b501-80a22837909c None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:50.707853 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d1071-7187-470c-a0bd-c225e045f5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:50.709057 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d1071-7187-470c-a0bd-c225e045f5d3 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:50.709723 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d1071-7187-470c-a0bd-c225e045f5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:50.710195 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d1071-7187-470c-a0bd-c225e045f5d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:50.711032 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d1071-7187-470c-a0bd-c225e045f5d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:50.711711 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d1071-7187-470c-a0bd-c225e045f5d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:50.713365 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d1071-7187-470c-a0bd-c225e045f5d3 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:50.731730 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 277/560] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:50.736695 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d1071-7187-470c-a0bd-c225e045f5d3 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:50.761381 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde5160-0c40-46bb-9c41-e1ee82936316 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:50.796751 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cbfbc4-9bf1-4a97-aaea-e1db3b21e79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:50.797370 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbfbc4-9bf1-4a97-aaea-e1db3b21e79a None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:50.797679 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbfbc4-9bf1-4a97-aaea-e1db3b21e79a None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:50.797919 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbfbc4-9bf1-4a97-aaea-e1db3b21e79a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:50.806155 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cbfbc4-9bf1-4a97-aaea-e1db3b21e79a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:50.807545 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cbfbc4-9bf1-4a97-aaea-e1db3b21e79a None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:50.819575 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-b2cbfbc4-9bf1-4a97-aaea-e1db3b21e79a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 26 10:50:50.819575 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:50.819575 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:50.819575 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:50.819575 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:50.819575 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:50.819575 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:50.819575 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:50.819575 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:50.819575 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:50.819575 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:50.819575 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:50.819575 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:50:50.819575 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:50:50.819575 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:50:50.819575 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:50:50.825631 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:50.825631 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:50.825631 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:50:50.825631 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:50:50.825631 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:50:50.825631 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:50:50.825631 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:50.825631 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:50.825631 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:50.825631 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:50.825631 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:50.825631 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:50.825631 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:50.825631 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:50.825631 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:50.825631 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:50.825631 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:50.825631 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:50.826652 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:50.826652 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:50.826652 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:50:50.826652 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:50:50.826652 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:50:50.826652 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:50:50.826652 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:50:50.826652 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:50:50.826652 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 26 10:50:50.826652 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:50.826652 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 284/561] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Oct 26 10:50:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:50:50.826652 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cbfbc4-9bf1-4a97-aaea-e1db3b21e79a None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:50.830337 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:50.870261 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d1071-7187-470c-a0bd-c225e045f5d3 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:50.910190 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f138463-a3af-46d2-95e2-385d7b5f9fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:50.911429 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f138463-a3af-46d2-95e2-385d7b5f9fac None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:50.913617 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f138463-a3af-46d2-95e2-385d7b5f9fac None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:50.914117 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f138463-a3af-46d2-95e2-385d7b5f9fac None admin] PATH_INFO: `/v3/users/nova` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:50.920303 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:50.929252 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f138463-a3af-46d2-95e2-385d7b5f9fac None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:50.935003 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f138463-a3af-46d2-95e2-385d7b5f9fac None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:50.957223 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-7f138463-a3af-46d2-95e2-385d7b5f9fac None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 26 10:50:50.957223 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:50.957223 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:50.957223 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:50.957223 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:50.957223 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:50.957223 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:50.957223 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:50.957223 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:50.957223 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:50.957223 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:50.957223 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:50.957223 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:50:50.957223 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:50:50.957223 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:50:50.957223 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:50:50.958770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:50.958770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:50.958770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:50:50.958770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:50:50.958770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:50:50.958770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:50:50.958770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:50.958770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:50.958770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:50.958770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:50.958770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:50.958770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:50.958770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:50.958770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:50.958770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:50.958770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:50.958770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:50.958770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:50.959758 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:50.959758 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:50.959758 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:50:50.959758 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:50:50.959758 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:50:50.959758 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:50:50.959758 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:50:50.959758 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:50:50.959758 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 26 10:50:50.959758 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:50.963413 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 278/562] 10.222.0.45 () {56 vars in 1093 bytes} [Wed Oct 26 10:50:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:50:50.968771 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f138463-a3af-46d2-95e2-385d7b5f9fac None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:50.990180 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cbfbc4-9bf1-4a97-aaea-e1db3b21e79a None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:51.046020 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ed96b-be78-4996-8c21-7bc4f72fcf07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:51.046636 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ed96b-be78-4996-8c21-7bc4f72fcf07 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:51.046921 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ed96b-be78-4996-8c21-7bc4f72fcf07 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:51.047197 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ed96b-be78-4996-8c21-7bc4f72fcf07 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:51.047926 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ed96b-be78-4996-8c21-7bc4f72fcf07 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:51.048261 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ed96b-be78-4996-8c21-7bc4f72fcf07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:51.049690 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ed96b-be78-4996-8c21-7bc4f72fcf07 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:51.076186 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 285/563] 10.222.0.45 () {56 vars in 1149 bytes} [Wed Oct 26 10:50:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:51.078722 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ed96b-be78-4996-8c21-7bc4f72fcf07 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:51.143437 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:51.153534 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f138463-a3af-46d2-95e2-385d7b5f9fac None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:51.186264 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ed96b-be78-4996-8c21-7bc4f72fcf07 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:51.216951 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f11d52-d0eb-40fa-958c-e93248183300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:51.217577 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f11d52-d0eb-40fa-958c-e93248183300 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:51.217838 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f11d52-d0eb-40fa-958c-e93248183300 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:51.218107 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f11d52-d0eb-40fa-958c-e93248183300 None admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:51.218836 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f11d52-d0eb-40fa-958c-e93248183300 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:51.219144 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f11d52-d0eb-40fa-958c-e93248183300 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:51.220594 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f11d52-d0eb-40fa-958c-e93248183300 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:51.222400 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8e513-b9dd-4172-af80-b2ce1a7e22f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:51.223536 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8e513-b9dd-4172-af80-b2ce1a7e22f5 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:51.226329 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8e513-b9dd-4172-af80-b2ce1a7e22f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:51.226810 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8e513-b9dd-4172-af80-b2ce1a7e22f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:51.246894 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff8e513-b9dd-4172-af80-b2ce1a7e22f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:51.249866 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff8e513-b9dd-4172-af80-b2ce1a7e22f5 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:51.252383 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 279/564] 10.222.0.45 () {56 vars in 1133 bytes} [Wed Oct 26 10:50:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:51.261019 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f11d52-d0eb-40fa-958c-e93248183300 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:51.278877 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-9ff8e513-b9dd-4172-af80-b2ce1a7e22f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:51.278877 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:51.278877 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:51.278877 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:51.278877 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:51.278877 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:51.278877 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:51.278877 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:51.278877 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:51.278877 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:51.278877 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:51.278877 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:51.278877 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:50:51.278877 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:50:51.278877 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:50:51.278877 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:50:51.279867 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:51.279867 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:51.279867 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:51.279867 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:51.279867 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:51.279867 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:51.279867 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:51.279867 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:51.279867 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:51.279867 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:51.279867 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:51.279867 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:51.279867 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:51.279867 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:51.279867 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:51.279867 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:51.279867 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:50:51.280825 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:50:51.280825 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:51.280825 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:51.288545 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 286/565] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:50:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:51.292288 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8e513-b9dd-4172-af80-b2ce1a7e22f5 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:51.380902 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:51.469867 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f11d52-d0eb-40fa-958c-e93248183300 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:51.491136 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8e513-b9dd-4172-af80-b2ce1a7e22f5 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:51.520411 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:51.543271 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314cb62-be4d-4c42-bd56-b7d2591092cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:51.546308 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314cb62-be4d-4c42-bd56-b7d2591092cd None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:51.546308 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314cb62-be4d-4c42-bd56-b7d2591092cd None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:51.546308 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314cb62-be4d-4c42-bd56-b7d2591092cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:51.566570 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2ee84-70c0-4028-b86e-822ed0ba6183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:51.567185 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2ee84-70c0-4028-b86e-822ed0ba6183 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:51.567468 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2ee84-70c0-4028-b86e-822ed0ba6183 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:51.567775 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2ee84-70c0-4028-b86e-822ed0ba6183 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:51.568461 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2ee84-70c0-4028-b86e-822ed0ba6183 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:51.568766 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2ee84-70c0-4028-b86e-822ed0ba6183 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:51.571767 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2ee84-70c0-4028-b86e-822ed0ba6183 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:51.596735 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 287/566] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:50:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:51.601132 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2ee84-70c0-4028-b86e-822ed0ba6183 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:51.675228 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6314cb62-be4d-4c42-bd56-b7d2591092cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:51.677559 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6314cb62-be4d-4c42-bd56-b7d2591092cd None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:51.784413 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:51.787713 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2ee84-70c0-4028-b86e-822ed0ba6183 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:51.857852 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8de08-62a3-4563-b088-db58b108750c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:51.858501 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8de08-62a3-4563-b088-db58b108750c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:51.858787 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8de08-62a3-4563-b088-db58b108750c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:51.859064 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8de08-62a3-4563-b088-db58b108750c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:51.859868 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 280/567] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 26 10:50:51 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 26 10:50:51.867441 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314cb62-be4d-4c42-bd56-b7d2591092cd None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:51.873797 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d8de08-62a3-4563-b088-db58b108750c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:51.875274 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d8de08-62a3-4563-b088-db58b108750c None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:51.897098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-70d8de08-62a3-4563-b088-db58b108750c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:50:51.897098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:51.897098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:51.897098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:51.897098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:51.897098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:51.897098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:51.897098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:51.897098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:51.897098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:51.897098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:51.897098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:51.897098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:50:51.897098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:50:51.897098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:50:51.898044 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:50:51.898044 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:51.898044 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:51.898044 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:51.898044 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:51.898044 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:51.898044 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:51.898044 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:51.898044 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:51.898044 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:51.898044 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:51.898044 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:51.898044 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:51.898044 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:51.898044 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:51.898044 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:51.898044 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:51.899709 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:50:51.899709 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:50:51.899709 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:50:51.899709 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:50:51.899709 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:50:51.899709 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:50:51.899709 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:50:51.899709 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:51.899709 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 288/568] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 26 10:50:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:51.906103 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8de08-62a3-4563-b088-db58b108750c None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:51.975641 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:52.066691 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314cb62-be4d-4c42-bd56-b7d2591092cd None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:52.098774 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8de08-62a3-4563-b088-db58b108750c None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:52.124693 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce6082-7d94-4287-a6a9-8f4338779d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:52.125835 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce6082-7d94-4287-a6a9-8f4338779d7e None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:52.126685 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce6082-7d94-4287-a6a9-8f4338779d7e None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:52.127232 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce6082-7d94-4287-a6a9-8f4338779d7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:52.138258 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f93e03-474d-4fe8-ad86-ad6018054bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:52.138923 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f93e03-474d-4fe8-ad86-ad6018054bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:52.139206 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f93e03-474d-4fe8-ad86-ad6018054bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:52.139486 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f93e03-474d-4fe8-ad86-ad6018054bc7 None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:52.140279 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f93e03-474d-4fe8-ad86-ad6018054bc7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:52.140612 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f93e03-474d-4fe8-ad86-ad6018054bc7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:52.141472 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce6082-7d94-4287-a6a9-8f4338779d7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:52.142016 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f93e03-474d-4fe8-ad86-ad6018054bc7 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:52.143227 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce6082-7d94-4287-a6a9-8f4338779d7e None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:52.155157 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 289/569] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 26 10:50:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:52.156427 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c2852-504f-4f34-ba48-fc93213a6b9a None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:52.156716 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c2852-504f-4f34-ba48-fc93213a6b9a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:52.156995 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c2852-504f-4f34-ba48-fc93213a6b9a None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:52.162835 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 290/570] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:50:52.162835 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c2852-504f-4f34-ba48-fc93213a6b9a None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:52.168117 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-16ce6082-7d94-4287-a6a9-8f4338779d7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:52.168117 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:52.168117 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:52.168117 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:52.168117 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:52.168117 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:52.168117 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:52.168117 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:52.168117 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:52.168117 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:52.168117 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:52.168117 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:52.168117 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:50:52.168117 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:50:52.168117 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:50:52.168117 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:50:52.169112 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:52.169112 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:52.169112 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:52.169112 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:52.169112 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:52.169112 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:52.169112 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:52.169112 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:52.169112 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:52.169112 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:52.169112 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:52.169112 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:52.169112 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:52.169112 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:52.169112 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:52.169112 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:52.169112 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:50:52.170050 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:50:52.170050 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:52.170050 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:52.172994 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 281/571] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:50:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:52.174406 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12446b2-0f16-4612-83cc-89712d05b8a5 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:52.174819 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12446b2-0f16-4612-83cc-89712d05b8a5 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:52.175229 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12446b2-0f16-4612-83cc-89712d05b8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:52.191715 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:52.201131 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-f12446b2-0f16-4612-83cc-89712d05b8a5 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:52.202372 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-f12446b2-0f16-4612-83cc-89712d05b8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:52.288427 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 282/572] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:50:52.289289 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12446b2-0f16-4612-83cc-89712d05b8a5 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:52.296783 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:52.311091 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c2852-504f-4f34-ba48-fc93213a6b9a None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:52.395204 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367862a-5d8e-4280-87e9-46bf59795108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:52.397364 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367862a-5d8e-4280-87e9-46bf59795108 None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:52.397652 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367862a-5d8e-4280-87e9-46bf59795108 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:52.397928 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367862a-5d8e-4280-87e9-46bf59795108 None admin] PATH_INFO: `/v3/projects/e8f0f02a607a49e0b88c75019795b726/users/3c90765757a34c6291c9980a7d5d5c79/roles/9102b6e1623a43e99513d6ad55d55c7b` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:52.429565 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6367862a-5d8e-4280-87e9-46bf59795108 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8f0f02a607a49e0b88c75019795b726, user_id=3c90765757a34c6291c9980a7d5d5c79, role_id=9102b6e1623a43e99513d6ad55d55c7b)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:52.431322 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6367862a-5d8e-4280-87e9-46bf59795108 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:52.478359 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12446b2-0f16-4612-83cc-89712d05b8a5 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:52.506525 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 291/573] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 26 10:50:52 2022] PUT /identity/v3/projects/e8f0f02a607a49e0b88c75019795b726/users/3c90765757a34c6291c9980a7d5d5c79/roles/9102b6e1623a43e99513d6ad55d55c7b => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:50:52.514667 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968850e-ff7a-4274-8d71-eb2c7a026698 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:52.515582 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968850e-ff7a-4274-8d71-eb2c7a026698 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:52.516105 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968850e-ff7a-4274-8d71-eb2c7a026698 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:52.518276 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 292/574] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:50:52.530561 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b5887-fd40-433c-8c9b-cf6748d8d3b2 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:52.531063 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b5887-fd40-433c-8c9b-cf6748d8d3b2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:52.531348 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b5887-fd40-433c-8c9b-cf6748d8d3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:52.539235 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed88c5-262b-423f-805f-a53f3c210ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:52.539929 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed88c5-262b-423f-805f-a53f3c210ad4 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:52.540584 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed88c5-262b-423f-805f-a53f3c210ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:52.540866 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed88c5-262b-423f-805f-a53f3c210ad4 None admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:52.541536 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed88c5-262b-423f-805f-a53f3c210ad4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:52.541843 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed88c5-262b-423f-805f-a53f3c210ad4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:52.550324 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed88c5-262b-423f-805f-a53f3c210ad4 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:52.561728 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:52.577015 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-350b5887-fd40-433c-8c9b-cf6748d8d3b2 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:52.579566 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-350b5887-fd40-433c-8c9b-cf6748d8d3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:52.585237 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 283/575] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:50:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:52.592043 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed88c5-262b-423f-805f-a53f3c210ad4 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:52.695576 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 293/576] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 26 10:50:52.696432 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b5887-fd40-433c-8c9b-cf6748d8d3b2 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:52.745630 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed88c5-262b-423f-805f-a53f3c210ad4 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:52.799333 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca3f5e-3a8f-4f2e-b4d7-05bfe6e1a3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:52.800262 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca3f5e-3a8f-4f2e-b4d7-05bfe6e1a3ff None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:52.800549 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca3f5e-3a8f-4f2e-b4d7-05bfe6e1a3ff None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:52.800910 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca3f5e-3a8f-4f2e-b4d7-05bfe6e1a3ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:52.810382 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca3f5e-3a8f-4f2e-b4d7-05bfe6e1a3ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:52.811869 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca3f5e-3a8f-4f2e-b4d7-05bfe6e1a3ff None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:52.824926 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:52.826030 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-ffca3f5e-3a8f-4f2e-b4d7-05bfe6e1a3ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:50:52.826030 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:52.826030 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:52.826030 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:52.826030 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:52.826030 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:52.826030 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:52.826030 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:52.826030 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:52.826030 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:52.826030 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:52.826030 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:52.826030 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:50:52.826030 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:50:52.826030 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:50:52.826941 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:50:52.826941 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:52.826941 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:52.826941 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:52.826941 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:52.826941 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:52.826941 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:52.826941 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:52.826941 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:52.826941 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:52.826941 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:52.826941 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:52.826941 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:52.826941 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:52.826941 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:52.826941 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:52.826941 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:52.827834 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:50:52.827834 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:50:52.827834 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:50:52.827834 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:50:52.827834 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:50:52.827834 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:50:52.827834 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:50:52.827834 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:52.827834 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 284/577] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 26 10:50:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:50:52.835688 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca3f5e-3a8f-4f2e-b4d7-05bfe6e1a3ff None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:52.885396 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b5887-fd40-433c-8c9b-cf6748d8d3b2 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:52.964952 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f856d1-b35f-47ab-aee6-dc9a74af1594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:52.966060 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f856d1-b35f-47ab-aee6-dc9a74af1594 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:52.966558 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f856d1-b35f-47ab-aee6-dc9a74af1594 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:52.967139 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f856d1-b35f-47ab-aee6-dc9a74af1594 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:52.968187 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f856d1-b35f-47ab-aee6-dc9a74af1594 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:52.971053 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f856d1-b35f-47ab-aee6-dc9a74af1594 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:52.976592 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:52.997815 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-d5f856d1-b35f-47ab-aee6-dc9a74af1594 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 26 10:50:52.997815 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:52.997815 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:50:52.997815 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:50:52.997815 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:50:52.997815 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:50:52.997815 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:50:52.997815 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:50:52.997815 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 26 10:50:52.997815 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:52.997815 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:50:52.997815 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:52.997815 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:52.997815 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:52.997815 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:52.997815 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:52.997815 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:52.999031 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:52.999031 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:52.999031 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:52.999031 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:52.999031 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:52.999031 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:52.999031 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:50:52.999031 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:50:52.999031 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:50:52.999031 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:50:52.999031 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:52.999031 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:52.999031 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:52.999031 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:52.999031 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:52.999031 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:52.999904 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:52.999904 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:52.999904 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:52.999904 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:52.999904 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:52.999904 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:52.999904 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:52.999904 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:52.999904 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:52.999904 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:52.999904 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:50:52.999904 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:50:52.999904 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 26 10:50:52.999904 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:53.002416 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 294/578] 10.222.0.45 () {56 vars in 1129 bytes} [Wed Oct 26 10:50:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:53.003259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f856d1-b35f-47ab-aee6-dc9a74af1594 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:53.054405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca3f5e-3a8f-4f2e-b4d7-05bfe6e1a3ff None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:53.094930 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63160fa6-34cd-4c1d-a95e-39ad1f5a533a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:53.096106 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63160fa6-34cd-4c1d-a95e-39ad1f5a533a None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:53.096106 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63160fa6-34cd-4c1d-a95e-39ad1f5a533a None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:53.096106 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63160fa6-34cd-4c1d-a95e-39ad1f5a533a None admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:53.096825 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63160fa6-34cd-4c1d-a95e-39ad1f5a533a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:53.097138 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63160fa6-34cd-4c1d-a95e-39ad1f5a533a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:53.098610 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63160fa6-34cd-4c1d-a95e-39ad1f5a533a None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:53.112239 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 285/579] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 26 10:50:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:53.113068 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63160fa6-34cd-4c1d-a95e-39ad1f5a533a None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:53.135000 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f856d1-b35f-47ab-aee6-dc9a74af1594 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:53.175507 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26560c-452c-435c-acc3-71f1c1fc5846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:53.176159 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26560c-452c-435c-acc3-71f1c1fc5846 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:53.176465 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26560c-452c-435c-acc3-71f1c1fc5846 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:53.176709 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26560c-452c-435c-acc3-71f1c1fc5846 None admin] PATH_INFO: `/v3/services/network` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:53.177330 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26560c-452c-435c-acc3-71f1c1fc5846 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:53.178720 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26560c-452c-435c-acc3-71f1c1fc5846 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:53.188259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-4a26560c-452c-435c-acc3-71f1c1fc5846 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 26 10:50:53.188259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:53.188259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:50:53.188259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:50:53.188259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:50:53.188259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:50:53.188259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:50:53.188259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:50:53.188259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 26 10:50:53.188259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:53.188259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:50:53.188259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:53.188259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:53.188259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:53.188259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:53.188259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:53.188259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:53.189345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:53.189345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:53.189345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:53.189345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:53.189345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:53.189345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:53.189345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:50:53.189345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:50:53.189345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:50:53.189345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:50:53.189345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:53.189345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:53.189345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:53.189345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:53.189345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:53.189345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:53.190248 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:53.190248 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:53.190248 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:53.190248 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:53.190248 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:53.190248 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:53.190248 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:53.190248 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:53.190248 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:53.190248 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:53.190248 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:50:53.190248 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:50:53.190248 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 26 10:50:53.190248 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:53.190248 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 295/580] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 26 10:50:53 2022] GET /identity/v3/services/network => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:53.191064 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdce474-54f6-4574-9bb2-44a39471d9e5 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:53.191064 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdce474-54f6-4574-9bb2-44a39471d9e5 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:53.191064 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdce474-54f6-4574-9bb2-44a39471d9e5 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:53.192295 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 296/581] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:50:53.193013 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdce474-54f6-4574-9bb2-44a39471d9e5 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:53.196528 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:53.233079 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63160fa6-34cd-4c1d-a95e-39ad1f5a533a None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:53.254528 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:53.275387 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d54b1-0998-41bb-b1a4-50aa341ee582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:53.276003 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d54b1-0998-41bb-b1a4-50aa341ee582 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:53.276314 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d54b1-0998-41bb-b1a4-50aa341ee582 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:53.276586 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d54b1-0998-41bb-b1a4-50aa341ee582 None admin] PATH_INFO: `/v3/services` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:53.277239 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d54b1-0998-41bb-b1a4-50aa341ee582 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:53.277509 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d54b1-0998-41bb-b1a4-50aa341ee582 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:53.278887 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d54b1-0998-41bb-b1a4-50aa341ee582 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:53.283419 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 286/582] 10.222.0.45 () {56 vars in 1124 bytes} [Wed Oct 26 10:50:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:53.284287 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d54b1-0998-41bb-b1a4-50aa341ee582 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:53.333363 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdce474-54f6-4574-9bb2-44a39471d9e5 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:53.372674 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa29c6-e767-493d-beb2-05a111e29aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:53.373462 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa29c6-e767-493d-beb2-05a111e29aa2 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:53.373794 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa29c6-e767-493d-beb2-05a111e29aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:53.374071 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa29c6-e767-493d-beb2-05a111e29aa2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:53.374849 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa29c6-e767-493d-beb2-05a111e29aa2 None admin] RBAC: Adding query filter params (role.id=d6876897d7c548b7900d4e01cb45a007, scope.project.id=e8f0f02a607a49e0b88c75019795b726, user.id=a852a777cb6a4863bebdb949cc71ea65) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:53.375163 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa29c6-e767-493d-beb2-05a111e29aa2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:53.376907 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa29c6-e767-493d-beb2-05a111e29aa2 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:53.392512 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 297/583] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 26 10:50:53 2022] GET /identity/v3/role_assignments?user.id=a852a777cb6a4863bebdb949cc71ea65&scope.project.id=e8f0f02a607a49e0b88c75019795b726&role.id=d6876897d7c548b7900d4e01cb45a007 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:53.392512 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb449cd3-830c-40a8-84c9-0fa4551e8044 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:53.392512 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb449cd3-830c-40a8-84c9-0fa4551e8044 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:53.392512 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb449cd3-830c-40a8-84c9-0fa4551e8044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:53.405651 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d54b1-0998-41bb-b1a4-50aa341ee582 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:53.411132 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-eb449cd3-830c-40a8-84c9-0fa4551e8044 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:53.412560 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-eb449cd3-830c-40a8-84c9-0fa4551e8044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:53.453135 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06003160-0724-47d4-9198-b8bd52e6d57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:53.453847 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06003160-0724-47d4-9198-b8bd52e6d57e None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:53.454197 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06003160-0724-47d4-9198-b8bd52e6d57e None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:53.454538 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06003160-0724-47d4-9198-b8bd52e6d57e None admin] PATH_INFO: `/v3/services` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:53.455245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06003160-0724-47d4-9198-b8bd52e6d57e None admin] RBAC: Adding query filter params (name=network) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:53.455615 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06003160-0724-47d4-9198-b8bd52e6d57e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:53.457232 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06003160-0724-47d4-9198-b8bd52e6d57e None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:53.462903 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 287/584] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Oct 26 10:50:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:53.463922 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06003160-0724-47d4-9198-b8bd52e6d57e None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:53.492657 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:53.507738 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 298/585] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:50:53.509871 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb449cd3-830c-40a8-84c9-0fa4551e8044 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:53.535303 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:53.638244 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06003160-0724-47d4-9198-b8bd52e6d57e None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:53.684770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f7197-a4c8-4fcf-af31-cfcacec710a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:53.685391 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f7197-a4c8-4fcf-af31-cfcacec710a2 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:53.685674 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f7197-a4c8-4fcf-af31-cfcacec710a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:53.685951 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f7197-a4c8-4fcf-af31-cfcacec710a2 None admin] PATH_INFO: `/v3/services` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:53.686129 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb449cd3-830c-40a8-84c9-0fa4551e8044 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:53.686587 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f7197-a4c8-4fcf-af31-cfcacec710a2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:53.686892 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f7197-a4c8-4fcf-af31-cfcacec710a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:53.689427 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f7197-a4c8-4fcf-af31-cfcacec710a2 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:53.695333 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 288/586] 10.222.0.45 () {56 vars in 1124 bytes} [Wed Oct 26 10:50:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:53.700606 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f7197-a4c8-4fcf-af31-cfcacec710a2 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:53.737345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed48a8-38f8-4fb8-a066-cec3d919d577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:53.738112 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed48a8-38f8-4fb8-a066-cec3d919d577 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:53.738535 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed48a8-38f8-4fb8-a066-cec3d919d577 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:53.738819 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed48a8-38f8-4fb8-a066-cec3d919d577 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:53.739446 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed48a8-38f8-4fb8-a066-cec3d919d577 None admin] RBAC: Adding query filter params (type=network) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:53.740324 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed48a8-38f8-4fb8-a066-cec3d919d577 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:53.741767 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed48a8-38f8-4fb8-a066-cec3d919d577 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:53.748552 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 299/587] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Oct 26 10:50:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:53.754333 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed48a8-38f8-4fb8-a066-cec3d919d577 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:53.826528 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:53.838325 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f7197-a4c8-4fcf-af31-cfcacec710a2 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:53.847885 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:53.873841 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc187452-96b3-45c8-92ce-b15e813f9e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:53.874493 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc187452-96b3-45c8-92ce-b15e813f9e36 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:53.874739 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc187452-96b3-45c8-92ce-b15e813f9e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:53.875015 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc187452-96b3-45c8-92ce-b15e813f9e36 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:53.875781 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc187452-96b3-45c8-92ce-b15e813f9e36 None admin] RBAC: Adding query filter params (interface=public, service_id=a06b20120b794ccc92f9c550d87eadf1, region_id=RegionOne) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:53.876014 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc187452-96b3-45c8-92ce-b15e813f9e36 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:53.877427 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc187452-96b3-45c8-92ce-b15e813f9e36 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:53.885101 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed48a8-38f8-4fb8-a066-cec3d919d577 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:53.885405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 289/588] 10.222.0.45 () {56 vars in 1251 bytes} [Wed Oct 26 10:50:53 2022] GET /identity/v3/endpoints?service_id=a06b20120b794ccc92f9c550d87eadf1&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:53.889988 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc187452-96b3-45c8-92ce-b15e813f9e36 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:53.924972 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4425f3-2b5f-4d69-9e91-92bbb88cd63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:53.925743 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4425f3-2b5f-4d69-9e91-92bbb88cd63f None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:53.926122 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4425f3-2b5f-4d69-9e91-92bbb88cd63f None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:53.926493 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4425f3-2b5f-4d69-9e91-92bbb88cd63f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:53.927848 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4425f3-2b5f-4d69-9e91-92bbb88cd63f None admin] RBAC: Adding query filter params (interface=public, service_id=96edbd6179bd4dfd90d51116349bc7f4, region_id=RegionOne) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:53.928282 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4425f3-2b5f-4d69-9e91-92bbb88cd63f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:53.929760 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4425f3-2b5f-4d69-9e91-92bbb88cd63f None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:53.938428 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 300/589] 10.222.0.45 () {56 vars in 1251 bytes} [Wed Oct 26 10:50:53 2022] GET /identity/v3/endpoints?service_id=96edbd6179bd4dfd90d51116349bc7f4&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:50:53.939389 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4425f3-2b5f-4d69-9e91-92bbb88cd63f None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:54.008891 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc187452-96b3-45c8-92ce-b15e813f9e36 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:54.046311 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6458c-0de4-48d5-9069-79cd0c3c28ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:54.047146 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6458c-0de4-48d5-9069-79cd0c3c28ef None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:54.047629 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6458c-0de4-48d5-9069-79cd0c3c28ef None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:54.048000 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6458c-0de4-48d5-9069-79cd0c3c28ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:54.059590 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e6458c-0de4-48d5-9069-79cd0c3c28ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:50:54.064040 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4425f3-2b5f-4d69-9e91-92bbb88cd63f None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:54.065504 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-a0e6458c-0de4-48d5-9069-79cd0c3c28ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:50:54.065504 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:54.065504 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:54.065504 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:54.065504 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:54.065504 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:54.065504 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:54.065504 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:54.065504 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:54.065504 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:54.065504 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:54.065504 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:54.065504 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:50:54.065504 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:50:54.065504 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:50:54.065504 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:50:54.066618 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:50:54.066618 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:50:54.066618 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:50:54.066618 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:50:54.066618 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:54.066618 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:54.066618 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:54.066618 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:54.066618 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:54.066618 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:54.066618 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:54.066618 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:54.066618 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:54.066618 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:54.066618 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:54.066618 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:54.068353 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:54.068353 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:54.068353 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:54.068353 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:54.068353 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:50:54.068353 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:50:54.068353 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:50:54.068353 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:50:54.068353 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:50:54.068353 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:50:54.068353 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:50:54.068353 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:54.073964 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 290/590] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 26 10:50:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:54.074837 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6458c-0de4-48d5-9069-79cd0c3c28ef None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:54.092010 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:54.104853 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308dab3-95ff-42f9-9bc7-2c79389da243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:54.123661 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308dab3-95ff-42f9-9bc7-2c79389da243 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:54.123661 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308dab3-95ff-42f9-9bc7-2c79389da243 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:54.123661 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308dab3-95ff-42f9-9bc7-2c79389da243 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:54.123661 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308dab3-95ff-42f9-9bc7-2c79389da243 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:54.123661 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308dab3-95ff-42f9-9bc7-2c79389da243 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:54.124076 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:54.124160 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 301/591] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Oct 26 10:50:53 2022] GET /identity/v3/services => generated 772 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:54.124160 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308dab3-95ff-42f9-9bc7-2c79389da243 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:54.250982 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6458c-0de4-48d5-9069-79cd0c3c28ef None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:54.314752 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308dab3-95ff-42f9-9bc7-2c79389da243 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:54.322210 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa708d-3c39-467b-83dd-310854815bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:54.325351 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa708d-3c39-467b-83dd-310854815bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:54.325658 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa708d-3c39-467b-83dd-310854815bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:54.325905 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa708d-3c39-467b-83dd-310854815bc8 None admin] PATH_INFO: `/v3/services` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:54.326536 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffa708d-3c39-467b-83dd-310854815bc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:54.327956 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffa708d-3c39-467b-83dd-310854815bc8 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:54.348707 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 291/592] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Oct 26 10:50:54 2022] GET /identity/v3/services => generated 772 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:54.369128 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8786ba02-04b7-46f9-91e4-6c305d8742d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:54.369765 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786ba02-04b7-46f9-91e4-6c305d8742d5 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:54.370054 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786ba02-04b7-46f9-91e4-6c305d8742d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:54.370332 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786ba02-04b7-46f9-91e4-6c305d8742d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:54.371011 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8786ba02-04b7-46f9-91e4-6c305d8742d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:54.371316 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8786ba02-04b7-46f9-91e4-6c305d8742d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:54.372889 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8786ba02-04b7-46f9-91e4-6c305d8742d5 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:54.383656 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 302/593] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 26 10:50:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:54.389714 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa708d-3c39-467b-83dd-310854815bc8 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:54.502400 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:54.509371 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa708d-3c39-467b-83dd-310854815bc8 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:54.547747 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086f4ec-70ac-4d20-8a09-9734df353fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:54.548462 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086f4ec-70ac-4d20-8a09-9734df353fe2 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:54.548699 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086f4ec-70ac-4d20-8a09-9734df353fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:54.548971 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086f4ec-70ac-4d20-8a09-9734df353fe2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:54.559621 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9086f4ec-70ac-4d20-8a09-9734df353fe2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:54.561113 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9086f4ec-70ac-4d20-8a09-9734df353fe2 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:54.576485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-9086f4ec-70ac-4d20-8a09-9734df353fe2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:54.576485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:54.576485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:54.576485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:54.576485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:54.576485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:54.576485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:54.576485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:54.576485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:54.576485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:54.576485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:54.576485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:54.576485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:50:54.576485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:50:54.576485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:50:54.576485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:50:54.578769 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:54.578769 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:54.578769 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:54.578769 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:54.578769 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:54.578769 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:54.578769 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:54.578769 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:54.578769 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:54.578769 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:54.578769 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:54.578769 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:54.578769 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:54.578769 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:54.578769 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:54.578769 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:54.578769 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:50:54.580957 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:50:54.580957 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:54.580957 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:54.580957 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 292/594] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:50:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:54.584273 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8786ba02-04b7-46f9-91e4-6c305d8742d5 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:54.642070 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:54.697543 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8786ba02-04b7-46f9-91e4-6c305d8742d5 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:54.734914 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb7465-45cd-4d3e-a3a8-ea4e779906ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:54.735530 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb7465-45cd-4d3e-a3a8-ea4e779906ab None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:54.735861 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb7465-45cd-4d3e-a3a8-ea4e779906ab None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:54.736164 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb7465-45cd-4d3e-a3a8-ea4e779906ab None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:54.736809 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb7465-45cd-4d3e-a3a8-ea4e779906ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:54.737112 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb7465-45cd-4d3e-a3a8-ea4e779906ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:54.738555 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb7465-45cd-4d3e-a3a8-ea4e779906ab None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:54.755156 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 303/595] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:54.761196 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086f4ec-70ac-4d20-8a09-9734df353fe2 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:54.890441 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086f4ec-70ac-4d20-8a09-9734df353fe2 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:54.905630 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66945e0a-6cb0-49e3-9841-bbdebe2c0d3e None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:54.905967 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66945e0a-6cb0-49e3-9841-bbdebe2c0d3e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:54.906188 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66945e0a-6cb0-49e3-9841-bbdebe2c0d3e None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:54.907644 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 304/596] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:50:54.912908 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10792fd-2514-4f32-8906-e05ce2a609b3 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:54.913444 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10792fd-2514-4f32-8906-e05ce2a609b3 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:54.913938 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10792fd-2514-4f32-8906-e05ce2a609b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:54.933838 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-f10792fd-2514-4f32-8906-e05ce2a609b3 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:54.935529 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f10792fd-2514-4f32-8906-e05ce2a609b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:54.945357 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1cd0cf-9e51-4f99-a799-27d297afb34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:54.946006 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1cd0cf-9e51-4f99-a799-27d297afb34f None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:54.946289 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1cd0cf-9e51-4f99-a799-27d297afb34f None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:54.946565 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1cd0cf-9e51-4f99-a799-27d297afb34f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:54.957060 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1cd0cf-9e51-4f99-a799-27d297afb34f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:54.959623 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1cd0cf-9e51-4f99-a799-27d297afb34f None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:54.980704 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-8e1cd0cf-9e51-4f99-a799-27d297afb34f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 26 10:50:54.980704 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:54.980704 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:54.980704 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:54.980704 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:54.980704 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:54.980704 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:54.980704 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:54.980704 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:54.980704 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:54.980704 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:54.980704 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:54.980704 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:50:54.980704 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:50:54.980704 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:50:54.980704 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:50:54.981712 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:54.981712 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:54.981712 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:50:54.981712 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:50:54.981712 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:50:54.981712 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:50:54.981712 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:54.981712 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:54.981712 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:54.981712 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:54.981712 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:54.981712 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:54.981712 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:54.981712 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:54.981712 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:54.981712 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:54.981712 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:54.981712 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:54.982665 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:54.982665 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:54.982665 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:50:54.982665 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:50:54.982665 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:50:54.982665 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:50:54.982665 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:50:54.982665 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:50:54.982665 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 26 10:50:54.982665 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:54.989359 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 293/597] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 26 10:50:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:54.995064 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1cd0cf-9e51-4f99-a799-27d297afb34f None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:55.015576 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:55.060745 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 305/598] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 26 10:50:55.144616 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1cd0cf-9e51-4f99-a799-27d297afb34f None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:55.180217 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f348158-03e7-44d1-b251-61625470e72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:55.181221 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f348158-03e7-44d1-b251-61625470e72d None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:55.181707 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f348158-03e7-44d1-b251-61625470e72d None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:55.182217 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f348158-03e7-44d1-b251-61625470e72d None admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:55.183226 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f348158-03e7-44d1-b251-61625470e72d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:55.183737 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f348158-03e7-44d1-b251-61625470e72d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:55.185392 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f348158-03e7-44d1-b251-61625470e72d None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:55.208482 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 294/599] 10.222.0.45 () {56 vars in 1135 bytes} [Wed Oct 26 10:50:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:55.214359 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10792fd-2514-4f32-8906-e05ce2a609b3 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:55.265414 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:55.336265 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10792fd-2514-4f32-8906-e05ce2a609b3 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:55.385773 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0fd13-661f-4a09-a012-b6bb9e8e478e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:55.386379 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0fd13-661f-4a09-a012-b6bb9e8e478e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:55.386652 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0fd13-661f-4a09-a012-b6bb9e8e478e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:55.386926 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0fd13-661f-4a09-a012-b6bb9e8e478e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:55.426274 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f348158-03e7-44d1-b251-61625470e72d None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:55.490699 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f0fd13-661f-4a09-a012-b6bb9e8e478e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:55.492202 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f0fd13-661f-4a09-a012-b6bb9e8e478e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:55.529122 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:55.583230 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f348158-03e7-44d1-b251-61625470e72d None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:55.592091 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:55.638016 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ab473-ee12-413e-80c5-c871b90e0fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:55.638659 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ab473-ee12-413e-80c5-c871b90e0fca None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:55.638937 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ab473-ee12-413e-80c5-c871b90e0fca None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:55.639206 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ab473-ee12-413e-80c5-c871b90e0fca None admin] PATH_INFO: `/v3/roles/service` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:55.664501 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ab473-ee12-413e-80c5-c871b90e0fca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:50:55.673974 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-1b7ab473-ee12-413e-80c5-c871b90e0fca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:50:55.673974 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:55.673974 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:55.673974 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:55.673974 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:55.673974 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:55.673974 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:55.673974 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:55.673974 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:55.673974 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:55.673974 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:55.673974 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:55.673974 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:50:55.673974 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:50:55.673974 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:50:55.673974 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:50:55.675111 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:50:55.675111 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:50:55.675111 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:50:55.675111 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:50:55.675111 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:55.675111 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:55.675111 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:55.675111 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:55.675111 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:55.675111 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:55.675111 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:55.675111 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:55.675111 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:55.675111 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:55.675111 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:55.675111 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:55.676198 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:55.676198 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:55.676198 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:55.676198 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:55.676198 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:50:55.676198 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:50:55.676198 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:50:55.676198 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:50:55.676198 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:50:55.676198 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:50:55.676198 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:50:55.676198 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:55.680403 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 295/600] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Oct 26 10:50:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:50:55.689403 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ab473-ee12-413e-80c5-c871b90e0fca None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:55.708422 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 306/601] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 26 10:50:55 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 26 10:50:55.709624 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0fd13-661f-4a09-a012-b6bb9e8e478e None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:55.867528 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0fd13-661f-4a09-a012-b6bb9e8e478e None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:55.871743 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ab473-ee12-413e-80c5-c871b90e0fca None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:55.907309 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265af62-b396-4b65-9220-24b367894169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:55.908294 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265af62-b396-4b65-9220-24b367894169 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:55.908887 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265af62-b396-4b65-9220-24b367894169 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:55.910998 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:55.912562 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265af62-b396-4b65-9220-24b367894169 None admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:55.913386 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9265af62-b396-4b65-9220-24b367894169 None admin] RBAC: Adding query filter params (name=service) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:55.914004 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9265af62-b396-4b65-9220-24b367894169 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:55.916538 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9265af62-b396-4b65-9220-24b367894169 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:55.931023 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76193b-a2c5-472a-8200-2609d8674f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:55.933704 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76193b-a2c5-472a-8200-2609d8674f78 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:55.934134 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76193b-a2c5-472a-8200-2609d8674f78 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:55.934580 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76193b-a2c5-472a-8200-2609d8674f78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:55.935497 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 296/602] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Oct 26 10:50:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:55.938537 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265af62-b396-4b65-9220-24b367894169 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:55.956992 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:55.960723 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a76193b-a2c5-472a-8200-2609d8674f78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:55.962086 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a76193b-a2c5-472a-8200-2609d8674f78 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:55.986993 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-4a76193b-a2c5-472a-8200-2609d8674f78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:55.986993 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:55.986993 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:55.986993 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:55.986993 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:55.986993 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:55.986993 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:55.986993 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:55.986993 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:55.986993 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:55.986993 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:55.986993 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:55.986993 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:50:55.986993 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:50:55.986993 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:50:55.986993 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:50:55.988017 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:55.988017 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:55.988017 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:55.988017 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:55.988017 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:55.988017 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:55.988017 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:55.988017 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:55.988017 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:55.988017 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:55.988017 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:55.988017 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:55.988017 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:55.988017 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:55.988017 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:55.988017 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:55.988017 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:50:55.988992 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:50:55.988992 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:55.988992 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:55.988992 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 307/603] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:50:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:55.999500 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76193b-a2c5-472a-8200-2609d8674f78 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:56.105911 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265af62-b396-4b65-9220-24b367894169 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:56.141517 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bdc630-d562-4cf0-8f00-01ae66fd1c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:56.142188 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdc630-d562-4cf0-8f00-01ae66fd1c5e None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:56.142468 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdc630-d562-4cf0-8f00-01ae66fd1c5e None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:56.142741 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdc630-d562-4cf0-8f00-01ae66fd1c5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:56.154966 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bdc630-d562-4cf0-8f00-01ae66fd1c5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:56.156441 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bdc630-d562-4cf0-8f00-01ae66fd1c5e None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:56.172101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-00bdc630-d562-4cf0-8f00-01ae66fd1c5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:56.172101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:56.172101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:56.172101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:56.172101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:56.172101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:56.172101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:56.172101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:56.172101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:56.172101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:56.172101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:56.172101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:56.172101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:50:56.172101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:50:56.172101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:50:56.172101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:50:56.173094 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:56.173094 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:56.173094 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:56.173094 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:56.173094 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:56.173094 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:56.173094 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:56.173094 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:56.173094 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:56.173094 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:56.173094 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:56.173094 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:56.173094 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:56.173094 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:56.173094 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:56.173094 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:56.173094 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:50:56.173988 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:50:56.173988 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:56.173988 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:56.173988 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 297/604] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:50:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:56.184172 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b07909-40ae-4f3e-8ec8-ebd393b60a6c None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:56.184733 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b07909-40ae-4f3e-8ec8-ebd393b60a6c None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:56.185206 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b07909-40ae-4f3e-8ec8-ebd393b60a6c None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:56.186959 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 298/605] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:50:56.187957 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b07909-40ae-4f3e-8ec8-ebd393b60a6c None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:56.210855 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76193b-a2c5-472a-8200-2609d8674f78 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:56.238293 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:56.249021 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1259455-5c68-4ec5-b5f6-1acc8935ee16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:56.249910 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1259455-5c68-4ec5-b5f6-1acc8935ee16 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:56.254541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1259455-5c68-4ec5-b5f6-1acc8935ee16 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:56.254541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1259455-5c68-4ec5-b5f6-1acc8935ee16 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:56.254541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1259455-5c68-4ec5-b5f6-1acc8935ee16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:56.254541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1259455-5c68-4ec5-b5f6-1acc8935ee16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:56.254541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1259455-5c68-4ec5-b5f6-1acc8935ee16 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:56.266020 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 308/606] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:50:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:56.267490 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16824eb8-3f69-4c4b-a867-e61c3fc4f519 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:56.268051 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16824eb8-3f69-4c4b-a867-e61c3fc4f519 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:56.268735 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16824eb8-3f69-4c4b-a867-e61c3fc4f519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:56.290635 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-16824eb8-3f69-4c4b-a867-e61c3fc4f519 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:56.292243 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-16824eb8-3f69-4c4b-a867-e61c3fc4f519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:56.307634 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b07909-40ae-4f3e-8ec8-ebd393b60a6c None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:56.344615 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b9105-6be7-4740-90ba-f268310fc9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:56.345277 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b9105-6be7-4740-90ba-f268310fc9ef None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:56.345620 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b9105-6be7-4740-90ba-f268310fc9ef None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:56.345947 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b9105-6be7-4740-90ba-f268310fc9ef None admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:56.346590 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b9105-6be7-4740-90ba-f268310fc9ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:56.346892 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b9105-6be7-4740-90ba-f268310fc9ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:56.348458 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b9105-6be7-4740-90ba-f268310fc9ef None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:56.355841 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:56.367958 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 299/607] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:50:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:56.367958 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b9105-6be7-4740-90ba-f268310fc9ef None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:56.382796 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 309/608] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:50:56.384106 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16824eb8-3f69-4c4b-a867-e61c3fc4f519 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:56.488973 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16824eb8-3f69-4c4b-a867-e61c3fc4f519 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:56.497337 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:56.502256 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b9105-6be7-4740-90ba-f268310fc9ef None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:56.527604 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf811d81-e8d1-4e43-a240-05814b02a588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:56.528613 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf811d81-e8d1-4e43-a240-05814b02a588 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:56.529104 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf811d81-e8d1-4e43-a240-05814b02a588 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:56.529598 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf811d81-e8d1-4e43-a240-05814b02a588 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:56.537609 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf811d81-e8d1-4e43-a240-05814b02a588 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:56.539351 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf811d81-e8d1-4e43-a240-05814b02a588 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:56.539799 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b14e6b-55a6-4a6b-b5d7-868ea98e2bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:56.544833 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b14e6b-55a6-4a6b-b5d7-868ea98e2bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:56.546670 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b14e6b-55a6-4a6b-b5d7-868ea98e2bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:56.547150 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b14e6b-55a6-4a6b-b5d7-868ea98e2bd1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:56.560345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-cf811d81-e8d1-4e43-a240-05814b02a588 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 26 10:50:56.560345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:56.560345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:56.560345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:56.560345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:56.560345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:56.560345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:56.560345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:56.560345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:56.560345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:56.560345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:56.560345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:56.560345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:50:56.560345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:50:56.560345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:50:56.560345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:50:56.561434 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:56.561434 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:56.561434 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:50:56.561434 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:50:56.561434 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:50:56.561434 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:50:56.561434 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:56.561434 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:56.561434 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:56.561434 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:56.561434 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:56.561434 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:56.561434 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:56.561434 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:56.561434 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:56.561434 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:56.561434 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:56.561434 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:56.562404 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:56.562404 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:56.562404 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:50:56.562404 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:50:56.562404 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:50:56.562404 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:50:56.562404 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:50:56.562404 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:50:56.562404 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 26 10:50:56.562404 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:56.567745 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b14e6b-55a6-4a6b-b5d7-868ea98e2bd1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:56.569985 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b14e6b-55a6-4a6b-b5d7-868ea98e2bd1 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:56.571634 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 310/609] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Oct 26 10:50:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:56.582079 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf811d81-e8d1-4e43-a240-05814b02a588 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:56.596358 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-17b14e6b-55a6-4a6b-b5d7-868ea98e2bd1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:50:56.596358 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:56.596358 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:56.596358 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:56.596358 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:56.596358 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:56.596358 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:56.596358 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:56.596358 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:56.596358 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:56.596358 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:56.596358 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:56.596358 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:50:56.596358 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:50:56.596358 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:50:56.597321 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:50:56.597321 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:56.597321 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:56.597321 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:56.597321 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:56.597321 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:56.597321 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:56.597321 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:56.597321 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:56.597321 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:56.597321 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:56.597321 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:56.597321 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:56.597321 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:56.597321 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:56.597321 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:56.597321 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:56.598212 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:50:56.598212 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:50:56.598212 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:50:56.598212 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:50:56.598212 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:50:56.598212 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:50:56.598212 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:50:56.598212 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:56.601197 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 300/610] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 26 10:50:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:56.606391 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b14e6b-55a6-4a6b-b5d7-868ea98e2bd1 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:56.664441 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:56.738275 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf811d81-e8d1-4e43-a240-05814b02a588 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:56.766722 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b14e6b-55a6-4a6b-b5d7-868ea98e2bd1 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:56.780047 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c1da3-a114-4278-9c10-f88e834d3048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:56.781138 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c1da3-a114-4278-9c10-f88e834d3048 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:56.781434 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c1da3-a114-4278-9c10-f88e834d3048 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:56.781999 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c1da3-a114-4278-9c10-f88e834d3048 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:56.782754 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c1da3-a114-4278-9c10-f88e834d3048 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:56.783073 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c1da3-a114-4278-9c10-f88e834d3048 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:56.784766 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c1da3-a114-4278-9c10-f88e834d3048 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:56.808168 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 311/611] 10.222.0.45 () {56 vars in 1149 bytes} [Wed Oct 26 10:50:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:50:56.809078 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c1da3-a114-4278-9c10-f88e834d3048 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:56.814154 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6173950-2d96-4653-9f2a-1924d3d14810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:56.814787 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6173950-2d96-4653-9f2a-1924d3d14810 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:56.815069 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6173950-2d96-4653-9f2a-1924d3d14810 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:56.815343 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6173950-2d96-4653-9f2a-1924d3d14810 None admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:56.816042 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6173950-2d96-4653-9f2a-1924d3d14810 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:56.816400 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6173950-2d96-4653-9f2a-1924d3d14810 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:56.817840 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6173950-2d96-4653-9f2a-1924d3d14810 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:56.830649 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 301/612] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 26 10:50:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:50:56.831343 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6173950-2d96-4653-9f2a-1924d3d14810 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:56.856672 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:56.920578 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:56.923533 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c1da3-a114-4278-9c10-f88e834d3048 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:56.938863 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6173950-2d96-4653-9f2a-1924d3d14810 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:56.958114 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380035dc-7816-46de-a75e-3d6ee8b7c701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:56.959599 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380035dc-7816-46de-a75e-3d6ee8b7c701 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:56.959877 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380035dc-7816-46de-a75e-3d6ee8b7c701 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:56.960182 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380035dc-7816-46de-a75e-3d6ee8b7c701 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:56.960765 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380035dc-7816-46de-a75e-3d6ee8b7c701 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:56.962160 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380035dc-7816-46de-a75e-3d6ee8b7c701 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:56.970900 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-380035dc-7816-46de-a75e-3d6ee8b7c701 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 26 10:50:56.970900 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:56.970900 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:50:56.970900 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:50:56.970900 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:50:56.970900 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:50:56.970900 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:50:56.970900 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:50:56.970900 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 26 10:50:56.970900 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:56.970900 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:50:56.970900 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:56.970900 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:56.970900 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:56.970900 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:56.970900 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:56.972010 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:56.972010 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:56.972010 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:56.972010 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:56.972010 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:56.972010 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:56.972010 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:56.972010 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:50:56.972010 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:50:56.972010 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:50:56.972010 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:50:56.972010 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:56.972010 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:56.972010 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:56.972010 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:56.972010 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:56.972010 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:56.973173 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:56.973173 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:56.973173 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:56.973173 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:56.973173 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:56.973173 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:56.973173 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:56.973173 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:56.973173 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:56.973173 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:56.973173 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:50:56.973173 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:50:56.973173 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 26 10:50:56.973173 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:56.973173 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 312/613] 10.222.0.45 () {56 vars in 1132 bytes} [Wed Oct 26 10:50:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:56.973993 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f32899-e162-41d7-9121-4488db24323c None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:56.973993 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f32899-e162-41d7-9121-4488db24323c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:56.974154 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f32899-e162-41d7-9121-4488db24323c None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:56.979455 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 313/614] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:50:56.979455 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f32899-e162-41d7-9121-4488db24323c None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:56.985239 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2074a-7982-442b-8a0f-a156dee35ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:56.986063 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2074a-7982-442b-8a0f-a156dee35ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:56.986490 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2074a-7982-442b-8a0f-a156dee35ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:56.986902 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2074a-7982-442b-8a0f-a156dee35ec2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:57.059062 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a2074a-7982-442b-8a0f-a156dee35ec2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:57.060766 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a2074a-7982-442b-8a0f-a156dee35ec2 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:57.085369 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:57.086677 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f32899-e162-41d7-9121-4488db24323c None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:57.126327 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634ddc3-2acc-41bd-9939-54f0b0a1f186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:57.127233 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634ddc3-2acc-41bd-9939-54f0b0a1f186 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:57.127705 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634ddc3-2acc-41bd-9939-54f0b0a1f186 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:57.128383 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634ddc3-2acc-41bd-9939-54f0b0a1f186 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:57.129451 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e634ddc3-2acc-41bd-9939-54f0b0a1f186 None admin] RBAC: Adding query filter params (role.id=d6876897d7c548b7900d4e01cb45a007, scope.project.id=e8f0f02a607a49e0b88c75019795b726, user.id=d21b84cc38a848de8d19a41e1eb04a58) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:57.130487 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e634ddc3-2acc-41bd-9939-54f0b0a1f186 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:57.132403 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e634ddc3-2acc-41bd-9939-54f0b0a1f186 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:57.138567 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 314/615] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 26 10:50:56 2022] GET /identity/v3/role_assignments?user.id=d21b84cc38a848de8d19a41e1eb04a58&scope.project.id=e8f0f02a607a49e0b88c75019795b726&role.id=d6876897d7c548b7900d4e01cb45a007 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:57.139616 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634ddc3-2acc-41bd-9939-54f0b0a1f186 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:57.178171 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 302/616] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 26 10:50:56 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 26 10:50:57.179469 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8936c4-baa8-4fd1-872f-1abc2d6637c4 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:57.179763 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8936c4-baa8-4fd1-872f-1abc2d6637c4 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:57.180039 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8936c4-baa8-4fd1-872f-1abc2d6637c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:57.185367 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:57.199464 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-eb8936c4-baa8-4fd1-872f-1abc2d6637c4 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:57.200857 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-eb8936c4-baa8-4fd1-872f-1abc2d6637c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:57.268536 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634ddc3-2acc-41bd-9939-54f0b0a1f186 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:57.276135 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 303/617] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:50:57.277945 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbc6d4-e619-46de-bee3-de2cee17d9b2 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:57.278291 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbc6d4-e619-46de-bee3-de2cee17d9b2 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:57.278632 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbc6d4-e619-46de-bee3-de2cee17d9b2 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:57.284192 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 304/618] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:50:57.284192 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fbc6d4-e619-46de-bee3-de2cee17d9b2 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:57.318809 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ac285-3d47-4c83-8815-6b59d2e57ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:57.319742 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ac285-3d47-4c83-8815-6b59d2e57ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:57.320233 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ac285-3d47-4c83-8815-6b59d2e57ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:57.320740 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ac285-3d47-4c83-8815-6b59d2e57ee2 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:57.321551 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317ac285-3d47-4c83-8815-6b59d2e57ee2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:57.322074 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317ac285-3d47-4c83-8815-6b59d2e57ee2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:57.323510 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317ac285-3d47-4c83-8815-6b59d2e57ee2 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:57.328676 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 315/619] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Oct 26 10:50:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:57.330680 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87755d-75d0-4ab0-b98f-a96363367ed1 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:57.330983 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87755d-75d0-4ab0-b98f-a96363367ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:57.331261 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87755d-75d0-4ab0-b98f-a96363367ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:57.350772 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-3f87755d-75d0-4ab0-b98f-a96363367ed1 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:57.352018 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:57.352430 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3f87755d-75d0-4ab0-b98f-a96363367ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:57.413740 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fbc6d4-e619-46de-bee3-de2cee17d9b2 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:57.446320 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 316/620] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:50:57.447436 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f87755d-75d0-4ab0-b98f-a96363367ed1 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:57.475802 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39942bb5-4f55-4c47-bbaf-22cfd5396482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:57.477315 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39942bb5-4f55-4c47-bbaf-22cfd5396482 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:57.478035 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39942bb5-4f55-4c47-bbaf-22cfd5396482 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:57.478729 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39942bb5-4f55-4c47-bbaf-22cfd5396482 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:57.499340 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:57.502695 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39942bb5-4f55-4c47-bbaf-22cfd5396482 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:57.502695 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39942bb5-4f55-4c47-bbaf-22cfd5396482 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:57.523057 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-39942bb5-4f55-4c47-bbaf-22cfd5396482 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:57.523057 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:57.523057 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:57.523057 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:57.523057 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:57.523057 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:57.523057 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:57.523057 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:57.523057 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:57.523057 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:57.523057 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:57.523057 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:57.523057 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:50:57.523057 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:50:57.523057 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:50:57.523057 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:50:57.524359 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:57.524359 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:57.524359 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:57.524359 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:57.524359 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:57.524359 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:57.524359 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:57.524359 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:57.524359 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:57.524359 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:57.524359 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:57.524359 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:57.524359 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:57.524359 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:57.524359 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:57.524359 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:57.524359 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:50:57.525274 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:50:57.525274 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:50:57.525274 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:57.525274 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 305/621] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:50:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:57.530853 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39942bb5-4f55-4c47-bbaf-22cfd5396482 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:57.645956 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f87755d-75d0-4ab0-b98f-a96363367ed1 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:57.671621 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39942bb5-4f55-4c47-bbaf-22cfd5396482 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:57.673461 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:57.693690 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2507153-8322-4d6b-861d-7995f305c5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:57.694584 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2507153-8322-4d6b-861d-7995f305c5b4 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:57.695050 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2507153-8322-4d6b-861d-7995f305c5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:57.695471 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2507153-8322-4d6b-861d-7995f305c5b4 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:57.696739 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2507153-8322-4d6b-861d-7995f305c5b4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:57.697472 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2507153-8322-4d6b-861d-7995f305c5b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:57.699619 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2507153-8322-4d6b-861d-7995f305c5b4 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:57.712081 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 317/622] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Oct 26 10:50:57 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:57.712081 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2507153-8322-4d6b-861d-7995f305c5b4 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:57.726850 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2c428-c9a9-44ca-85c1-c8b4a4bafa9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:57.727517 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2c428-c9a9-44ca-85c1-c8b4a4bafa9c None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:57.727844 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2c428-c9a9-44ca-85c1-c8b4a4bafa9c None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:57.728164 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2c428-c9a9-44ca-85c1-c8b4a4bafa9c None admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:57.728869 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d2c428-c9a9-44ca-85c1-c8b4a4bafa9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:57.729169 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d2c428-c9a9-44ca-85c1-c8b4a4bafa9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:57.732031 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d2c428-c9a9-44ca-85c1-c8b4a4bafa9c None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:57.750928 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 306/623] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:50:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:57.751904 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2c428-c9a9-44ca-85c1-c8b4a4bafa9c None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:57.833422 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:57.855767 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2507153-8322-4d6b-861d-7995f305c5b4 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:57.880578 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2c428-c9a9-44ca-85c1-c8b4a4bafa9c None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:57.906792 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dcccc6-12a6-42dd-ae52-915bdda69e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:57.907356 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dcccc6-12a6-42dd-ae52-915bdda69e83 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:57.907639 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dcccc6-12a6-42dd-ae52-915bdda69e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:57.907911 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dcccc6-12a6-42dd-ae52-915bdda69e83 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:57.908926 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dcccc6-12a6-42dd-ae52-915bdda69e83 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:57.909902 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dcccc6-12a6-42dd-ae52-915bdda69e83 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:57.921278 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-b8dcccc6-12a6-42dd-ae52-915bdda69e83 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 26 10:50:57.921278 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:57.921278 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:50:57.921278 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:50:57.921278 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:50:57.921278 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:50:57.921278 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:50:57.921278 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:50:57.921278 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 26 10:50:57.921278 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:57.921278 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:50:57.921278 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:57.921278 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:57.921278 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:57.921278 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:57.921278 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:57.921278 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:57.922342 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:57.922342 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:57.922342 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:57.922342 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:57.922342 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:57.922342 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:57.922342 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:50:57.922342 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:50:57.922342 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:50:57.922342 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:50:57.922342 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:57.922342 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:57.922342 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:57.922342 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:57.922342 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:57.922342 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:57.923210 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:57.923210 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:57.923210 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:57.923210 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:57.923210 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:57.923210 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:57.923210 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:57.923210 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:57.923210 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:57.923210 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:57.923210 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:50:57.923210 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:50:57.923210 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 26 10:50:57.923210 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:57.923210 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 318/624] 10.222.0.45 () {56 vars in 1129 bytes} [Wed Oct 26 10:50:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:57.924024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dcccc6-12a6-42dd-ae52-915bdda69e83 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:57.930531 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae757e4-b8ef-4c66-84d5-15209c49becd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:57.931224 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae757e4-b8ef-4c66-84d5-15209c49becd None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:57.931527 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae757e4-b8ef-4c66-84d5-15209c49becd None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:57.931777 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae757e4-b8ef-4c66-84d5-15209c49becd None admin] PATH_INFO: `/v3/services/network` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:57.932387 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae757e4-b8ef-4c66-84d5-15209c49becd None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:57.933760 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae757e4-b8ef-4c66-84d5-15209c49becd None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:57.943684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-eae757e4-b8ef-4c66-84d5-15209c49becd None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 26 10:50:57.943684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:57.943684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:50:57.943684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:50:57.943684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:50:57.943684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:50:57.943684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:50:57.943684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:50:57.943684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 26 10:50:57.943684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:57.943684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:50:57.943684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:57.943684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:57.943684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:57.943684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:57.943684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:57.943684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:57.944762 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:57.944762 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:57.944762 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:57.944762 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:57.944762 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:57.944762 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:57.944762 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:50:57.944762 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:50:57.944762 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:50:57.944762 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:50:57.944762 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:57.944762 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:57.944762 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:57.944762 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:57.944762 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:57.944762 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:57.945622 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:57.945622 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:57.945622 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:57.945622 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:57.945622 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:57.945622 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:57.945622 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:57.945622 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:57.945622 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:57.945622 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:57.945622 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:50:57.945622 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:50:57.945622 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 26 10:50:57.945622 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:50:57.945622 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 307/625] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 26 10:50:57 2022] GET /identity/v3/services/network => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:57.947975 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae757e4-b8ef-4c66-84d5-15209c49becd None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:57.986879 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:58.055644 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dcccc6-12a6-42dd-ae52-915bdda69e83 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:58.067100 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae757e4-b8ef-4c66-84d5-15209c49becd None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:58.104300 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003bc3a-e5ba-40c4-b113-49171d8ed034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:58.105433 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003bc3a-e5ba-40c4-b113-49171d8ed034 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:58.105858 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e744c-6554-4f5e-abe6-69de7c33df2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:58.106029 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003bc3a-e5ba-40c4-b113-49171d8ed034 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:58.106447 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003bc3a-e5ba-40c4-b113-49171d8ed034 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:58.106768 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e744c-6554-4f5e-abe6-69de7c33df2f None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:58.107168 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e744c-6554-4f5e-abe6-69de7c33df2f None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:58.107538 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e744c-6554-4f5e-abe6-69de7c33df2f None admin] PATH_INFO: `/v3/services` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:58.108340 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e744c-6554-4f5e-abe6-69de7c33df2f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:58.108749 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e744c-6554-4f5e-abe6-69de7c33df2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:58.110415 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e744c-6554-4f5e-abe6-69de7c33df2f None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:58.116842 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 308/626] 10.222.0.45 () {56 vars in 1124 bytes} [Wed Oct 26 10:50:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:58.117726 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e744c-6554-4f5e-abe6-69de7c33df2f None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:58.117913 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e003bc3a-e5ba-40c4-b113-49171d8ed034 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:58.119538 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e003bc3a-e5ba-40c4-b113-49171d8ed034 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:58.136696 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-e003bc3a-e5ba-40c4-b113-49171d8ed034 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:50:58.136696 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:50:58.136696 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:50:58.136696 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:50:58.136696 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:50:58.136696 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:50:58.136696 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:50:58.136696 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:50:58.136696 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:50:58.136696 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:50:58.136696 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:50:58.136696 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:50:58.136696 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:50:58.136696 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:50:58.136696 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:50:58.137839 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:50:58.137839 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:50:58.137839 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:50:58.137839 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:50:58.137839 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:50:58.137839 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:50:58.137839 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:50:58.137839 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:50:58.137839 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:50:58.137839 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:50:58.137839 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:50:58.137839 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:50:58.137839 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:50:58.137839 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:50:58.137839 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:50:58.137839 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:50:58.137839 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:50:58.138960 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:50:58.138960 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:50:58.138960 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:50:58.138960 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:50:58.138960 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:50:58.138960 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:50:58.138960 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:50:58.138960 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:50:58.141270 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 319/627] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 26 10:50:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:50:58.142265 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003bc3a-e5ba-40c4-b113-49171d8ed034 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:58.161585 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:58.216023 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:58.226218 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e744c-6554-4f5e-abe6-69de7c33df2f None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:58.262844 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1da0bf-d444-45e0-af40-6434d07ca252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:58.263665 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1da0bf-d444-45e0-af40-6434d07ca252 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:58.264145 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1da0bf-d444-45e0-af40-6434d07ca252 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:58.264499 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1da0bf-d444-45e0-af40-6434d07ca252 None admin] PATH_INFO: `/v3/services` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:58.265188 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1da0bf-d444-45e0-af40-6434d07ca252 None admin] RBAC: Adding query filter params (name=network) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:58.265586 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1da0bf-d444-45e0-af40-6434d07ca252 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:58.267329 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1da0bf-d444-45e0-af40-6434d07ca252 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:58.276874 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 309/628] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Oct 26 10:50:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:58.277191 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003bc3a-e5ba-40c4-b113-49171d8ed034 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:58.277921 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1da0bf-d444-45e0-af40-6434d07ca252 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:58.318035 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3226556-5f5d-4122-901e-120a7e3fe4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:58.318902 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3226556-5f5d-4122-901e-120a7e3fe4fa None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:58.319285 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3226556-5f5d-4122-901e-120a7e3fe4fa None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:58.319682 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3226556-5f5d-4122-901e-120a7e3fe4fa None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:58.320640 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3226556-5f5d-4122-901e-120a7e3fe4fa None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:58.320960 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3226556-5f5d-4122-901e-120a7e3fe4fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:58.322430 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3226556-5f5d-4122-901e-120a7e3fe4fa None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:58.328109 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 320/629] 10.222.0.45 () {56 vars in 1124 bytes} [Wed Oct 26 10:50:58 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:58.329183 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3226556-5f5d-4122-901e-120a7e3fe4fa None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:58.406098 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1da0bf-d444-45e0-af40-6434d07ca252 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:58.415225 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:58.444717 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3226556-5f5d-4122-901e-120a7e3fe4fa None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:58.452282 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075819c3-a14f-4733-a2ff-35a53b630ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:58.453024 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075819c3-a14f-4733-a2ff-35a53b630ba0 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:58.453434 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075819c3-a14f-4733-a2ff-35a53b630ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:58.453801 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075819c3-a14f-4733-a2ff-35a53b630ba0 None admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:58.455085 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075819c3-a14f-4733-a2ff-35a53b630ba0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:58.455500 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075819c3-a14f-4733-a2ff-35a53b630ba0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:58.457433 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075819c3-a14f-4733-a2ff-35a53b630ba0 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:58.475219 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 310/630] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 26 10:50:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:58.476617 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075819c3-a14f-4733-a2ff-35a53b630ba0 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:58.485222 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2c01d-e8fd-4c32-832f-3ca6e89e7b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:58.486153 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2c01d-e8fd-4c32-832f-3ca6e89e7b44 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:58.486580 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2c01d-e8fd-4c32-832f-3ca6e89e7b44 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:58.487436 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2c01d-e8fd-4c32-832f-3ca6e89e7b44 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:58.488254 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2c01d-e8fd-4c32-832f-3ca6e89e7b44 None admin] RBAC: Adding query filter params (type=network) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:58.488721 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2c01d-e8fd-4c32-832f-3ca6e89e7b44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:58.491175 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2c01d-e8fd-4c32-832f-3ca6e89e7b44 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:58.495931 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:58.497702 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 321/631] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Oct 26 10:50:58 2022] GET /identity/v3/services?type=network => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:58.498665 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2c01d-e8fd-4c32-832f-3ca6e89e7b44 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:58.612327 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075819c3-a14f-4733-a2ff-35a53b630ba0 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:58.629583 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2c01d-e8fd-4c32-832f-3ca6e89e7b44 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:58.658913 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a764c08-0dbb-4044-9c04-34a5e44350af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:58.659845 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a764c08-0dbb-4044-9c04-34a5e44350af None admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:58.660896 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a764c08-0dbb-4044-9c04-34a5e44350af None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:58.661323 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a764c08-0dbb-4044-9c04-34a5e44350af None admin] PATH_INFO: `/v3/endpoints` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:58.662522 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a764c08-0dbb-4044-9c04-34a5e44350af None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:58.664963 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a764c08-0dbb-4044-9c04-34a5e44350af None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:58.676013 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63aa4f-c349-4b0b-abe0-94bbe40a2d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:58.676700 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63aa4f-c349-4b0b-abe0-94bbe40a2d6b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:58.677315 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63aa4f-c349-4b0b-abe0-94bbe40a2d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:58.678169 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63aa4f-c349-4b0b-abe0-94bbe40a2d6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:58.678949 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63aa4f-c349-4b0b-abe0-94bbe40a2d6b None admin] RBAC: Adding query filter params (role.id=9102b6e1623a43e99513d6ad55d55c7b, scope.project.id=e8f0f02a607a49e0b88c75019795b726, user.id=3c90765757a34c6291c9980a7d5d5c79) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:50:58.679318 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63aa4f-c349-4b0b-abe0-94bbe40a2d6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:58.681718 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63aa4f-c349-4b0b-abe0-94bbe40a2d6b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:58.687876 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 322/632] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 26 10:50:58 2022] GET /identity/v3/role_assignments?user.id=3c90765757a34c6291c9980a7d5d5c79&scope.project.id=e8f0f02a607a49e0b88c75019795b726&role.id=9102b6e1623a43e99513d6ad55d55c7b => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:50:58.688797 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63aa4f-c349-4b0b-abe0-94bbe40a2d6b None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:58.691657 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:58.779175 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 311/633] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 10:50:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:50:58.839242 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63aa4f-c349-4b0b-abe0-94bbe40a2d6b None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:50:58.895117 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7aadc1-b290-4ee4-a5ac-5b838b3d3b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:50:58.895740 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7aadc1-b290-4ee4-a5ac-5b838b3d3b7b None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:58.896020 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7aadc1-b290-4ee4-a5ac-5b838b3d3b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:58.896387 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7aadc1-b290-4ee4-a5ac-5b838b3d3b7b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:58.897066 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7aadc1-b290-4ee4-a5ac-5b838b3d3b7b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:50:58.898478 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7aadc1-b290-4ee4-a5ac-5b838b3d3b7b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:50:58.982555 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 323/634] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 10:50:58 2022] POST /identity/v3/endpoints => generated 337 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:50:59.491551 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ef72f-7613-45e0-a7e7-fe5393f74354 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:59.491928 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ef72f-7613-45e0-a7e7-fe5393f74354 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:59.492130 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ef72f-7613-45e0-a7e7-fe5393f74354 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:59.493721 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 312/635] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:50:59.499822 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa72fe3-a28a-4147-b78b-c60254101f69 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:50:59.500144 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa72fe3-a28a-4147-b78b-c60254101f69 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:50:59.500425 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa72fe3-a28a-4147-b78b-c60254101f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:50:59.519621 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-2fa72fe3-a28a-4147-b78b-c60254101f69 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:50:59.520853 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2fa72fe3-a28a-4147-b78b-c60254101f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:50:59.573746 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:50:59.599915 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 324/636] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:50:59 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:50:59.875069 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ef72f-7613-45e0-a7e7-fe5393f74354 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:50:59.955194 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:00.004873 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ef72f-7613-45e0-a7e7-fe5393f74354 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:00.015827 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfe630-9641-443d-ad29-74ab45b309a3 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:00.016367 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfe630-9641-443d-ad29-74ab45b309a3 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:00.016446 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfe630-9641-443d-ad29-74ab45b309a3 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:00.017985 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 325/637] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:00.023758 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a354846-6eb1-42ec-9d95-ba9a2b572ba4 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:00.024047 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a354846-6eb1-42ec-9d95-ba9a2b572ba4 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:00.024403 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a354846-6eb1-42ec-9d95-ba9a2b572ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:00.053583 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-0a354846-6eb1-42ec-9d95-ba9a2b572ba4 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:00.054815 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0a354846-6eb1-42ec-9d95-ba9a2b572ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:00.057396 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd446441-628f-432b-a6c3-17375c8a9a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:00.058122 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd446441-628f-432b-a6c3-17375c8a9a4c None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:00.058468 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd446441-628f-432b-a6c3-17375c8a9a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:00.058853 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd446441-628f-432b-a6c3-17375c8a9a4c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:00.059664 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd446441-628f-432b-a6c3-17375c8a9a4c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:00.061281 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd446441-628f-432b-a6c3-17375c8a9a4c None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:00.073157 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-fd446441-628f-432b-a6c3-17375c8a9a4c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 26 10:51:00.073157 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:00.073157 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:51:00.073157 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:51:00.073157 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:51:00.073157 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:51:00.073157 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:51:00.073157 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:51:00.073157 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 26 10:51:00.073157 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:51:00.073157 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:51:00.073157 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:51:00.073157 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:00.073157 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:00.073157 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:00.073157 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:00.073157 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:00.074191 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:00.074191 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:00.074191 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:00.074191 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:00.074191 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:00.074191 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:00.074191 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:51:00.074191 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:51:00.074191 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:51:00.074191 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:51:00.074191 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:00.074191 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:00.074191 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:00.074191 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:00.074191 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:00.074191 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:00.075039 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:00.075039 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:00.075039 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:00.075039 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:00.075039 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:00.075039 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:00.075039 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:00.075039 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:00.075039 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:00.075039 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:00.075039 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:51:00.075039 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:51:00.075039 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 26 10:51:00.075039 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:51:00.079373 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 313/638] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Oct 26 10:50:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:00.081848 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd446441-628f-432b-a6c3-17375c8a9a4c None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:00.182416 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 326/639] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 26 10:51:00.271833 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd446441-628f-432b-a6c3-17375c8a9a4c None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:00.330565 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0db615-7376-4616-bf8a-36687ef85b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:00.330565 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0db615-7376-4616-bf8a-36687ef85b08 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:00.330565 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0db615-7376-4616-bf8a-36687ef85b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:00.330911 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0db615-7376-4616-bf8a-36687ef85b08 None admin] PATH_INFO: `/v3/services` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:00.331283 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0db615-7376-4616-bf8a-36687ef85b08 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:00.331585 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0db615-7376-4616-bf8a-36687ef85b08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:00.332980 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0db615-7376-4616-bf8a-36687ef85b08 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:00.339155 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:00.347703 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 314/640] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Oct 26 10:51:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:00.357197 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a354846-6eb1-42ec-9d95-ba9a2b572ba4 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:00.466546 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0db615-7376-4616-bf8a-36687ef85b08 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:00.473378 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a354846-6eb1-42ec-9d95-ba9a2b572ba4 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:00.487047 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:00.514260 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3771af-165d-45e7-806b-c1b4b2cdfb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:00.515200 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3771af-165d-45e7-806b-c1b4b2cdfb60 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:00.515626 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3771af-165d-45e7-806b-c1b4b2cdfb60 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:00.516040 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3771af-165d-45e7-806b-c1b4b2cdfb60 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:00.516848 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3771af-165d-45e7-806b-c1b4b2cdfb60 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:00.517316 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3771af-165d-45e7-806b-c1b4b2cdfb60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:00.518899 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3771af-165d-45e7-806b-c1b4b2cdfb60 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:00.525265 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 327/641] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Oct 26 10:51:00 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:00.587497 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0db615-7376-4616-bf8a-36687ef85b08 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:00.625962 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df4c3e-2b7e-44f1-956f-7cd1fa8caae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:00.626870 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df4c3e-2b7e-44f1-956f-7cd1fa8caae6 None admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:00.627296 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df4c3e-2b7e-44f1-956f-7cd1fa8caae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:00.627711 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df4c3e-2b7e-44f1-956f-7cd1fa8caae6 None admin] PATH_INFO: `/v3/services` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:00.628557 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7df4c3e-2b7e-44f1-956f-7cd1fa8caae6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:00.630141 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7df4c3e-2b7e-44f1-956f-7cd1fa8caae6 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:00.714274 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 315/642] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Oct 26 10:51:00 2022] POST /identity/v3/services => generated 269 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 10:51:01.154810 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56567339-65e7-4057-9f7a-1974635f66b6 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:01.155338 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56567339-65e7-4057-9f7a-1974635f66b6 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:01.155338 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56567339-65e7-4057-9f7a-1974635f66b6 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:01.156986 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 328/643] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:01.162153 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae3317-9edd-437f-8a0a-56a80b213101 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:01.162587 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae3317-9edd-437f-8a0a-56a80b213101 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:01.162760 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae3317-9edd-437f-8a0a-56a80b213101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:01.182537 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-a0ae3317-9edd-437f-8a0a-56a80b213101 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:01.183736 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-a0ae3317-9edd-437f-8a0a-56a80b213101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:01.239857 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:01.261578 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 316/644] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:01 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:51:01.393646 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e58ac-8b84-42dc-a7e1-b871ee642b0f None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:01.393987 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e58ac-8b84-42dc-a7e1-b871ee642b0f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:01.394213 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e58ac-8b84-42dc-a7e1-b871ee642b0f None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:01.395812 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 329/645] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:01.401591 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8394e3c-6749-430d-9360-290190427645 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:01.402106 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8394e3c-6749-430d-9360-290190427645 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:01.402572 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8394e3c-6749-430d-9360-290190427645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:01.421706 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-c8394e3c-6749-430d-9360-290190427645 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:01.423204 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-c8394e3c-6749-430d-9360-290190427645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:01.495315 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 317/646] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:01 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:51:01.553025 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e58ac-8b84-42dc-a7e1-b871ee642b0f None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:01.666179 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e58ac-8b84-42dc-a7e1-b871ee642b0f None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:01.701059 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81070524-8ae9-4324-af1c-adaacfeae7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:01.701631 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81070524-8ae9-4324-af1c-adaacfeae7be None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:01.701915 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81070524-8ae9-4324-af1c-adaacfeae7be None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:01.702189 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81070524-8ae9-4324-af1c-adaacfeae7be None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:01.712677 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81070524-8ae9-4324-af1c-adaacfeae7be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:51:01.717567 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-81070524-8ae9-4324-af1c-adaacfeae7be None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 26 10:51:01.717567 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:01.717567 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:01.717567 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:01.717567 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:01.717567 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:01.717567 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:01.717567 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:01.717567 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:01.717567 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:01.717567 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:01.717567 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:01.717567 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:51:01.717567 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:51:01.717567 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:51:01.717567 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:51:01.718522 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:51:01.718522 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:51:01.718522 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:51:01.718522 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:51:01.718522 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:01.718522 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:01.718522 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:01.718522 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:01.718522 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:01.718522 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:01.718522 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:01.718522 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:01.718522 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:01.718522 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:01.718522 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:01.718522 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:01.719413 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:01.719413 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:01.719413 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:01.719413 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:01.719413 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:51:01.719413 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:51:01.719413 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:51:01.719413 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:51:01.719413 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:51:01.719413 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:51:01.719413 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 26 10:51:01.719413 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:01.719413 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 330/647] 10.222.0.45 () {56 vars in 1120 bytes} [Wed Oct 26 10:51:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:01.729209 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8394e3c-6749-430d-9360-290190427645 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:01.797203 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81070524-8ae9-4324-af1c-adaacfeae7be None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:01.836593 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:01.844354 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8394e3c-6749-430d-9360-290190427645 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:01.862352 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:01.884454 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a8fb9-8b0b-41b8-85a5-e8351019393f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:01.885376 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a8fb9-8b0b-41b8-85a5-e8351019393f None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:01.885940 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a8fb9-8b0b-41b8-85a5-e8351019393f None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:01.886420 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a8fb9-8b0b-41b8-85a5-e8351019393f None admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:01.887311 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a8fb9-8b0b-41b8-85a5-e8351019393f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:01.887835 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a8fb9-8b0b-41b8-85a5-e8351019393f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:01.889424 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a8fb9-8b0b-41b8-85a5-e8351019393f None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:01.897971 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 318/648] 10.222.0.45 () {56 vars in 1115 bytes} [Wed Oct 26 10:51:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:01.903630 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a8fb9-8b0b-41b8-85a5-e8351019393f None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:01.910357 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81070524-8ae9-4324-af1c-adaacfeae7be None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:01.951216 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47df80-5c94-4b93-b3a2-99ad5ab6033f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:01.951797 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47df80-5c94-4b93-b3a2-99ad5ab6033f None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:01.952082 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47df80-5c94-4b93-b3a2-99ad5ab6033f None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:01.952411 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47df80-5c94-4b93-b3a2-99ad5ab6033f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:01.953426 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47df80-5c94-4b93-b3a2-99ad5ab6033f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:01.954816 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47df80-5c94-4b93-b3a2-99ad5ab6033f None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:01.965124 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-fc47df80-5c94-4b93-b3a2-99ad5ab6033f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 26 10:51:01.965124 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:01.965124 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:51:01.965124 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:51:01.965124 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:51:01.965124 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:51:01.965124 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:51:01.965124 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:51:01.965124 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 26 10:51:01.965124 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:01.965124 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:51:01.965124 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:01.965124 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:01.965124 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:01.965124 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:01.965124 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:01.965124 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:01.966139 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:01.966139 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:01.966139 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:01.966139 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:01.966139 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:01.966139 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:01.966139 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:51:01.966139 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:51:01.966139 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:51:01.966139 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:51:01.966139 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:01.966139 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:01.966139 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:01.966139 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:01.966139 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:01.966139 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:01.967031 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:01.967031 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:01.967031 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:01.967031 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:01.967031 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:01.967031 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:01.967031 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:01.967031 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:01.967031 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:01.967031 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:01.967031 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:51:01.967031 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:51:01.967031 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 26 10:51:01.967031 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:01.967031 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 331/649] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Oct 26 10:51:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:51:01.973505 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47df80-5c94-4b93-b3a2-99ad5ab6033f None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:02.023511 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a8fb9-8b0b-41b8-85a5-e8351019393f None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:02.061512 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66151ff7-b7c3-461d-bae3-9b810ca82527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:02.062542 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66151ff7-b7c3-461d-bae3-9b810ca82527 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:02.063031 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66151ff7-b7c3-461d-bae3-9b810ca82527 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:02.063532 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66151ff7-b7c3-461d-bae3-9b810ca82527 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:02.074929 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66151ff7-b7c3-461d-bae3-9b810ca82527 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:02.076661 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66151ff7-b7c3-461d-bae3-9b810ca82527 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:02.080489 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:02.084971 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47df80-5c94-4b93-b3a2-99ad5ab6033f None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:02.092472 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-66151ff7-b7c3-461d-bae3-9b810ca82527 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:51:02.092472 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:02.092472 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:02.092472 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:02.092472 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:02.092472 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:02.092472 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:02.092472 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:02.092472 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:02.092472 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:02.092472 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:02.092472 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:02.092472 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:51:02.092472 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:51:02.092472 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:51:02.092472 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:51:02.093467 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:02.093467 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:02.093467 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:02.093467 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:02.093467 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:02.093467 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:02.093467 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:02.093467 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:02.093467 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:02.093467 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:02.093467 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:02.093467 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:02.093467 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:02.093467 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:02.093467 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:02.093467 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:02.093467 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:51:02.094802 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:51:02.094802 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:51:02.094802 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:51:02.101108 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 319/650] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:51:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:02.102858 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66151ff7-b7c3-461d-bae3-9b810ca82527 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:02.121285 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649aec1a-5a47-4eea-a376-c93fdfae11f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:02.121909 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649aec1a-5a47-4eea-a376-c93fdfae11f0 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:02.122196 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649aec1a-5a47-4eea-a376-c93fdfae11f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:02.122474 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649aec1a-5a47-4eea-a376-c93fdfae11f0 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:02.123392 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649aec1a-5a47-4eea-a376-c93fdfae11f0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:02.123701 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649aec1a-5a47-4eea-a376-c93fdfae11f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:02.125246 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649aec1a-5a47-4eea-a376-c93fdfae11f0 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:02.135678 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 332/651] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Oct 26 10:51:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:51:02.136783 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649aec1a-5a47-4eea-a376-c93fdfae11f0 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:02.144590 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:02.228033 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66151ff7-b7c3-461d-bae3-9b810ca82527 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:02.260889 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649aec1a-5a47-4eea-a376-c93fdfae11f0 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:02.266263 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c238623-3b4f-4f4e-8eb0-c26d46473976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:02.267172 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c238623-3b4f-4f4e-8eb0-c26d46473976 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:02.267696 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c238623-3b4f-4f4e-8eb0-c26d46473976 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:02.268218 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c238623-3b4f-4f4e-8eb0-c26d46473976 None admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:02.269083 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c238623-3b4f-4f4e-8eb0-c26d46473976 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:02.269591 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c238623-3b4f-4f4e-8eb0-c26d46473976 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:02.271171 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c238623-3b4f-4f4e-8eb0-c26d46473976 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:02.288339 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 320/652] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:51:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:02.290102 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c238623-3b4f-4f4e-8eb0-c26d46473976 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:02.300016 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904eb0e3-9dc8-4073-af9b-b34852f69011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:02.300663 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904eb0e3-9dc8-4073-af9b-b34852f69011 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:02.300945 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904eb0e3-9dc8-4073-af9b-b34852f69011 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:02.301220 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904eb0e3-9dc8-4073-af9b-b34852f69011 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:02.301917 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904eb0e3-9dc8-4073-af9b-b34852f69011 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:02.302220 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904eb0e3-9dc8-4073-af9b-b34852f69011 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:02.304223 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904eb0e3-9dc8-4073-af9b-b34852f69011 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:02.316093 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 333/653] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Oct 26 10:51:02 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:02.400493 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:02.409603 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c238623-3b4f-4f4e-8eb0-c26d46473976 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:02.448395 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74802cf-ae9b-4ad3-8811-d2bc43319847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:02.449049 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74802cf-ae9b-4ad3-8811-d2bc43319847 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:02.449332 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74802cf-ae9b-4ad3-8811-d2bc43319847 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:02.449605 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74802cf-ae9b-4ad3-8811-d2bc43319847 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:02.458047 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74802cf-ae9b-4ad3-8811-d2bc43319847 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:02.459587 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74802cf-ae9b-4ad3-8811-d2bc43319847 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:02.472799 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-f74802cf-ae9b-4ad3-8811-d2bc43319847 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 26 10:51:02.472799 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:02.472799 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:02.472799 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:02.472799 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:02.472799 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:02.472799 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:02.472799 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:02.472799 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:02.472799 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:02.472799 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:02.472799 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:02.472799 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:51:02.472799 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:51:02.472799 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:51:02.472799 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:51:02.473832 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:02.473832 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:02.473832 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:51:02.473832 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:51:02.473832 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:51:02.473832 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:51:02.473832 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:02.473832 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:02.473832 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:02.473832 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:02.473832 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:02.473832 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:02.473832 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:02.473832 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:02.473832 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:02.473832 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:02.473832 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:02.473832 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:02.475452 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:02.475452 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:02.475452 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:51:02.475452 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:51:02.475452 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:51:02.475452 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:51:02.475452 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:51:02.475452 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:51:02.475452 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 26 10:51:02.475452 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:51:02.475452 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 321/654] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Oct 26 10:51:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:02.482618 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904eb0e3-9dc8-4073-af9b-b34852f69011 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:02.517852 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:02.597882 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904eb0e3-9dc8-4073-af9b-b34852f69011 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:02.639406 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ae2bb-3261-48aa-9e9a-32c779932822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:02.640531 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ae2bb-3261-48aa-9e9a-32c779932822 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:02.641022 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ae2bb-3261-48aa-9e9a-32c779932822 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:02.641523 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ae2bb-3261-48aa-9e9a-32c779932822 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:02.642857 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ae2bb-3261-48aa-9e9a-32c779932822 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:02.643374 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ae2bb-3261-48aa-9e9a-32c779932822 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:02.645074 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ae2bb-3261-48aa-9e9a-32c779932822 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:02.664594 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 334/655] 10.222.0.45 () {56 vars in 1149 bytes} [Wed Oct 26 10:51:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:02.670908 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74802cf-ae9b-4ad3-8811-d2bc43319847 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:02.728711 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd549147-13b6-45dd-9a44-4cc54eff035d None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:02.729409 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd549147-13b6-45dd-9a44-4cc54eff035d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:02.729930 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd549147-13b6-45dd-9a44-4cc54eff035d None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:02.731697 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 335/656] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:51:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:02.740445 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81c133-1892-494b-9939-02e90254665d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:02.740799 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81c133-1892-494b-9939-02e90254665d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:02.741181 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81c133-1892-494b-9939-02e90254665d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:02.764312 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-4d81c133-1892-494b-9939-02e90254665d None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:02.776232 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4d81c133-1892-494b-9939-02e90254665d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:02.789556 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74802cf-ae9b-4ad3-8811-d2bc43319847 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:02.838880 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7374dfb-b04a-474e-ba79-2dac333a1b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:02.839529 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7374dfb-b04a-474e-ba79-2dac333a1b9c None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:02.839815 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7374dfb-b04a-474e-ba79-2dac333a1b9c None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:02.840113 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7374dfb-b04a-474e-ba79-2dac333a1b9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:02.854761 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7374dfb-b04a-474e-ba79-2dac333a1b9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:02.856335 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7374dfb-b04a-474e-ba79-2dac333a1b9c None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:02.857178 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 336/657] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:02 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 26 10:51:02.878406 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-d7374dfb-b04a-474e-ba79-2dac333a1b9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:51:02.878406 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:02.878406 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:02.878406 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:02.878406 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:02.878406 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:02.878406 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:02.878406 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:02.878406 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:02.878406 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:02.878406 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:02.878406 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:02.878406 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:51:02.878406 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:51:02.878406 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:51:02.878406 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:51:02.879381 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:02.879381 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:02.879381 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:02.879381 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:02.879381 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:02.879381 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:02.879381 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:02.879381 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:02.879381 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:02.879381 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:02.879381 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:02.879381 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:02.879381 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:02.879381 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:02.879381 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:02.879381 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:02.879381 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:51:02.880325 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:51:02.880325 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:51:02.880325 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:51:02.882510 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 322/658] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:51:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:02.882858 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:02.890169 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81c133-1892-494b-9939-02e90254665d None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:02.910646 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:02.922157 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a59fb-8af5-4f63-9cb5-124edd4daeb5 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:02.922443 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a59fb-8af5-4f63-9cb5-124edd4daeb5 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:02.930848 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a59fb-8af5-4f63-9cb5-124edd4daeb5 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:02.930848 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 323/659] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:51:02.930848 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4889e-b27b-453a-a6f2-f6d6ecd90098 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:02.930848 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4889e-b27b-453a-a6f2-f6d6ecd90098 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:02.930848 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4889e-b27b-453a-a6f2-f6d6ecd90098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:02.948667 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-97a4889e-b27b-453a-a6f2-f6d6ecd90098 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:02.949867 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-97a4889e-b27b-453a-a6f2-f6d6ecd90098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:02.996875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81c133-1892-494b-9939-02e90254665d None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:03.040209 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 324/660] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:02 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 26 10:51:03.048300 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d746a3-8746-46a4-987c-245b9e849ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:03.048919 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d746a3-8746-46a4-987c-245b9e849ece None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:03.049199 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d746a3-8746-46a4-987c-245b9e849ece None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:03.049472 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d746a3-8746-46a4-987c-245b9e849ece None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:03.050118 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d746a3-8746-46a4-987c-245b9e849ece None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:03.050416 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d746a3-8746-46a4-987c-245b9e849ece None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:03.051834 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d746a3-8746-46a4-987c-245b9e849ece None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:03.063683 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 337/661] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:51:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:03.069236 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4889e-b27b-453a-a6f2-f6d6ecd90098 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:03.157837 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d746a3-8746-46a4-987c-245b9e849ece None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:03.174100 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4889e-b27b-453a-a6f2-f6d6ecd90098 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:03.210428 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:03.213887 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a3650-bacc-4e9c-a574-1a6e381ef972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:03.214523 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a3650-bacc-4e9c-a574-1a6e381ef972 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:03.223746 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a3650-bacc-4e9c-a574-1a6e381ef972 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:03.223746 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a3650-bacc-4e9c-a574-1a6e381ef972 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:03.223746 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1a3650-bacc-4e9c-a574-1a6e381ef972 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:03.224001 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1a3650-bacc-4e9c-a574-1a6e381ef972 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:03.240283 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-5a1a3650-bacc-4e9c-a574-1a6e381ef972 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:51:03.240283 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:03.240283 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:03.240283 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:03.240283 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:03.240283 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:03.240283 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:03.240283 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:03.240283 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:03.240283 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:03.240283 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:03.240283 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:03.240283 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:51:03.240283 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:51:03.240283 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:51:03.241635 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:51:03.241635 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:03.241635 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:03.241635 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:03.241635 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:03.241635 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:03.241635 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:03.241635 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:03.241635 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:03.241635 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:03.241635 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:03.241635 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:03.241635 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:03.241635 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:03.241635 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:03.241635 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:03.241635 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:03.243125 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:51:03.243125 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:51:03.243125 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:51:03.243125 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:51:03.243125 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:51:03.243125 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:51:03.243125 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:51:03.243125 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:51:03.243125 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 325/662] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 26 10:51:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:03.247556 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a3650-bacc-4e9c-a574-1a6e381ef972 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:03.250942 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:03.284148 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d746a3-8746-46a4-987c-245b9e849ece None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:03.329502 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c7c73-dffd-45f7-ae7a-5865d279ae9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:03.330402 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c7c73-dffd-45f7-ae7a-5865d279ae9e None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:03.330833 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c7c73-dffd-45f7-ae7a-5865d279ae9e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:03.331269 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c7c73-dffd-45f7-ae7a-5865d279ae9e None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:03.332671 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c7c73-dffd-45f7-ae7a-5865d279ae9e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:03.334479 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c7c73-dffd-45f7-ae7a-5865d279ae9e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:03.357869 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a3650-bacc-4e9c-a574-1a6e381ef972 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:03.391368 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb5332-c1a3-4ec0-8cdc-ae0ea3d006ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:03.391978 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb5332-c1a3-4ec0-8cdc-ae0ea3d006ff None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:03.392292 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb5332-c1a3-4ec0-8cdc-ae0ea3d006ff None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:03.392567 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb5332-c1a3-4ec0-8cdc-ae0ea3d006ff None admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:03.393257 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb5332-c1a3-4ec0-8cdc-ae0ea3d006ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:03.393565 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb5332-c1a3-4ec0-8cdc-ae0ea3d006ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:03.395035 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb5332-c1a3-4ec0-8cdc-ae0ea3d006ff None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:03.406694 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 326/663] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 26 10:51:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:51:03.407475 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb5332-c1a3-4ec0-8cdc-ae0ea3d006ff None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:03.450071 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 338/664] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Oct 26 10:51:03 2022] POST /identity/v3/services => generated 241 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 10:51:03.451545 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c7c73-dffd-45f7-ae7a-5865d279ae9e None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:03.462448 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:03.534972 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb5332-c1a3-4ec0-8cdc-ae0ea3d006ff None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:03.585562 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072b576-e36d-4cb4-bc4b-7d0c63c87659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:03.586221 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072b576-e36d-4cb4-bc4b-7d0c63c87659 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:03.586511 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072b576-e36d-4cb4-bc4b-7d0c63c87659 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:03.586792 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072b576-e36d-4cb4-bc4b-7d0c63c87659 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:03.587398 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e072b576-e36d-4cb4-bc4b-7d0c63c87659 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:03.588846 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e072b576-e36d-4cb4-bc4b-7d0c63c87659 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:03.600585 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-e072b576-e36d-4cb4-bc4b-7d0c63c87659 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 26 10:51:03.600585 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:03.600585 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:51:03.600585 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:51:03.600585 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:51:03.600585 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:51:03.600585 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:51:03.600585 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:51:03.600585 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 26 10:51:03.600585 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:51:03.600585 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:51:03.600585 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:51:03.600585 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:03.600585 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:03.600585 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:03.600585 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:03.601633 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:03.601633 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:03.601633 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:03.601633 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:03.601633 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:03.601633 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:03.601633 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:03.601633 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:51:03.601633 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:51:03.601633 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:51:03.601633 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:51:03.601633 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:03.601633 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:03.601633 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:03.601633 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:03.601633 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:03.601633 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:03.602547 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:03.602547 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:03.602547 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:03.602547 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:03.602547 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:03.602547 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:03.602547 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:03.602547 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:03.602547 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:03.602547 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:03.602547 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:51:03.602547 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:51:03.602547 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 26 10:51:03.602547 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:51:03.602547 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 327/665] 10.222.0.45 () {56 vars in 1132 bytes} [Wed Oct 26 10:51:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:03.609151 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072b576-e36d-4cb4-bc4b-7d0c63c87659 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:03.624366 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c7c73-dffd-45f7-ae7a-5865d279ae9e None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:03.675338 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab84ce-e0d2-42cb-bbe7-79a37103fcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:03.676488 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab84ce-e0d2-42cb-bbe7-79a37103fcb1 None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:03.676781 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab84ce-e0d2-42cb-bbe7-79a37103fcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:03.677059 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab84ce-e0d2-42cb-bbe7-79a37103fcb1 None admin] PATH_INFO: `/v3/projects/e8f0f02a607a49e0b88c75019795b726/users/3c90765757a34c6291c9980a7d5d5c79/roles/bb4187021aea4d30a339f0c0e79a6601` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:03.680574 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab84ce-e0d2-42cb-bbe7-79a37103fcb1 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8f0f02a607a49e0b88c75019795b726, user_id=3c90765757a34c6291c9980a7d5d5c79, role_id=bb4187021aea4d30a339f0c0e79a6601)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:03.682477 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab84ce-e0d2-42cb-bbe7-79a37103fcb1 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:03.685710 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:03.729094 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072b576-e36d-4cb4-bc4b-7d0c63c87659 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:03.740465 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:03.768098 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c2bfb-463a-41d8-a255-58c41d6cb6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:03.768098 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c2bfb-463a-41d8-a255-58c41d6cb6cc None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:03.768098 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c2bfb-463a-41d8-a255-58c41d6cb6cc None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:03.768098 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c2bfb-463a-41d8-a255-58c41d6cb6cc None admin] PATH_INFO: `/v3/services` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:03.768554 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c2bfb-463a-41d8-a255-58c41d6cb6cc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:03.768554 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c2bfb-463a-41d8-a255-58c41d6cb6cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:03.768554 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c2bfb-463a-41d8-a255-58c41d6cb6cc None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:03.769281 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 339/666] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 26 10:51:03 2022] PUT /identity/v3/projects/e8f0f02a607a49e0b88c75019795b726/users/3c90765757a34c6291c9980a7d5d5c79/roles/bb4187021aea4d30a339f0c0e79a6601 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:51:03.774265 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 328/667] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Oct 26 10:51:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:03.781584 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab84ce-e0d2-42cb-bbe7-79a37103fcb1 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:03.899341 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab84ce-e0d2-42cb-bbe7-79a37103fcb1 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:03.937294 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f60a4-f584-4d34-85f0-f696c9986583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:03.938227 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f60a4-f584-4d34-85f0-f696c9986583 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:03.938687 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f60a4-f584-4d34-85f0-f696c9986583 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:03.939134 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f60a4-f584-4d34-85f0-f696c9986583 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:03.939986 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f60a4-f584-4d34-85f0-f696c9986583 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:03.940509 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f60a4-f584-4d34-85f0-f696c9986583 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:03.942103 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f60a4-f584-4d34-85f0-f696c9986583 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:03.952166 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 340/668] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Oct 26 10:51:03 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:03.954534 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c2bfb-463a-41d8-a255-58c41d6cb6cc None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:04.063860 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c2bfb-463a-41d8-a255-58c41d6cb6cc None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:04.099192 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f18de-4fd5-4e27-8508-df53f37849bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:04.100380 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f18de-4fd5-4e27-8508-df53f37849bd None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:04.100669 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f18de-4fd5-4e27-8508-df53f37849bd None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:04.100946 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f18de-4fd5-4e27-8508-df53f37849bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:04.101650 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0f18de-4fd5-4e27-8508-df53f37849bd None admin] RBAC: Adding query filter params (interface=public, service_id=baf1063d4c3544ff8e9eed474809d036, region_id=RegionOne) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:04.101960 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0f18de-4fd5-4e27-8508-df53f37849bd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:04.103404 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0f18de-4fd5-4e27-8508-df53f37849bd None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:04.109100 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 329/669] 10.222.0.45 () {56 vars in 1251 bytes} [Wed Oct 26 10:51:03 2022] GET /identity/v3/endpoints?service_id=baf1063d4c3544ff8e9eed474809d036&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:04.114793 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f60a4-f584-4d34-85f0-f696c9986583 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:04.180099 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:04.223471 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f60a4-f584-4d34-85f0-f696c9986583 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:04.259769 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d6474-be1e-4c60-9f6a-8560f4b92efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:04.260418 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d6474-be1e-4c60-9f6a-8560f4b92efc None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:04.260704 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d6474-be1e-4c60-9f6a-8560f4b92efc None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:04.260982 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d6474-be1e-4c60-9f6a-8560f4b92efc None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:04.261600 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d6474-be1e-4c60-9f6a-8560f4b92efc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:04.263039 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d6474-be1e-4c60-9f6a-8560f4b92efc None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:04.269247 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 341/670] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Oct 26 10:51:04 2022] GET /identity/v3/services => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 10:51:04.572466 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289445c-ad93-4642-a199-4a4d78d84366 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:04.572983 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289445c-ad93-4642-a199-4a4d78d84366 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:04.572983 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289445c-ad93-4642-a199-4a4d78d84366 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:04.574550 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 330/671] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:04.579969 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e059dd-a92b-4419-b94e-bc41ab52ce22 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:04.580411 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e059dd-a92b-4419-b94e-bc41ab52ce22 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:04.580584 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e059dd-a92b-4419-b94e-bc41ab52ce22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:04.599170 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-48e059dd-a92b-4419-b94e-bc41ab52ce22 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:04.600954 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-48e059dd-a92b-4419-b94e-bc41ab52ce22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:04.670722 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 342/672] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:04 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:51:04.942493 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289445c-ad93-4642-a199-4a4d78d84366 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:04.984909 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:05.052724 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289445c-ad93-4642-a199-4a4d78d84366 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:05.088303 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eba0c0-bc71-495f-8367-282e0b06cbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:05.088964 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eba0c0-bc71-495f-8367-282e0b06cbc9 None admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:05.089254 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eba0c0-bc71-495f-8367-282e0b06cbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:05.089525 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eba0c0-bc71-495f-8367-282e0b06cbc9 None admin] PATH_INFO: `/v3/services` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:05.090191 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eba0c0-bc71-495f-8367-282e0b06cbc9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:05.091573 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eba0c0-bc71-495f-8367-282e0b06cbc9 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:05.163416 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 331/673] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Oct 26 10:51:04 2022] POST /identity/v3/services => generated 251 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:51:05.747614 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f22296-b027-41d5-97ee-0cc178f57ca3 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:05.748613 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f22296-b027-41d5-97ee-0cc178f57ca3 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:05.749127 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f22296-b027-41d5-97ee-0cc178f57ca3 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:05.750917 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 343/674] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:51:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:05.757069 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301818fa-5b62-40d9-8396-79ac9b8f0976 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:05.757857 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301818fa-5b62-40d9-8396-79ac9b8f0976 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:05.758357 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301818fa-5b62-40d9-8396-79ac9b8f0976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:05.777987 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-301818fa-5b62-40d9-8396-79ac9b8f0976 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:05.779508 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-301818fa-5b62-40d9-8396-79ac9b8f0976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:05.856160 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 332/675] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:51:06.077104 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e0435-b372-4e47-abc9-d727696b9c24 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:06.077475 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e0435-b372-4e47-abc9-d727696b9c24 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:06.077673 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e0435-b372-4e47-abc9-d727696b9c24 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:06.079260 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 344/676] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:06.085258 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb889371-e078-4694-886f-09b2ee9bcd22 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:06.085543 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb889371-e078-4694-886f-09b2ee9bcd22 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:06.085816 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb889371-e078-4694-886f-09b2ee9bcd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:06.105568 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-bb889371-e078-4694-886f-09b2ee9bcd22 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:06.106800 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-bb889371-e078-4694-886f-09b2ee9bcd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:06.126606 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:06.131710 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e0435-b372-4e47-abc9-d727696b9c24 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:06.188185 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:06.190603 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 333/677] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:51:06.240234 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e0435-b372-4e47-abc9-d727696b9c24 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:06.274973 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c89a24-f616-49a7-8659-d0a996ebda6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:06.275606 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c89a24-f616-49a7-8659-d0a996ebda6d None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:06.275939 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c89a24-f616-49a7-8659-d0a996ebda6d None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:06.276245 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c89a24-f616-49a7-8659-d0a996ebda6d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:06.276880 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c89a24-f616-49a7-8659-d0a996ebda6d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:06.278255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c89a24-f616-49a7-8659-d0a996ebda6d None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:06.287874 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-65c89a24-f616-49a7-8659-d0a996ebda6d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 26 10:51:06.287874 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:06.287874 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:51:06.287874 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:51:06.287874 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:51:06.287874 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:51:06.287874 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:51:06.287874 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:51:06.287874 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 26 10:51:06.287874 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:06.287874 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:51:06.287874 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:06.287874 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:06.287874 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:06.287874 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:06.287874 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:06.287874 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:06.288890 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:06.288890 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:06.288890 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:06.288890 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:06.288890 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:06.288890 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:06.288890 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:51:06.288890 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:51:06.288890 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:51:06.288890 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:51:06.288890 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:06.288890 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:06.288890 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:06.288890 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:06.288890 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:06.288890 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:06.289927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:06.289927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:06.289927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:06.289927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:06.289927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:06.289927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:06.289927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:06.289927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:06.289927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:06.289927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:06.289927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:51:06.289927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:51:06.289927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 26 10:51:06.289927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:06.289927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 345/678] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Oct 26 10:51:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:51:06.295540 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb889371-e078-4694-886f-09b2ee9bcd22 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:06.417366 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb889371-e078-4694-886f-09b2ee9bcd22 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:06.453172 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a5e89-420c-4e2a-9b44-6785353366a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:06.454110 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a5e89-420c-4e2a-9b44-6785353366a7 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:06.454570 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a5e89-420c-4e2a-9b44-6785353366a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:06.455018 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a5e89-420c-4e2a-9b44-6785353366a7 None admin] PATH_INFO: `/v3/services` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:06.455819 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a5e89-420c-4e2a-9b44-6785353366a7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:06.456419 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a5e89-420c-4e2a-9b44-6785353366a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:06.457966 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a5e89-420c-4e2a-9b44-6785353366a7 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:06.463543 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 334/679] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Oct 26 10:51:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:06.469440 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c89a24-f616-49a7-8659-d0a996ebda6d None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:06.486423 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474def0-d410-4282-b5f1-c5a276ab823a None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:06.486701 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474def0-d410-4282-b5f1-c5a276ab823a None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:06.486975 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474def0-d410-4282-b5f1-c5a276ab823a None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:06.488624 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 335/680] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:51:06.493719 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d284423-41f9-4b23-9506-9b5e134ec255 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:06.494379 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d284423-41f9-4b23-9506-9b5e134ec255 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:06.494379 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d284423-41f9-4b23-9506-9b5e134ec255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:06.513671 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-4d284423-41f9-4b23-9506-9b5e134ec255 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:06.514861 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-4d284423-41f9-4b23-9506-9b5e134ec255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:06.528312 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:06.577358 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c89a24-f616-49a7-8659-d0a996ebda6d None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:06.582979 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 336/681] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:51:06.583806 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d284423-41f9-4b23-9506-9b5e134ec255 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:06.600718 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:06.624838 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7fb3b4-5718-4e75-a315-4fadc8fe53ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:06.625749 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fb3b4-5718-4e75-a315-4fadc8fe53ae None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:06.626688 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fb3b4-5718-4e75-a315-4fadc8fe53ae None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:06.627171 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fb3b4-5718-4e75-a315-4fadc8fe53ae None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:06.628051 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7fb3b4-5718-4e75-a315-4fadc8fe53ae None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:06.629009 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7fb3b4-5718-4e75-a315-4fadc8fe53ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:06.631366 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7fb3b4-5718-4e75-a315-4fadc8fe53ae None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:06.638656 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 346/682] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Oct 26 10:51:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:06.646178 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7fb3b4-5718-4e75-a315-4fadc8fe53ae None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:06.696734 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d284423-41f9-4b23-9506-9b5e134ec255 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:06.741276 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c8060-b5af-4cf7-8377-25dfbdc7c620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:06.742189 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c8060-b5af-4cf7-8377-25dfbdc7c620 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:06.742466 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c8060-b5af-4cf7-8377-25dfbdc7c620 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:06.742743 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c8060-b5af-4cf7-8377-25dfbdc7c620 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:06.760414 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c8060-b5af-4cf7-8377-25dfbdc7c620 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:51:06.767639 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-478c8060-b5af-4cf7-8377-25dfbdc7c620 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 26 10:51:06.767639 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:06.767639 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:06.767639 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:06.767639 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:06.767639 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:06.767639 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:06.767639 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:06.767639 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:06.767639 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:06.767639 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:06.767639 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:06.767639 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:51:06.767639 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:51:06.767639 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:51:06.767639 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:51:06.768897 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:51:06.768897 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:51:06.768897 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:51:06.768897 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:51:06.768897 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:06.768897 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:06.768897 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:06.768897 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:06.768897 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:06.768897 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:06.768897 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:06.768897 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:06.768897 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:06.768897 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:06.768897 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:06.768897 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:06.769775 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:06.769775 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:06.769775 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:06.769775 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:06.769775 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:51:06.769775 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:51:06.769775 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:51:06.769775 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:51:06.769775 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:51:06.769775 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:51:06.769775 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 26 10:51:06.769775 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:51:06.769775 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 337/683] 10.222.0.45 () {56 vars in 1120 bytes} [Wed Oct 26 10:51:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:06.774617 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7fb3b4-5718-4e75-a315-4fadc8fe53ae None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:06.775602 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c8060-b5af-4cf7-8377-25dfbdc7c620 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:06.786777 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:06.819312 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3fbda-571c-48de-8641-12502e31527a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:06.820089 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3fbda-571c-48de-8641-12502e31527a None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:06.822575 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3fbda-571c-48de-8641-12502e31527a None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:06.822575 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3fbda-571c-48de-8641-12502e31527a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:06.822575 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd3fbda-571c-48de-8641-12502e31527a None admin] RBAC: Adding query filter params (interface=public, service_id=0947d2e81d074b87841b7dc2f4e512f2, region_id=RegionOne) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:06.822575 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd3fbda-571c-48de-8641-12502e31527a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:06.823316 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd3fbda-571c-48de-8641-12502e31527a None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:06.829092 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 347/684] 10.222.0.45 () {56 vars in 1251 bytes} [Wed Oct 26 10:51:06 2022] GET /identity/v3/endpoints?service_id=0947d2e81d074b87841b7dc2f4e512f2&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:06.835146 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3fbda-571c-48de-8641-12502e31527a None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:06.881529 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c8060-b5af-4cf7-8377-25dfbdc7c620 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:06.887959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:06.916728 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0df8a8-7f46-406a-a0b7-c2f54120eff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:06.917364 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0df8a8-7f46-406a-a0b7-c2f54120eff9 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:06.917643 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0df8a8-7f46-406a-a0b7-c2f54120eff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:06.917915 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0df8a8-7f46-406a-a0b7-c2f54120eff9 None admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:06.918575 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0df8a8-7f46-406a-a0b7-c2f54120eff9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:06.918875 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0df8a8-7f46-406a-a0b7-c2f54120eff9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:06.920526 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0df8a8-7f46-406a-a0b7-c2f54120eff9 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:06.932310 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 338/685] 10.222.0.45 () {56 vars in 1115 bytes} [Wed Oct 26 10:51:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:51:06.932310 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0df8a8-7f46-406a-a0b7-c2f54120eff9 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:06.949164 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3fbda-571c-48de-8641-12502e31527a None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:06.987829 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c6beb-9d80-478e-a8dc-6973191f5563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:06.988476 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c6beb-9d80-478e-a8dc-6973191f5563 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:06.988758 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c6beb-9d80-478e-a8dc-6973191f5563 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:06.989030 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c6beb-9d80-478e-a8dc-6973191f5563 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:06.989635 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c6beb-9d80-478e-a8dc-6973191f5563 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:06.991057 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c6beb-9d80-478e-a8dc-6973191f5563 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:07.004094 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 348/686] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Oct 26 10:51:06 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 10:51:07.004094 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c6beb-9d80-478e-a8dc-6973191f5563 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:07.010633 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:07.047092 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0df8a8-7f46-406a-a0b7-c2f54120eff9 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:07.090317 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac28551-046a-4dcd-97eb-ef5e4ef922bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:07.091127 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac28551-046a-4dcd-97eb-ef5e4ef922bd None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:07.091477 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac28551-046a-4dcd-97eb-ef5e4ef922bd None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:07.091815 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac28551-046a-4dcd-97eb-ef5e4ef922bd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:07.092614 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac28551-046a-4dcd-97eb-ef5e4ef922bd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:07.094245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac28551-046a-4dcd-97eb-ef5e4ef922bd None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:07.104961 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-5ac28551-046a-4dcd-97eb-ef5e4ef922bd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 26 10:51:07.104961 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:07.104961 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:51:07.104961 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:51:07.104961 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:51:07.104961 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:51:07.104961 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:51:07.104961 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:51:07.104961 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 26 10:51:07.104961 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:51:07.104961 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:51:07.104961 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:51:07.104961 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:07.104961 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:07.104961 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:07.104961 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:07.106011 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:07.106011 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:07.106011 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:07.106011 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:07.106011 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:07.106011 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:07.106011 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:07.106011 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:51:07.106011 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:51:07.106011 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:51:07.106011 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:51:07.106011 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:07.106011 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:07.106011 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:07.106011 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:07.106011 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:07.106011 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:07.106927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:07.106927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:07.106927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:07.106927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:07.106927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:07.106927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:07.106927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:07.106927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:07.106927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:07.106927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:07.106927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:51:07.106927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:51:07.106927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 26 10:51:07.106927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:51:07.106927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 339/687] 10.222.0.45 () {56 vars in 1132 bytes} [Wed Oct 26 10:51:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:07.117637 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac28551-046a-4dcd-97eb-ef5e4ef922bd None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:07.138833 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c6beb-9d80-478e-a8dc-6973191f5563 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:07.150045 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:07.179000 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4f570-6ebf-4fe0-a288-ac31f8d0c35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:07.179891 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4f570-6ebf-4fe0-a288-ac31f8d0c35a None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:07.180353 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4f570-6ebf-4fe0-a288-ac31f8d0c35a None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:07.180736 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4f570-6ebf-4fe0-a288-ac31f8d0c35a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:07.194255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f4f570-6ebf-4fe0-a288-ac31f8d0c35a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:07.196306 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f4f570-6ebf-4fe0-a288-ac31f8d0c35a None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:07.214255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-58f4f570-6ebf-4fe0-a288-ac31f8d0c35a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:51:07.214255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:07.214255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:07.214255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:07.214255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:07.214255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:07.214255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:07.214255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:07.214255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:07.214255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:07.214255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:07.214255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:07.214255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:51:07.214255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:51:07.214255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:51:07.214255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:51:07.215760 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:07.215760 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:07.215760 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:07.215760 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:07.215760 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:07.215760 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:07.215760 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:07.215760 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:07.215760 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:07.215760 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:07.215760 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:07.215760 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:07.215760 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:07.215760 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:07.215760 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:07.215760 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:07.215760 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:51:07.217152 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:51:07.217152 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:51:07.217152 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:07.217152 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 349/688] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:51:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:07.221119 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4f570-6ebf-4fe0-a288-ac31f8d0c35a None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:07.255967 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac28551-046a-4dcd-97eb-ef5e4ef922bd None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:07.295068 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f4c68-d0cb-4172-a95b-939ff5636263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:07.295698 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f4c68-d0cb-4172-a95b-939ff5636263 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:07.295977 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f4c68-d0cb-4172-a95b-939ff5636263 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:07.296435 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f4c68-d0cb-4172-a95b-939ff5636263 None admin] PATH_INFO: `/v3/services` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:07.297090 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56f4c68-d0cb-4172-a95b-939ff5636263 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:07.297464 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56f4c68-d0cb-4172-a95b-939ff5636263 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:07.298870 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56f4c68-d0cb-4172-a95b-939ff5636263 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:07.300382 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:07.305439 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 340/689] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Oct 26 10:51:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:51:07.317402 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f4c68-d0cb-4172-a95b-939ff5636263 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:07.369206 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4f570-6ebf-4fe0-a288-ac31f8d0c35a None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:07.406244 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da864d1-de9e-49a0-84de-df3928c2d0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:07.406775 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da864d1-de9e-49a0-84de-df3928c2d0e1 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:07.407055 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da864d1-de9e-49a0-84de-df3928c2d0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:07.407327 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da864d1-de9e-49a0-84de-df3928c2d0e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:07.407966 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da864d1-de9e-49a0-84de-df3928c2d0e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:07.408364 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da864d1-de9e-49a0-84de-df3928c2d0e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:07.409773 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da864d1-de9e-49a0-84de-df3928c2d0e1 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:07.422731 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 350/690] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:51:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:51:07.423531 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9a711-2534-4ded-9267-d4e3b0076146 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:07.423821 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9a711-2534-4ded-9267-d4e3b0076146 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:07.424112 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9a711-2534-4ded-9267-d4e3b0076146 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:07.429814 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 351/691] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:51:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:07.429814 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9a711-2534-4ded-9267-d4e3b0076146 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:07.449845 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:07.460496 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f4c68-d0cb-4172-a95b-939ff5636263 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:07.494211 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a83c94-07cd-4110-b07f-267b047a5b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:07.494823 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a83c94-07cd-4110-b07f-267b047a5b03 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:07.495109 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a83c94-07cd-4110-b07f-267b047a5b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:07.495383 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a83c94-07cd-4110-b07f-267b047a5b03 None admin] PATH_INFO: `/v3/services` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:07.496012 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a83c94-07cd-4110-b07f-267b047a5b03 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:07.496344 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a83c94-07cd-4110-b07f-267b047a5b03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:07.497703 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a83c94-07cd-4110-b07f-267b047a5b03 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:07.502543 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 341/692] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Oct 26 10:51:07 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:51:07.503692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6b471-6c86-484b-8a94-f9c468d9b0d5 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:07.503977 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6b471-6c86-484b-8a94-f9c468d9b0d5 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:07.504295 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6b471-6c86-484b-8a94-f9c468d9b0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:07.521577 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-c4a6b471-6c86-484b-8a94-f9c468d9b0d5 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:07.523248 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-c4a6b471-6c86-484b-8a94-f9c468d9b0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:07.540718 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9a711-2534-4ded-9267-d4e3b0076146 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:07.584123 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42fbee-ffee-4e30-a48a-1fe2b3adf568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:07.585102 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42fbee-ffee-4e30-a48a-1fe2b3adf568 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:07.585547 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42fbee-ffee-4e30-a48a-1fe2b3adf568 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:07.585737 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:07.585829 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42fbee-ffee-4e30-a48a-1fe2b3adf568 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:07.593232 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42fbee-ffee-4e30-a48a-1fe2b3adf568 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:07.594707 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42fbee-ffee-4e30-a48a-1fe2b3adf568 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:07.604096 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 342/693] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:51:07.604096 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6b471-6c86-484b-8a94-f9c468d9b0d5 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:07.614654 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-7d42fbee-ffee-4e30-a48a-1fe2b3adf568 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 26 10:51:07.614654 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:07.614654 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:07.614654 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:07.614654 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:07.614654 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:07.614654 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:07.614654 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:07.614654 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:07.614654 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:07.614654 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:07.614654 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:07.614654 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:51:07.614654 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:51:07.614654 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:51:07.614654 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:51:07.616215 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:07.616215 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:07.616215 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:51:07.616215 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:51:07.616215 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:51:07.616215 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:51:07.616215 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:07.616215 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:07.616215 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:07.616215 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:07.616215 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:07.616215 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:07.616215 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:07.616215 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:07.616215 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:07.616215 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:07.616215 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:07.616215 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:07.617184 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:07.617184 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:07.617184 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:51:07.617184 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:51:07.617184 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:51:07.617184 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:51:07.617184 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:51:07.617184 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:51:07.617184 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 26 10:51:07.617184 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:07.621096 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 352/694] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Oct 26 10:51:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:07.625279 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42fbee-ffee-4e30-a48a-1fe2b3adf568 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:07.715584 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6b471-6c86-484b-8a94-f9c468d9b0d5 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:07.732495 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:07.751654 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c88b63-a96f-4d75-9ef9-2dda3296bf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:07.752573 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c88b63-a96f-4d75-9ef9-2dda3296bf21 None admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:07.752801 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42fbee-ffee-4e30-a48a-1fe2b3adf568 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:07.753151 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c88b63-a96f-4d75-9ef9-2dda3296bf21 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:07.753595 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c88b63-a96f-4d75-9ef9-2dda3296bf21 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:07.754404 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c88b63-a96f-4d75-9ef9-2dda3296bf21 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:07.755949 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c88b63-a96f-4d75-9ef9-2dda3296bf21 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:07.790551 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832a06f-37b3-4ac6-8356-fb372effb7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:07.791158 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832a06f-37b3-4ac6-8356-fb372effb7f0 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:07.791554 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832a06f-37b3-4ac6-8356-fb372effb7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:07.791906 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832a06f-37b3-4ac6-8356-fb372effb7f0 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:07.792753 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832a06f-37b3-4ac6-8356-fb372effb7f0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:07.793123 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832a06f-37b3-4ac6-8356-fb372effb7f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:07.794901 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832a06f-37b3-4ac6-8356-fb372effb7f0 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:07.813218 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 353/695] 10.222.0.45 () {56 vars in 1149 bytes} [Wed Oct 26 10:51:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:07.818527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832a06f-37b3-4ac6-8356-fb372effb7f0 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:07.869299 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 343/696] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 10:51:07 2022] POST /identity/v3/endpoints => generated 347 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:51:07.889044 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c88b63-a96f-4d75-9ef9-2dda3296bf21 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:07.936112 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832a06f-37b3-4ac6-8356-fb372effb7f0 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:07.963993 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:07.993866 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf789a0-5a36-41d1-b0b2-7b7d009b4d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:07.994407 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf789a0-5a36-41d1-b0b2-7b7d009b4d76 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:07.994686 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf789a0-5a36-41d1-b0b2-7b7d009b4d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:07.994958 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf789a0-5a36-41d1-b0b2-7b7d009b4d76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:07.998222 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:08.039605 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c88b63-a96f-4d75-9ef9-2dda3296bf21 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:08.083595 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf789a0-5a36-41d1-b0b2-7b7d009b4d76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:08.086774 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf789a0-5a36-41d1-b0b2-7b7d009b4d76 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:08.087548 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821bec0-bb08-4d29-88d2-d1b26e31ac95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:08.088300 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821bec0-bb08-4d29-88d2-d1b26e31ac95 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:08.088581 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821bec0-bb08-4d29-88d2-d1b26e31ac95 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:08.088852 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821bec0-bb08-4d29-88d2-d1b26e31ac95 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:08.089493 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821bec0-bb08-4d29-88d2-d1b26e31ac95 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:08.090999 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821bec0-bb08-4d29-88d2-d1b26e31ac95 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:08.100301 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-7821bec0-bb08-4d29-88d2-d1b26e31ac95 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 26 10:51:08.100301 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:08.100301 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:51:08.100301 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:51:08.100301 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:51:08.100301 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:51:08.100301 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:51:08.100301 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:51:08.100301 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 26 10:51:08.100301 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:51:08.100301 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:51:08.100301 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:51:08.100301 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:08.100301 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:08.100301 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:08.100301 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:08.100301 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:08.101328 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:08.101328 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:08.101328 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:08.101328 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:08.101328 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:08.101328 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:08.101328 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:51:08.101328 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:51:08.101328 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:51:08.101328 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:51:08.101328 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:08.101328 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:08.101328 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:08.101328 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:08.101328 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:08.101328 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:08.102209 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:08.102209 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:08.102209 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:08.102209 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:08.102209 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:08.102209 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:08.102209 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:08.102209 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:08.102209 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:08.102209 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:08.102209 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:51:08.102209 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:51:08.102209 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 26 10:51:08.102209 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:51:08.102209 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 344/697] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Oct 26 10:51:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:51:08.107738 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821bec0-bb08-4d29-88d2-d1b26e31ac95 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:08.199778 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 354/698] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 26 10:51:07 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 26 10:51:08.208092 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf789a0-5a36-41d1-b0b2-7b7d009b4d76 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:08.231657 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821bec0-bb08-4d29-88d2-d1b26e31ac95 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:08.243798 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:08.245505 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:08.267047 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ed747-66eb-49dc-816f-eef284baa13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:08.267663 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ed747-66eb-49dc-816f-eef284baa13c None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:08.267942 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ed747-66eb-49dc-816f-eef284baa13c None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:08.268258 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ed747-66eb-49dc-816f-eef284baa13c None admin] PATH_INFO: `/v3/services` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:08.268921 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ed747-66eb-49dc-816f-eef284baa13c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:08.269253 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ed747-66eb-49dc-816f-eef284baa13c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:08.270624 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ed747-66eb-49dc-816f-eef284baa13c None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:08.276382 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 345/699] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Oct 26 10:51:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:08.285661 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ed747-66eb-49dc-816f-eef284baa13c None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:08.328219 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf789a0-5a36-41d1-b0b2-7b7d009b4d76 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:08.364829 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e803c3-0397-403f-aab9-7c179c63d6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:08.365671 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e803c3-0397-403f-aab9-7c179c63d6a3 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:08.366055 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e803c3-0397-403f-aab9-7c179c63d6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:08.366461 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e803c3-0397-403f-aab9-7c179c63d6a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:08.377323 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e803c3-0397-403f-aab9-7c179c63d6a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:08.378923 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e803c3-0397-403f-aab9-7c179c63d6a3 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:08.395469 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-08e803c3-0397-403f-aab9-7c179c63d6a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:51:08.395469 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:08.395469 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:08.395469 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:08.395469 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:08.395469 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:08.395469 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:08.395469 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:08.395469 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:08.395469 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:08.395469 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:08.395469 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:08.395469 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:51:08.395469 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:51:08.395469 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:51:08.395469 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:51:08.396675 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:08.396675 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:08.396675 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:08.396675 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:08.396675 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:08.396675 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:08.396675 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:08.396675 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:08.396675 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:08.396675 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:08.396675 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:08.396675 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:08.396675 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:08.396675 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:08.396675 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:08.396675 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:08.396675 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:51:08.398548 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:51:08.398548 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:51:08.398548 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:08.398548 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 355/700] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:51:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:08.399964 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ed747-66eb-49dc-816f-eef284baa13c None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:08.403092 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e803c3-0397-403f-aab9-7c179c63d6a3 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:08.442098 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318018d1-5578-47cf-aa5e-632e37314ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:08.442709 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318018d1-5578-47cf-aa5e-632e37314ed2 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:08.442990 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318018d1-5578-47cf-aa5e-632e37314ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:08.443263 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318018d1-5578-47cf-aa5e-632e37314ed2 None admin] PATH_INFO: `/v3/services` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:08.444492 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318018d1-5578-47cf-aa5e-632e37314ed2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:08.444794 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318018d1-5578-47cf-aa5e-632e37314ed2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:08.446155 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318018d1-5578-47cf-aa5e-632e37314ed2 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:08.457274 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 346/701] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Oct 26 10:51:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:08.458903 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318018d1-5578-47cf-aa5e-632e37314ed2 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:08.502229 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:08.510416 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:08.528577 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e803c3-0397-403f-aab9-7c179c63d6a3 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:08.565871 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318018d1-5578-47cf-aa5e-632e37314ed2 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:08.571637 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ebfa8-4979-45a5-ae5e-abd4cb197a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:08.572276 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ebfa8-4979-45a5-ae5e-abd4cb197a8a None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:08.572555 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ebfa8-4979-45a5-ae5e-abd4cb197a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:08.572825 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ebfa8-4979-45a5-ae5e-abd4cb197a8a None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:08.573465 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18ebfa8-4979-45a5-ae5e-abd4cb197a8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:08.573763 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18ebfa8-4979-45a5-ae5e-abd4cb197a8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:08.575125 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18ebfa8-4979-45a5-ae5e-abd4cb197a8a None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:08.592799 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 356/702] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:51:08.601571 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ebfa8-4979-45a5-ae5e-abd4cb197a8a None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:08.610222 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f1cc4-c002-4b27-8a9f-efe2d38ce801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:08.611508 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f1cc4-c002-4b27-8a9f-efe2d38ce801 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:08.612043 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f1cc4-c002-4b27-8a9f-efe2d38ce801 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:08.612524 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f1cc4-c002-4b27-8a9f-efe2d38ce801 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:08.613742 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f1cc4-c002-4b27-8a9f-efe2d38ce801 None admin] RBAC: Adding query filter params (interface=public, service_id=00c3a4cff6f442debff5c7eea95294b4, region_id=RegionOne) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:08.614204 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f1cc4-c002-4b27-8a9f-efe2d38ce801 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:08.616970 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f1cc4-c002-4b27-8a9f-efe2d38ce801 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:08.624839 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 347/703] 10.222.0.45 () {56 vars in 1251 bytes} [Wed Oct 26 10:51:08 2022] GET /identity/v3/endpoints?service_id=00c3a4cff6f442debff5c7eea95294b4&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:08.630358 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f1cc4-c002-4b27-8a9f-efe2d38ce801 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:08.723511 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ebfa8-4979-45a5-ae5e-abd4cb197a8a None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:08.739290 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f1cc4-c002-4b27-8a9f-efe2d38ce801 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:08.742622 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:08.762431 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31665624-e713-44b6-967f-8b5096f1a36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:08.762756 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31665624-e713-44b6-967f-8b5096f1a36b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:08.763109 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31665624-e713-44b6-967f-8b5096f1a36b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:08.763414 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31665624-e713-44b6-967f-8b5096f1a36b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:08.771285 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31665624-e713-44b6-967f-8b5096f1a36b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:08.772925 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31665624-e713-44b6-967f-8b5096f1a36b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:08.780121 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6b1a8-740a-4551-a183-163cedf48f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:08.781069 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6b1a8-740a-4551-a183-163cedf48f3f None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:08.781579 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6b1a8-740a-4551-a183-163cedf48f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:08.782051 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6b1a8-740a-4551-a183-163cedf48f3f None admin] PATH_INFO: `/v3/services` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:08.782872 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab6b1a8-740a-4551-a183-163cedf48f3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:08.784469 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab6b1a8-740a-4551-a183-163cedf48f3f None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:08.785236 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-31665624-e713-44b6-967f-8b5096f1a36b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:51:08.785236 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:08.785236 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:08.785236 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:08.785236 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:08.785236 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:08.785236 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:08.785236 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:08.785236 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:08.785236 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:08.785236 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:08.785236 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:08.785236 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:51:08.785236 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:51:08.785236 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:51:08.790659 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:51:08.790659 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:08.790659 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:08.790659 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:08.790659 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:08.790659 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:08.790659 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:08.790659 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:08.790659 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:08.790659 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:08.790659 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:08.790659 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:08.790659 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:08.790659 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:08.790659 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:08.790659 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:08.790659 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:08.792370 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:51:08.792370 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:51:08.792370 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:51:08.792370 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:51:08.792370 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:51:08.792370 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:51:08.792370 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:51:08.792370 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:08.792370 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 357/704] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 26 10:51:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:08.794952 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 348/705] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Oct 26 10:51:08 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 10:51:08.807499 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31665624-e713-44b6-967f-8b5096f1a36b None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:08.820944 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:08.926304 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31665624-e713-44b6-967f-8b5096f1a36b None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:08.964410 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674e076-6b19-43c3-aec7-329e7b8cf049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:08.965033 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674e076-6b19-43c3-aec7-329e7b8cf049 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:08.965312 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674e076-6b19-43c3-aec7-329e7b8cf049 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:08.965587 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674e076-6b19-43c3-aec7-329e7b8cf049 None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:08.966294 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674e076-6b19-43c3-aec7-329e7b8cf049 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:08.966598 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674e076-6b19-43c3-aec7-329e7b8cf049 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:08.968043 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674e076-6b19-43c3-aec7-329e7b8cf049 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:08.981409 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 358/706] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 26 10:51:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:08.987434 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6b1a8-740a-4551-a183-163cedf48f3f None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:09.097971 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6b1a8-740a-4551-a183-163cedf48f3f None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:09.133522 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799572ea-e774-48b6-bf05-a06a20834a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:09.134142 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799572ea-e774-48b6-bf05-a06a20834a0f None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:09.134427 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799572ea-e774-48b6-bf05-a06a20834a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:09.134705 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799572ea-e774-48b6-bf05-a06a20834a0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:09.135503 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799572ea-e774-48b6-bf05-a06a20834a0f None admin] RBAC: Adding query filter params (role.id=bb4187021aea4d30a339f0c0e79a6601, scope.project.id=e8f0f02a607a49e0b88c75019795b726, user.id=3c90765757a34c6291c9980a7d5d5c79) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:09.135819 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799572ea-e774-48b6-bf05-a06a20834a0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:09.137313 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799572ea-e774-48b6-bf05-a06a20834a0f None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:09.143821 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 349/707] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 26 10:51:08 2022] GET /identity/v3/role_assignments?user.id=3c90765757a34c6291c9980a7d5d5c79&scope.project.id=e8f0f02a607a49e0b88c75019795b726&role.id=bb4187021aea4d30a339f0c0e79a6601 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:09.331809 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebafbf-ae6a-4836-9bea-aa1e609ed717 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:09.332127 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebafbf-ae6a-4836-9bea-aa1e609ed717 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:09.332413 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebafbf-ae6a-4836-9bea-aa1e609ed717 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:09.333992 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 359/708] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:09.339658 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324226c3-e8c8-4312-8b90-15562da5995e None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:09.339949 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324226c3-e8c8-4312-8b90-15562da5995e None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:09.340261 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324226c3-e8c8-4312-8b90-15562da5995e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:09.359258 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-324226c3-e8c8-4312-8b90-15562da5995e None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:09.360711 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-324226c3-e8c8-4312-8b90-15562da5995e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:09.390043 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:09.433883 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 350/709] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:51:09.699010 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbebafbf-ae6a-4836-9bea-aa1e609ed717 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:09.766880 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:09.810662 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbebafbf-ae6a-4836-9bea-aa1e609ed717 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:09.848860 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bbddd2-b4c5-4f8a-bbdc-7aaa0920b953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:09.849780 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbddd2-b4c5-4f8a-bbdc-7aaa0920b953 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:09.850802 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbddd2-b4c5-4f8a-bbdc-7aaa0920b953 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:09.851322 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbddd2-b4c5-4f8a-bbdc-7aaa0920b953 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:09.852220 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bbddd2-b4c5-4f8a-bbdc-7aaa0920b953 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:09.853764 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bbddd2-b4c5-4f8a-bbdc-7aaa0920b953 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:09.863343 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-82bbddd2-b4c5-4f8a-bbdc-7aaa0920b953 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 26 10:51:09.863343 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:09.863343 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:51:09.863343 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:51:09.863343 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:51:09.863343 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:51:09.863343 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:51:09.863343 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:51:09.863343 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 26 10:51:09.863343 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:09.863343 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:51:09.863343 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:09.863343 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:09.863343 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:09.863343 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:09.863343 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:09.863343 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:09.864640 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:09.864640 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:09.864640 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:09.864640 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:09.864640 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:09.864640 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:09.864640 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:51:09.864640 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:51:09.864640 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:51:09.864640 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:51:09.864640 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:09.864640 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:09.864640 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:09.864640 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:09.864640 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:09.864640 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:09.865754 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:09.865754 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:09.865754 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:09.865754 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:09.865754 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:09.865754 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:09.865754 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:09.865754 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:09.865754 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:09.865754 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:09.865754 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:51:09.865754 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:51:09.865754 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 26 10:51:09.865754 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:09.868280 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 360/710] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Oct 26 10:51:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:09.880119 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324226c3-e8c8-4312-8b90-15562da5995e None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:09.978147 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324226c3-e8c8-4312-8b90-15562da5995e None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:10.013136 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5427d8f-a8d9-43ff-b622-a6d436d95a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:10.013914 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5427d8f-a8d9-43ff-b622-a6d436d95a82 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:10.014077 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5427d8f-a8d9-43ff-b622-a6d436d95a82 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:10.014274 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5427d8f-a8d9-43ff-b622-a6d436d95a82 None admin] PATH_INFO: `/v3/services` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:10.014905 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5427d8f-a8d9-43ff-b622-a6d436d95a82 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:10.015205 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5427d8f-a8d9-43ff-b622-a6d436d95a82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:10.016615 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5427d8f-a8d9-43ff-b622-a6d436d95a82 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:10.022358 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 351/711] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Oct 26 10:51:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:10.027694 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bbddd2-b4c5-4f8a-bbdc-7aaa0920b953 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:10.142133 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bbddd2-b4c5-4f8a-bbdc-7aaa0920b953 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:10.155609 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90280e3a-3100-42e5-b4c6-eae47ff130ed None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:10.156028 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90280e3a-3100-42e5-b4c6-eae47ff130ed None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:10.156439 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90280e3a-3100-42e5-b4c6-eae47ff130ed None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:10.158199 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 352/712] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:51:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:10.163677 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6969b-cb42-4a27-ae18-29853dd786ae None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:10.164092 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6969b-cb42-4a27-ae18-29853dd786ae None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:10.164497 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6969b-cb42-4a27-ae18-29853dd786ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:10.175376 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:10.181930 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87c419-fdec-4323-84f4-224afb7ebd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:10.182557 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87c419-fdec-4323-84f4-224afb7ebd5d None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:10.182842 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87c419-fdec-4323-84f4-224afb7ebd5d None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:10.183119 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87c419-fdec-4323-84f4-224afb7ebd5d None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:10.183754 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87c419-fdec-4323-84f4-224afb7ebd5d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:10.184083 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87c419-fdec-4323-84f4-224afb7ebd5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:10.185469 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87c419-fdec-4323-84f4-224afb7ebd5d None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:10.187885 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-7ec6969b-cb42-4a27-ae18-29853dd786ae None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:10.189642 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-7ec6969b-cb42-4a27-ae18-29853dd786ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:10.190681 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 361/713] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Oct 26 10:51:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:10.196966 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87c419-fdec-4323-84f4-224afb7ebd5d None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:10.212928 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:10.279184 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 353/714] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:51:10.304494 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87c419-fdec-4323-84f4-224afb7ebd5d None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:10.339929 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60850d-98ea-44f8-b702-58f3ea286033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:10.340564 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60850d-98ea-44f8-b702-58f3ea286033 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:10.340842 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60850d-98ea-44f8-b702-58f3ea286033 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:10.341112 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60850d-98ea-44f8-b702-58f3ea286033 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:10.341776 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60850d-98ea-44f8-b702-58f3ea286033 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:10.348121 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60850d-98ea-44f8-b702-58f3ea286033 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:10.422726 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 362/715] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 10:51:10 2022] POST /identity/v3/endpoints => generated 349 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:51:10.556693 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6969b-cb42-4a27-ae18-29853dd786ae None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:10.662508 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6969b-cb42-4a27-ae18-29853dd786ae None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:10.704216 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b154e90-d202-45d4-a7df-44487bc8e842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:10.704853 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b154e90-d202-45d4-a7df-44487bc8e842 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:10.705132 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b154e90-d202-45d4-a7df-44487bc8e842 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:10.705408 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b154e90-d202-45d4-a7df-44487bc8e842 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:10.705993 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b154e90-d202-45d4-a7df-44487bc8e842 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:10.707408 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b154e90-d202-45d4-a7df-44487bc8e842 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:10.716401 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-2b154e90-d202-45d4-a7df-44487bc8e842 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 26 10:51:10.716401 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:10.716401 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:51:10.716401 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:51:10.716401 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:51:10.716401 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:51:10.716401 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:51:10.716401 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:51:10.716401 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 26 10:51:10.716401 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:51:10.716401 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:51:10.716401 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:51:10.716401 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:10.716401 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:10.716401 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:10.716401 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:10.716401 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:10.717405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:10.717405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:10.717405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:10.717405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:10.717405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:10.717405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:10.717405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:51:10.717405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:51:10.717405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:51:10.717405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:51:10.717405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:10.717405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:10.717405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:10.717405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:10.717405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:10.717405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:10.718269 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:10.718269 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:10.718269 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:10.718269 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:10.718269 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:10.718269 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:10.718269 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:10.718269 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:10.718269 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:10.718269 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:10.718269 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:51:10.718269 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:51:10.718269 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 26 10:51:10.718269 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:51:10.718269 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 354/716] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 26 10:51:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:10.723608 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60850d-98ea-44f8-b702-58f3ea286033 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:10.777631 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:10.832158 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60850d-98ea-44f8-b702-58f3ea286033 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:10.867247 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090015d-60fe-4674-85e5-7ad0e61522dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:10.867860 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090015d-60fe-4674-85e5-7ad0e61522dd None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:10.868169 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090015d-60fe-4674-85e5-7ad0e61522dd None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:10.868442 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090015d-60fe-4674-85e5-7ad0e61522dd None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:10.869069 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b090015d-60fe-4674-85e5-7ad0e61522dd None admin] RBAC: Adding query filter params (name=compute) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:10.869367 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b090015d-60fe-4674-85e5-7ad0e61522dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:10.870723 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b090015d-60fe-4674-85e5-7ad0e61522dd None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:10.880658 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 363/717] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Oct 26 10:51:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:10.882442 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b154e90-d202-45d4-a7df-44487bc8e842 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:10.901694 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:10.992198 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b154e90-d202-45d4-a7df-44487bc8e842 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:11.027545 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c65d4d-be06-4b0c-84c2-f7cb6c2707ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:11.028239 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c65d4d-be06-4b0c-84c2-f7cb6c2707ee None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:11.028466 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c65d4d-be06-4b0c-84c2-f7cb6c2707ee None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:11.028723 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c65d4d-be06-4b0c-84c2-f7cb6c2707ee None admin] PATH_INFO: `/v3/services` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:11.029353 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c65d4d-be06-4b0c-84c2-f7cb6c2707ee None admin] RBAC: Adding query filter params (type=compute) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:11.029720 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c65d4d-be06-4b0c-84c2-f7cb6c2707ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:11.031090 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c65d4d-be06-4b0c-84c2-f7cb6c2707ee None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:11.036208 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 355/718] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Oct 26 10:51:10 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:11.173012 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551f108-fdc3-42d9-89b8-61fa75555ce1 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:11.173195 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551f108-fdc3-42d9-89b8-61fa75555ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:11.173476 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551f108-fdc3-42d9-89b8-61fa75555ce1 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:11.175365 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 364/719] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:11.181716 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f24578-183f-43a0-a81c-bf92d477e9e6 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:11.182159 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f24578-183f-43a0-a81c-bf92d477e9e6 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:11.182504 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f24578-183f-43a0-a81c-bf92d477e9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:11.202544 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-e0f24578-183f-43a0-a81c-bf92d477e9e6 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:11.203771 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-e0f24578-183f-43a0-a81c-bf92d477e9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:11.276650 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 356/720] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:51:11.458867 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769b083-07bc-45f4-84b1-bdc3804c03e6 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:11.459056 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769b083-07bc-45f4-84b1-bdc3804c03e6 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:11.459340 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769b083-07bc-45f4-84b1-bdc3804c03e6 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:11.461220 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 365/721] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:11.466592 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270759b1-95aa-4155-be99-a0feeba9aa6e None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:11.467132 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270759b1-95aa-4155-be99-a0feeba9aa6e None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:11.467613 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270759b1-95aa-4155-be99-a0feeba9aa6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:11.487694 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-270759b1-95aa-4155-be99-a0feeba9aa6e None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:11.489240 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-270759b1-95aa-4155-be99-a0feeba9aa6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:11.493245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:11.559997 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 357/722] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 26 10:51:11.581524 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4769b083-07bc-45f4-84b1-bdc3804c03e6 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:11.691269 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4769b083-07bc-45f4-84b1-bdc3804c03e6 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:11.706444 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:11.727936 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c837447e-d4a9-4a60-9770-a212bf16d179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:11.728553 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c837447e-d4a9-4a60-9770-a212bf16d179 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:11.728839 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c837447e-d4a9-4a60-9770-a212bf16d179 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:11.729116 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c837447e-d4a9-4a60-9770-a212bf16d179 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:11.729701 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c837447e-d4a9-4a60-9770-a212bf16d179 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:11.731080 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c837447e-d4a9-4a60-9770-a212bf16d179 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:11.740450 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-c837447e-d4a9-4a60-9770-a212bf16d179 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 26 10:51:11.740450 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:11.740450 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:51:11.740450 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:51:11.740450 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:51:11.740450 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:51:11.740450 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:51:11.740450 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:51:11.740450 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 26 10:51:11.740450 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:11.740450 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:51:11.740450 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:11.740450 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:11.740450 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:11.740450 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:11.740450 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:11.740450 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:11.741757 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:11.741757 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:11.741757 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:11.741757 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:11.741757 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:11.741757 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:11.741757 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:51:11.741757 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:51:11.741757 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:51:11.741757 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:51:11.741757 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:11.741757 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:11.741757 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:11.741757 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:11.741757 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:11.741757 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:11.742806 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:11.742806 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:11.742806 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:11.742806 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:11.742806 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:11.742806 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:11.742806 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:11.742806 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:11.742806 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:11.742806 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:11.742806 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:51:11.742806 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:51:11.742806 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 26 10:51:11.742806 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:11.749748 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 366/723] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Oct 26 10:51:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:11.755858 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270759b1-95aa-4155-be99-a0feeba9aa6e None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:11.832773 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c837447e-d4a9-4a60-9770-a212bf16d179 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:11.868126 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270759b1-95aa-4155-be99-a0feeba9aa6e None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:11.907079 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9dc454-4aff-477c-ae24-a9f130a47a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:11.907693 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dc454-4aff-477c-ae24-a9f130a47a56 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:11.907978 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dc454-4aff-477c-ae24-a9f130a47a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:11.908286 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dc454-4aff-477c-ae24-a9f130a47a56 None admin] PATH_INFO: `/v3/services` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:11.909024 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9dc454-4aff-477c-ae24-a9f130a47a56 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:11.909343 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9dc454-4aff-477c-ae24-a9f130a47a56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:11.910907 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9dc454-4aff-477c-ae24-a9f130a47a56 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:11.916392 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 358/724] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Oct 26 10:51:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:11.922214 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9dc454-4aff-477c-ae24-a9f130a47a56 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:11.926004 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:11.952707 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c837447e-d4a9-4a60-9770-a212bf16d179 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:11.996485 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b4137-8648-4c39-90e2-a726e35df9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:11.998142 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b4137-8648-4c39-90e2-a726e35df9c6 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:11.998752 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b4137-8648-4c39-90e2-a726e35df9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:11.999313 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b4137-8648-4c39-90e2-a726e35df9c6 None admin] PATH_INFO: `/v3/services/image` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:12.000354 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1b4137-8648-4c39-90e2-a726e35df9c6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:12.002618 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1b4137-8648-4c39-90e2-a726e35df9c6 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:12.015205 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-ff1b4137-8648-4c39-90e2-a726e35df9c6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 26 10:51:12.015205 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:12.015205 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:51:12.015205 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:51:12.015205 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:51:12.015205 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:51:12.015205 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:51:12.015205 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:51:12.015205 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 26 10:51:12.015205 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:12.015205 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:51:12.015205 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:12.015205 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:12.015205 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:12.015205 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:12.015205 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:12.015205 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:12.016329 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:12.016329 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:12.016329 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:12.016329 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:12.016329 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:12.016329 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:12.016329 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:51:12.016329 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:51:12.016329 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:51:12.016329 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:51:12.016329 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:12.016329 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:12.016329 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:12.016329 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:12.016329 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:12.016329 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:12.017198 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:12.017198 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:12.017198 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:12.017198 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:12.017198 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:12.017198 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:12.017198 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:12.017198 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:12.017198 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:12.017198 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:12.017198 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:51:12.017198 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:51:12.017198 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 26 10:51:12.017198 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:12.017952 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 367/725] 10.222.0.45 () {56 vars in 1105 bytes} [Wed Oct 26 10:51:11 2022] GET /identity/v3/services/image => generated 86 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:51:12.024170 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b4137-8648-4c39-90e2-a726e35df9c6 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:12.049924 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9dc454-4aff-477c-ae24-a9f130a47a56 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:12.075957 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:12.087045 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a13b796-42ce-4011-b1c6-14126f8fe7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:12.088196 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13b796-42ce-4011-b1c6-14126f8fe7f5 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:12.088196 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13b796-42ce-4011-b1c6-14126f8fe7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:12.092275 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13b796-42ce-4011-b1c6-14126f8fe7f5 None admin] PATH_INFO: `/v3/services` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:12.092275 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a13b796-42ce-4011-b1c6-14126f8fe7f5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:12.092275 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a13b796-42ce-4011-b1c6-14126f8fe7f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:12.092275 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a13b796-42ce-4011-b1c6-14126f8fe7f5 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:12.100387 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 359/726] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Oct 26 10:51:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:51:12.102850 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a13b796-42ce-4011-b1c6-14126f8fe7f5 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:12.146157 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b4137-8648-4c39-90e2-a726e35df9c6 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:12.172681 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:12.187476 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9df0b6-c519-458b-b33c-81c593854a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:12.188331 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9df0b6-c519-458b-b33c-81c593854a95 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:12.201320 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9df0b6-c519-458b-b33c-81c593854a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:12.201320 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9df0b6-c519-458b-b33c-81c593854a95 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:12.201320 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9df0b6-c519-458b-b33c-81c593854a95 None admin] RBAC: Adding query filter params (name=image) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:12.201320 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9df0b6-c519-458b-b33c-81c593854a95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:12.201320 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9df0b6-c519-458b-b33c-81c593854a95 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:12.202468 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 368/727] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:51:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:51:12.203709 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9df0b6-c519-458b-b33c-81c593854a95 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:12.212716 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a13b796-42ce-4011-b1c6-14126f8fe7f5 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:12.249851 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385a486-b3d9-44fd-b905-5bfead9cfbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:12.250801 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385a486-b3d9-44fd-b905-5bfead9cfbac None admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:12.251331 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385a486-b3d9-44fd-b905-5bfead9cfbac None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:12.251811 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385a486-b3d9-44fd-b905-5bfead9cfbac None admin] PATH_INFO: `/v3/endpoints` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:12.252790 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c385a486-b3d9-44fd-b905-5bfead9cfbac None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:12.254412 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c385a486-b3d9-44fd-b905-5bfead9cfbac None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:12.314185 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9df0b6-c519-458b-b33c-81c593854a95 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:12.322540 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:12.344731 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 360/728] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 10:51:12 2022] POST /identity/v3/endpoints => generated 346 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:51:12.369269 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c443e-87a3-44bb-92b2-1f2139470ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:12.370178 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c443e-87a3-44bb-92b2-1f2139470ea7 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:12.370686 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c443e-87a3-44bb-92b2-1f2139470ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:12.371096 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c443e-87a3-44bb-92b2-1f2139470ea7 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:12.371856 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71c443e-87a3-44bb-92b2-1f2139470ea7 None admin] RBAC: Adding query filter params (type=image) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:12.372318 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71c443e-87a3-44bb-92b2-1f2139470ea7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:12.373941 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71c443e-87a3-44bb-92b2-1f2139470ea7 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:12.380039 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 369/729] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:51:12 2022] GET /identity/v3/services?type=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:12.682385 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad32d8-5325-471f-b6b2-b2c00a4be5a8 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:12.682765 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad32d8-5325-471f-b6b2-b2c00a4be5a8 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:12.682946 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad32d8-5325-471f-b6b2-b2c00a4be5a8 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:12.684602 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 361/730] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:51:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:12.689897 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ffd99-e241-4aad-a7a8-f3f79a185218 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:12.690197 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ffd99-e241-4aad-a7a8-f3f79a185218 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:12.690456 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ffd99-e241-4aad-a7a8-f3f79a185218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:12.708678 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-e08ffd99-e241-4aad-a7a8-f3f79a185218 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:12.710421 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e08ffd99-e241-4aad-a7a8-f3f79a185218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:12.778774 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 370/731] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 26 10:51:13.047415 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad32d8-5325-471f-b6b2-b2c00a4be5a8 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:13.155839 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad32d8-5325-471f-b6b2-b2c00a4be5a8 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:13.181280 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:13.192872 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aaff21-e643-415e-bc61-253bde7d0c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:13.193515 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aaff21-e643-415e-bc61-253bde7d0c28 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:13.193797 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aaff21-e643-415e-bc61-253bde7d0c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:13.194597 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aaff21-e643-415e-bc61-253bde7d0c28 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:13.195184 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aaff21-e643-415e-bc61-253bde7d0c28 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:13.196702 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aaff21-e643-415e-bc61-253bde7d0c28 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:13.206368 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-22aaff21-e643-415e-bc61-253bde7d0c28 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 26 10:51:13.206368 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:13.206368 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:51:13.206368 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:51:13.206368 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:51:13.206368 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:51:13.206368 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:51:13.206368 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:51:13.206368 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 26 10:51:13.206368 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:51:13.206368 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:51:13.206368 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:51:13.206368 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:13.206368 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:13.206368 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:13.206368 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:13.206368 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:13.207454 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:13.207454 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:13.207454 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:13.207454 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:13.207454 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:13.207454 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:13.207454 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:51:13.207454 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:51:13.207454 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:51:13.207454 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:51:13.207454 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:13.207454 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:13.207454 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:13.207454 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:13.207454 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:13.207454 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:13.208768 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:13.208768 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:13.208768 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:13.208768 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:13.208768 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:13.208768 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:13.208768 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:13.208768 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:13.208768 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:13.208768 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:13.208768 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:51:13.208768 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:51:13.208768 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 26 10:51:13.208768 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:51:13.208768 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 362/732] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Oct 26 10:51:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:13.214845 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ffd99-e241-4aad-a7a8-f3f79a185218 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:13.316197 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:13.322370 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ffd99-e241-4aad-a7a8-f3f79a185218 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:13.364505 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfbcd50-460c-4a31-b130-c200907d7dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:13.365434 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfbcd50-460c-4a31-b130-c200907d7dc6 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:13.366428 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfbcd50-460c-4a31-b130-c200907d7dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:13.366914 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfbcd50-460c-4a31-b130-c200907d7dc6 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:13.367727 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfbcd50-460c-4a31-b130-c200907d7dc6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:13.368230 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfbcd50-460c-4a31-b130-c200907d7dc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:13.370538 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fd0d7-ac12-4c17-ae7e-eba14bd9638f None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:13.372681 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fd0d7-ac12-4c17-ae7e-eba14bd9638f None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:13.372681 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fd0d7-ac12-4c17-ae7e-eba14bd9638f None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:13.372872 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfbcd50-460c-4a31-b130-c200907d7dc6 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:13.372951 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 363/733] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:51:13.377421 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 371/734] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Oct 26 10:51:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:13.378646 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff120ca-10c8-4659-bd99-902e81b74c9b None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:13.378646 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff120ca-10c8-4659-bd99-902e81b74c9b None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:13.378834 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff120ca-10c8-4659-bd99-902e81b74c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:13.384266 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfbcd50-460c-4a31-b130-c200907d7dc6 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:13.398575 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-0ff120ca-10c8-4659-bd99-902e81b74c9b None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:13.400226 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-0ff120ca-10c8-4659-bd99-902e81b74c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:13.474745 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 364/735] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:51:13.484631 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfbcd50-460c-4a31-b130-c200907d7dc6 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:13.520524 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c9f455-9da8-415f-b77c-afdc7d4f31b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:13.521143 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9f455-9da8-415f-b77c-afdc7d4f31b2 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:13.521426 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9f455-9da8-415f-b77c-afdc7d4f31b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:13.521699 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9f455-9da8-415f-b77c-afdc7d4f31b2 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:13.522860 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c9f455-9da8-415f-b77c-afdc7d4f31b2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:13.523167 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c9f455-9da8-415f-b77c-afdc7d4f31b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:13.524721 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c9f455-9da8-415f-b77c-afdc7d4f31b2 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:13.534456 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 372/736] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Oct 26 10:51:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:51:13.535861 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff120ca-10c8-4659-bd99-902e81b74c9b None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:13.644665 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff120ca-10c8-4659-bd99-902e81b74c9b None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:13.664325 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:13.682491 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d242fb0-1a3f-438a-b40e-8292727166b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:13.683109 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d242fb0-1a3f-438a-b40e-8292727166b9 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:13.683461 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d242fb0-1a3f-438a-b40e-8292727166b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:13.683738 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d242fb0-1a3f-438a-b40e-8292727166b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:13.684547 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d242fb0-1a3f-438a-b40e-8292727166b9 None admin] RBAC: Adding query filter params (interface=admin, service_id=0947d2e81d074b87841b7dc2f4e512f2, region_id=RegionOne) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:13.684855 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d242fb0-1a3f-438a-b40e-8292727166b9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:13.686294 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d242fb0-1a3f-438a-b40e-8292727166b9 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:13.691857 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 365/737] 10.222.0.45 () {56 vars in 1249 bytes} [Wed Oct 26 10:51:13 2022] GET /identity/v3/endpoints?service_id=0947d2e81d074b87841b7dc2f4e512f2&interface=admin®ion_id=RegionOne => generated 193 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:13.697546 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c9f455-9da8-415f-b77c-afdc7d4f31b2 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:13.724391 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:13.759033 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d242fb0-1a3f-438a-b40e-8292727166b9 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:13.876949 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d242fb0-1a3f-438a-b40e-8292727166b9 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:13.917432 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace11c3-4c29-41be-a3d4-6ba152034148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:13.917624 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c9f455-9da8-415f-b77c-afdc7d4f31b2 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:13.917969 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace11c3-4c29-41be-a3d4-6ba152034148 None admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:13.918248 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace11c3-4c29-41be-a3d4-6ba152034148 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:13.918522 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace11c3-4c29-41be-a3d4-6ba152034148 None admin] PATH_INFO: `/v3/services` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:13.919282 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace11c3-4c29-41be-a3d4-6ba152034148 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:13.921045 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace11c3-4c29-41be-a3d4-6ba152034148 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:13.952215 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30c084-4795-4df8-94b7-823ead24bbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:13.952879 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30c084-4795-4df8-94b7-823ead24bbfc None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:13.953160 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30c084-4795-4df8-94b7-823ead24bbfc None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:13.953430 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30c084-4795-4df8-94b7-823ead24bbfc None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:13.954026 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d30c084-4795-4df8-94b7-823ead24bbfc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:13.955381 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d30c084-4795-4df8-94b7-823ead24bbfc None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:13.961965 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 373/738] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Oct 26 10:51:13 2022] GET /identity/v3/services => generated 1497 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 10:51:14.000809 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 366/739] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Oct 26 10:51:13 2022] POST /identity/v3/services => generated 242 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:51:14.634996 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56454f5d-7067-44af-8dca-000b2bb98d6e None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:14.635514 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56454f5d-7067-44af-8dca-000b2bb98d6e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:14.635514 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56454f5d-7067-44af-8dca-000b2bb98d6e None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:14.637122 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 374/740] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:51:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:14.642640 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebcf13-7270-4680-b5ee-329105fd3602 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:14.643031 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebcf13-7270-4680-b5ee-329105fd3602 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:14.643210 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebcf13-7270-4680-b5ee-329105fd3602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:14.661806 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-86ebcf13-7270-4680-b5ee-329105fd3602 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:14.663522 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-86ebcf13-7270-4680-b5ee-329105fd3602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:14.701929 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:14.726672 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352f7c0-a3ab-4022-8dfd-300ff22c9a73 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:14.726959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352f7c0-a3ab-4022-8dfd-300ff22c9a73 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:14.727238 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352f7c0-a3ab-4022-8dfd-300ff22c9a73 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:14.728874 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 375/741] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:51:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:51:14.734037 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808ba82-a08b-465d-9d40-bcce1ca633e6 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:14.734321 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808ba82-a08b-465d-9d40-bcce1ca633e6 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:14.734596 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808ba82-a08b-465d-9d40-bcce1ca633e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:14.747515 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 367/742] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:14 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:51:14.757835 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-d808ba82-a08b-465d-9d40-bcce1ca633e6 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:14.759117 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d808ba82-a08b-465d-9d40-bcce1ca633e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:14.831979 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 376/743] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:14 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:51:15.020677 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebcf13-7270-4680-b5ee-329105fd3602 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:15.119808 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808ba82-a08b-465d-9d40-bcce1ca633e6 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:15.125674 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebcf13-7270-4680-b5ee-329105fd3602 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:15.142353 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:15.164867 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517e4c9-d989-4544-bea4-96442f1bd98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:15.165326 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517e4c9-d989-4544-bea4-96442f1bd98d None admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:15.165612 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517e4c9-d989-4544-bea4-96442f1bd98d None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:15.165887 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517e4c9-d989-4544-bea4-96442f1bd98d None admin] PATH_INFO: `/v3/services` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:15.166548 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6517e4c9-d989-4544-bea4-96442f1bd98d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:15.167926 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6517e4c9-d989-4544-bea4-96442f1bd98d None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:15.235724 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808ba82-a08b-465d-9d40-bcce1ca633e6 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:15.271287 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4039bb-2789-4bf2-a8cc-0d9331b3ebe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:15.271824 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4039bb-2789-4bf2-a8cc-0d9331b3ebe0 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:15.272134 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4039bb-2789-4bf2-a8cc-0d9331b3ebe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:15.272456 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4039bb-2789-4bf2-a8cc-0d9331b3ebe0 None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:15.273104 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4039bb-2789-4bf2-a8cc-0d9331b3ebe0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:15.274556 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4039bb-2789-4bf2-a8cc-0d9331b3ebe0 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:15.277242 dv-cinder-862679-1-smb devstack@keystone.service[81623]: WARNING keystone.server.flask.common [None req-0e4039bb-2789-4bf2-a8cc-0d9331b3ebe0 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 26 10:51:15.294377 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 368/744] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Oct 26 10:51:15 2022] POST /identity/v3/services => generated 242 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:51:15.363180 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.sql.core [None req-0e4039bb-2789-4bf2-a8cc-0d9331b3ebe0 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 26 10:51:15.363180 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 26 10:51:15.363180 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [parameters: {'id': 'edd55a9127414ca596825dea3da5b021', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 26 10:51:15.363180 dv-cinder-862679-1-smb devstack@keystone.service[81623]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81623) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 26 10:51:15.366489 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-0e4039bb-2789-4bf2-a8cc-0d9331b3ebe0 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id edd55a9127414ca596825dea3da5b021.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id edd55a9127414ca596825dea3da5b021. Oct 26 10:51:15.366489 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:15.366489 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 26 10:51:15.366489 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 26 10:51:15.366489 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 26 10:51:15.366489 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 26 10:51:15.366489 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 26 10:51:15.366489 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application result = self._query(query) Oct 26 10:51:15.366489 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 26 10:51:15.366489 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application conn.query(q) Oct 26 10:51:15.366489 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 26 10:51:15.366489 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 26 10:51:15.366489 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 26 10:51:15.367286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application result.read() Oct 26 10:51:15.367286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 26 10:51:15.367286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 26 10:51:15.367286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 26 10:51:15.367286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 26 10:51:15.367286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 26 10:51:15.367286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 26 10:51:15.367286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 26 10:51:15.367286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 26 10:51:15.367286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 26 10:51:15.367286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:15.367286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 26 10:51:15.367286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:15.367286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:15.367286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 26 10:51:15.367286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 26 10:51:15.367286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 26 10:51:15.367286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 26 10:51:15.368318 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 26 10:51:15.368318 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application next(self.gen) Oct 26 10:51:15.368318 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 26 10:51:15.368318 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application yield resource Oct 26 10:51:15.368318 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 26 10:51:15.368318 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application next(self.gen) Oct 26 10:51:15.368318 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 26 10:51:15.368318 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.session.rollback() Oct 26 10:51:15.368318 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 10:51:15.368318 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.force_reraise() Oct 26 10:51:15.368318 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 10:51:15.368318 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise self.value Oct 26 10:51:15.368318 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 26 10:51:15.368318 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 26 10:51:15.368318 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 26 10:51:15.368318 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application session.commit() Oct 26 10:51:15.368318 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 26 10:51:15.369286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 26 10:51:15.369286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 26 10:51:15.369286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._prepare_impl() Oct 26 10:51:15.369286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 26 10:51:15.369286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.session.flush() Oct 26 10:51:15.369286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 26 10:51:15.369286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._flush(objects) Oct 26 10:51:15.369286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 26 10:51:15.369286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 26 10:51:15.369286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 26 10:51:15.369286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application compat.raise_( Oct 26 10:51:15.369286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 26 10:51:15.369286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception Oct 26 10:51:15.369286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 26 10:51:15.369286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application flush_context.execute() Oct 26 10:51:15.369286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 26 10:51:15.369286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rec.execute(self) Oct 26 10:51:15.370205 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 26 10:51:15.370205 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 26 10:51:15.370205 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 26 10:51:15.370205 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 26 10:51:15.370205 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 26 10:51:15.370205 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 26 10:51:15.370205 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 26 10:51:15.370205 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 26 10:51:15.370205 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 26 10:51:15.370205 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 26 10:51:15.370205 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 26 10:51:15.370205 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 26 10:51:15.370205 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 26 10:51:15.370205 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 26 10:51:15.370205 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 26 10:51:15.371037 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 26 10:51:15.371037 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 26 10:51:15.371037 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception Oct 26 10:51:15.371037 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 26 10:51:15.371037 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 26 10:51:15.371037 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 26 10:51:15.371037 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 26 10:51:15.371037 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 26 10:51:15.371037 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application result = self._query(query) Oct 26 10:51:15.371037 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 26 10:51:15.371037 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application conn.query(q) Oct 26 10:51:15.371037 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 26 10:51:15.371037 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 26 10:51:15.371037 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 26 10:51:15.371037 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application result.read() Oct 26 10:51:15.371037 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 26 10:51:15.371037 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 26 10:51:15.372991 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 26 10:51:15.372991 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 26 10:51:15.372991 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 26 10:51:15.372991 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 26 10:51:15.372991 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 26 10:51:15.372991 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 26 10:51:15.372991 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 26 10:51:15.372991 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 26 10:51:15.372991 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [parameters: {'id': 'edd55a9127414ca596825dea3da5b021', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 26 10:51:15.372991 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 26 10:51:15.372991 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:15.372991 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:51:15.372991 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:15.372991 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:15.372991 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 26 10:51:15.374093 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 26 10:51:15.374093 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 26 10:51:15.374093 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 26 10:51:15.374093 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 26 10:51:15.374093 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:15.374093 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:51:15.374093 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:15.374093 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:15.374093 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:15.374093 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:15.374093 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:15.374093 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:15.374093 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:15.374093 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:15.374093 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:15.374093 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:15.374093 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:15.375394 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:15.375394 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 26 10:51:15.375394 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 26 10:51:15.375394 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:15.375394 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:15.375394 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 26 10:51:15.375394 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 26 10:51:15.375394 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id edd55a9127414ca596825dea3da5b021. Oct 26 10:51:15.375394 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:15.375394 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 377/745] 10.222.0.45 () {60 vars in 1140 bytes} [Wed Oct 26 10:51:15 2022] POST /identity/v3/projects => generated 262 bytes in 249 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:15.376193 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517e4c9-d989-4544-bea4-96442f1bd98d None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:15.410936 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:15.498094 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517e4c9-d989-4544-bea4-96442f1bd98d None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:15.533948 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e11628-7794-491c-9a86-1c70b0b599e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:15.534593 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e11628-7794-491c-9a86-1c70b0b599e9 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:15.534942 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e11628-7794-491c-9a86-1c70b0b599e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:15.535221 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e11628-7794-491c-9a86-1c70b0b599e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:15.542677 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e11628-7794-491c-9a86-1c70b0b599e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:15.544155 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e11628-7794-491c-9a86-1c70b0b599e9 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:15.556903 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-55e11628-7794-491c-9a86-1c70b0b599e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:51:15.556903 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:15.556903 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:15.556903 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:15.556903 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:15.556903 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:15.556903 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:15.556903 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:15.556903 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:15.556903 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:15.556903 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:15.556903 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:15.556903 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:51:15.556903 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:51:15.556903 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:51:15.557843 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:51:15.557843 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:15.557843 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:15.557843 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:15.557843 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:15.557843 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:15.557843 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:15.557843 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:15.557843 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:15.557843 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:15.557843 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:15.557843 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:15.557843 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:15.557843 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:15.557843 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:15.557843 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:15.557843 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:15.558771 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:51:15.558771 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:51:15.558771 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:51:15.558771 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:51:15.558771 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:51:15.558771 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:51:15.558771 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:51:15.558771 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:51:15.558771 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 369/746] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 26 10:51:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:15.564307 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4039bb-2789-4bf2-a8cc-0d9331b3ebe0 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:15.642418 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:15.674600 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4039bb-2789-4bf2-a8cc-0d9331b3ebe0 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:15.718320 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3cf4f-9eb7-423c-91b0-bfd83a022882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:15.718932 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3cf4f-9eb7-423c-91b0-bfd83a022882 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:15.719207 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3cf4f-9eb7-423c-91b0-bfd83a022882 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:15.719481 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3cf4f-9eb7-423c-91b0-bfd83a022882 None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:15.720162 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c3cf4f-9eb7-423c-91b0-bfd83a022882 None admin] RBAC: Adding query filter params (name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:15.720461 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c3cf4f-9eb7-423c-91b0-bfd83a022882 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:15.722094 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c3cf4f-9eb7-423c-91b0-bfd83a022882 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:15.743778 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 378/747] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Oct 26 10:51:15 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:16.188100 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d51bb9-6e08-4633-b22a-b5f3d2fafd5a None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:16.189123 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d51bb9-6e08-4633-b22a-b5f3d2fafd5a None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:16.189651 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d51bb9-6e08-4633-b22a-b5f3d2fafd5a None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:16.191450 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 370/748] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:51:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:16.197825 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9609766-e70d-488b-8b33-8d56ce72119f None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:16.198408 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9609766-e70d-488b-8b33-8d56ce72119f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:16.198890 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9609766-e70d-488b-8b33-8d56ce72119f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:16.214356 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ee940-e287-420d-954f-007d2d06f255 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:16.214869 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ee940-e287-420d-954f-007d2d06f255 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:16.215379 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ee940-e287-420d-954f-007d2d06f255 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:16.217215 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 371/749] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:51:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:51:16.221037 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-d9609766-e70d-488b-8b33-8d56ce72119f None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:16.222703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d9609766-e70d-488b-8b33-8d56ce72119f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:16.224047 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5da39-c16d-4bb2-ba11-7a1dda788841 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:16.224596 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5da39-c16d-4bb2-ba11-7a1dda788841 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:16.224945 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5da39-c16d-4bb2-ba11-7a1dda788841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:16.243933 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-54c5da39-c16d-4bb2-ba11-7a1dda788841 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:16.245271 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-54c5da39-c16d-4bb2-ba11-7a1dda788841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:16.298842 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 379/750] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:16 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:51:16.321646 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 372/751] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:16 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:51:16.577237 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9609766-e70d-488b-8b33-8d56ce72119f None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:16.600861 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5da39-c16d-4bb2-ba11-7a1dda788841 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:16.615869 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:16.644469 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:16.683391 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9609766-e70d-488b-8b33-8d56ce72119f None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:16.704111 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5da39-c16d-4bb2-ba11-7a1dda788841 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:16.724296 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a761524-5660-4649-8fe8-bc54e8911a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:16.725242 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a761524-5660-4649-8fe8-bc54e8911a3b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:16.726191 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a761524-5660-4649-8fe8-bc54e8911a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:16.726847 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a761524-5660-4649-8fe8-bc54e8911a3b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:16.727657 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a761524-5660-4649-8fe8-bc54e8911a3b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:16.729338 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a761524-5660-4649-8fe8-bc54e8911a3b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:16.739582 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-1a761524-5660-4649-8fe8-bc54e8911a3b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 26 10:51:16.739582 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:16.739582 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:51:16.739582 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:51:16.739582 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:51:16.739582 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:51:16.739582 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:51:16.739582 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:51:16.739582 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 26 10:51:16.739582 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:16.739582 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:51:16.739582 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:16.739582 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:16.739582 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:16.739582 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:16.739582 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:16.739582 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:16.740812 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:16.740812 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:16.740812 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:16.740812 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:16.740812 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:16.740812 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:16.740812 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:51:16.740812 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:51:16.740812 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:51:16.740812 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:51:16.740812 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:16.740812 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:16.740812 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:16.740812 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:16.740812 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:16.740812 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:16.741729 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:16.741729 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:16.741729 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:16.741729 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:16.741729 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:16.741729 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:16.741729 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:16.741729 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:16.741729 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:16.741729 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:16.741729 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:51:16.741729 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:51:16.741729 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 26 10:51:16.741729 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:16.743170 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b3f37-7de2-46d2-b0c3-e6437044b1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:16.743863 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b3f37-7de2-46d2-b0c3-e6437044b1d6 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:16.744173 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b3f37-7de2-46d2-b0c3-e6437044b1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:16.744452 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b3f37-7de2-46d2-b0c3-e6437044b1d6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:16.749869 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b3f37-7de2-46d2-b0c3-e6437044b1d6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:16.749869 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b3f37-7de2-46d2-b0c3-e6437044b1d6 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:16.750064 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 380/752] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Oct 26 10:51:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:16.751044 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a761524-5660-4649-8fe8-bc54e8911a3b None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:16.760526 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-4b7b3f37-7de2-46d2-b0c3-e6437044b1d6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 26 10:51:16.760526 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:16.760526 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:51:16.760526 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:51:16.760526 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:51:16.760526 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:51:16.760526 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:51:16.760526 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:51:16.760526 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 26 10:51:16.760526 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:51:16.760526 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:51:16.760526 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:51:16.760526 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:16.760526 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:16.760526 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:16.760526 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:16.760526 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:16.761529 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:16.761529 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:16.761529 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:16.761529 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:16.761529 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:16.761529 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:16.761529 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:51:16.761529 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:51:16.761529 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:51:16.761529 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:51:16.761529 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:16.761529 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:16.761529 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:16.761529 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:16.761529 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:16.761529 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:16.762370 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:16.762370 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:16.762370 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:16.762370 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:16.762370 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:16.762370 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:16.762370 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:16.762370 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:16.762370 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:16.762370 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:16.762370 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:51:16.762370 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:51:16.762370 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 26 10:51:16.762370 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:51:16.762370 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 373/753] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 26 10:51:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:16.767410 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b3f37-7de2-46d2-b0c3-e6437044b1d6 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:16.860544 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:16.880896 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a761524-5660-4649-8fe8-bc54e8911a3b None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:16.882761 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b3f37-7de2-46d2-b0c3-e6437044b1d6 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:16.919216 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9648cd0-73e3-49d0-8503-fc2f56aec86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:16.919680 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:16.920655 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9648cd0-73e3-49d0-8503-fc2f56aec86c None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:16.921158 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9648cd0-73e3-49d0-8503-fc2f56aec86c None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:16.921631 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9648cd0-73e3-49d0-8503-fc2f56aec86c None admin] PATH_INFO: `/v3/services` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:16.922447 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9648cd0-73e3-49d0-8503-fc2f56aec86c None admin] RBAC: Adding query filter params (name=compute) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:16.922941 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9648cd0-73e3-49d0-8503-fc2f56aec86c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:16.924538 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9648cd0-73e3-49d0-8503-fc2f56aec86c None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:16.929184 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1338591-45b7-4f4b-9917-c5332b23f480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:16.929799 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1338591-45b7-4f4b-9917-c5332b23f480 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:16.930085 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1338591-45b7-4f4b-9917-c5332b23f480 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:16.930362 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1338591-45b7-4f4b-9917-c5332b23f480 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:16.930995 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1338591-45b7-4f4b-9917-c5332b23f480 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:16.933942 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1338591-45b7-4f4b-9917-c5332b23f480 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:16.934043 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 374/754] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Oct 26 10:51:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:51:16.934120 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1338591-45b7-4f4b-9917-c5332b23f480 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:16.937349 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9648cd0-73e3-49d0-8503-fc2f56aec86c None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:16.947221 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 381/755] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Oct 26 10:51:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:16.948157 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1338591-45b7-4f4b-9917-c5332b23f480 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:17.053943 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1338591-45b7-4f4b-9917-c5332b23f480 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:17.074853 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9648cd0-73e3-49d0-8503-fc2f56aec86c None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:17.096948 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b3575-e331-4738-951d-0282d4802c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:17.098184 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b3575-e331-4738-951d-0282d4802c8f None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:17.099092 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b3575-e331-4738-951d-0282d4802c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:17.099581 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b3575-e331-4738-951d-0282d4802c8f None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:17.100520 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b3575-e331-4738-951d-0282d4802c8f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:17.101035 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b3575-e331-4738-951d-0282d4802c8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:17.103478 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b3575-e331-4738-951d-0282d4802c8f None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:17.110761 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 382/756] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Oct 26 10:51:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:17.116966 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b3575-e331-4738-951d-0282d4802c8f None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:17.118913 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567154c-404d-4157-8d89-12c6258decc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:17.119759 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567154c-404d-4157-8d89-12c6258decc3 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:17.120289 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567154c-404d-4157-8d89-12c6258decc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:17.120826 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567154c-404d-4157-8d89-12c6258decc3 None admin] PATH_INFO: `/v3/services` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:17.121661 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0567154c-404d-4157-8d89-12c6258decc3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:17.122166 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0567154c-404d-4157-8d89-12c6258decc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:17.123772 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0567154c-404d-4157-8d89-12c6258decc3 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:17.134309 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 375/757] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Oct 26 10:51:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:51:17.135523 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567154c-404d-4157-8d89-12c6258decc3 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:17.145108 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:17.175936 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:17.222752 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b3575-e331-4738-951d-0282d4802c8f None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:17.257473 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b3cec-22ad-4708-b53b-193a54e81c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:17.258079 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b3cec-22ad-4708-b53b-193a54e81c8e None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:17.258358 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b3cec-22ad-4708-b53b-193a54e81c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:17.258629 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b3cec-22ad-4708-b53b-193a54e81c8e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:17.259304 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09b3cec-22ad-4708-b53b-193a54e81c8e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:17.260696 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09b3cec-22ad-4708-b53b-193a54e81c8e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:17.264870 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567154c-404d-4157-8d89-12c6258decc3 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:17.302933 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63765cca-82ac-4b90-a9a9-9d16b1cc7152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:17.304531 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63765cca-82ac-4b90-a9a9-9d16b1cc7152 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:17.305043 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63765cca-82ac-4b90-a9a9-9d16b1cc7152 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:17.305523 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63765cca-82ac-4b90-a9a9-9d16b1cc7152 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:17.306422 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63765cca-82ac-4b90-a9a9-9d16b1cc7152 None admin] RBAC: Adding query filter params (interface=public, service_id=32853d90ab184be1ae958da3b907c5d5, region_id=RegionOne) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:17.307066 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63765cca-82ac-4b90-a9a9-9d16b1cc7152 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:17.308855 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63765cca-82ac-4b90-a9a9-9d16b1cc7152 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:17.314598 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 376/758] 10.222.0.45 () {56 vars in 1251 bytes} [Wed Oct 26 10:51:17 2022] GET /identity/v3/endpoints?service_id=32853d90ab184be1ae958da3b907c5d5&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:17.320879 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63765cca-82ac-4b90-a9a9-9d16b1cc7152 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:17.356756 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 383/759] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 10:51:17 2022] POST /identity/v3/endpoints => generated 325 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 10:51:17.407787 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:17.447354 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63765cca-82ac-4b90-a9a9-9d16b1cc7152 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:17.499880 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5221d7c-e8a6-4448-8ecf-fcd61480fda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:17.500934 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5221d7c-e8a6-4448-8ecf-fcd61480fda7 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:17.501451 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5221d7c-e8a6-4448-8ecf-fcd61480fda7 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:17.501930 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5221d7c-e8a6-4448-8ecf-fcd61480fda7 None admin] PATH_INFO: `/v3/services` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:17.502746 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5221d7c-e8a6-4448-8ecf-fcd61480fda7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:17.504485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5221d7c-e8a6-4448-8ecf-fcd61480fda7 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:17.513563 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 377/760] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Oct 26 10:51:17 2022] GET /identity/v3/services => generated 1957 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 10:51:17.584257 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edd82f-1ae3-4df5-98d2-0441edc2a993 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:17.584645 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edd82f-1ae3-4df5-98d2-0441edc2a993 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:17.585012 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edd82f-1ae3-4df5-98d2-0441edc2a993 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:17.586565 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 384/761] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:17.592709 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357845e-df3a-44a9-9943-8ee92f4e0404 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:17.593351 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357845e-df3a-44a9-9943-8ee92f4e0404 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:17.593851 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357845e-df3a-44a9-9943-8ee92f4e0404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:17.616695 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-7357845e-df3a-44a9-9943-8ee92f4e0404 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:17.618261 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-7357845e-df3a-44a9-9943-8ee92f4e0404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:17.702285 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 378/762] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:17 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:51:17.972278 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8edd82f-1ae3-4df5-98d2-0441edc2a993 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:18.025501 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64842e9-1cc6-4f1b-92c9-7d42f69c6494 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:18.025855 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64842e9-1cc6-4f1b-92c9-7d42f69c6494 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:18.026065 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64842e9-1cc6-4f1b-92c9-7d42f69c6494 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:18.027536 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 379/763] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:51:18.034015 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b026b0-e3c1-472a-94df-8595c32bf045 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:18.034305 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b026b0-e3c1-472a-94df-8595c32bf045 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:18.034577 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b026b0-e3c1-472a-94df-8595c32bf045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:18.053058 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-25b026b0-e3c1-472a-94df-8595c32bf045 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:18.055041 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-25b026b0-e3c1-472a-94df-8595c32bf045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:18.095656 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8edd82f-1ae3-4df5-98d2-0441edc2a993 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:18.114662 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:18.116896 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:18.129731 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 380/764] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:18 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 26 10:51:18.139990 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151406c3-6223-4e72-bd0a-606df180a026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:18.139990 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151406c3-6223-4e72-bd0a-606df180a026 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:18.139990 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151406c3-6223-4e72-bd0a-606df180a026 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:18.139990 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151406c3-6223-4e72-bd0a-606df180a026 None admin] PATH_INFO: `/v3/services/image` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:18.140457 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151406c3-6223-4e72-bd0a-606df180a026 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:18.140457 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151406c3-6223-4e72-bd0a-606df180a026 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:18.149126 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-151406c3-6223-4e72-bd0a-606df180a026 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 26 10:51:18.149126 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:18.149126 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:51:18.149126 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:51:18.149126 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:51:18.149126 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:51:18.149126 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:51:18.149126 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:51:18.149126 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 26 10:51:18.149126 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:18.149126 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:51:18.149126 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:18.149126 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:18.149126 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:18.149126 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:18.149126 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:18.149126 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:18.150221 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:18.150221 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:18.150221 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:18.150221 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:18.150221 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:18.150221 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:18.150221 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:51:18.150221 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:51:18.150221 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:51:18.150221 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:51:18.150221 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:18.150221 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:18.150221 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:18.150221 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:18.150221 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:18.150221 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:18.151365 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:18.151365 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:18.151365 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:18.151365 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:18.151365 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:18.151365 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:18.151365 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:18.151365 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:18.151365 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:18.151365 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:18.151365 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:51:18.151365 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:51:18.151365 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 26 10:51:18.151365 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:18.151365 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 385/765] 10.222.0.45 () {56 vars in 1105 bytes} [Wed Oct 26 10:51:17 2022] GET /identity/v3/services/image => generated 86 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:18.159152 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b026b0-e3c1-472a-94df-8595c32bf045 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:18.262205 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b026b0-e3c1-472a-94df-8595c32bf045 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:18.297609 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f280e-448c-4de4-bcbe-3981cb680dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:18.299016 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f280e-448c-4de4-bcbe-3981cb680dca None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:18.299509 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f280e-448c-4de4-bcbe-3981cb680dca None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:18.299977 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f280e-448c-4de4-bcbe-3981cb680dca None admin] PATH_INFO: `/v3/services` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:18.300823 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f280e-448c-4de4-bcbe-3981cb680dca None admin] RBAC: Adding query filter params (name=image) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:18.301335 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f280e-448c-4de4-bcbe-3981cb680dca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:18.302962 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f280e-448c-4de4-bcbe-3981cb680dca None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:18.312092 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 381/766] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:51:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:18.314910 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151406c3-6223-4e72-bd0a-606df180a026 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:18.424030 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f280e-448c-4de4-bcbe-3981cb680dca None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:18.429705 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151406c3-6223-4e72-bd0a-606df180a026 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:18.469762 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0798b4-12e7-4de6-bf72-82e8ca2a99a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:18.470368 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0798b4-12e7-4de6-bf72-82e8ca2a99a6 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:18.470752 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0798b4-12e7-4de6-bf72-82e8ca2a99a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:18.471033 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0798b4-12e7-4de6-bf72-82e8ca2a99a6 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:18.471662 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0798b4-12e7-4de6-bf72-82e8ca2a99a6 None admin] RBAC: Adding query filter params (type=image) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:18.471962 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0798b4-12e7-4de6-bf72-82e8ca2a99a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:18.473490 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0798b4-12e7-4de6-bf72-82e8ca2a99a6 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:18.480151 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 386/767] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:51:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:18.486883 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0798b4-12e7-4de6-bf72-82e8ca2a99a6 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:18.498736 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:18.551651 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:18.552547 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f280e-448c-4de4-bcbe-3981cb680dca None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:18.587949 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6363ca-ef77-443b-ba5a-eb779110709a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:18.588926 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6363ca-ef77-443b-ba5a-eb779110709a None admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:18.589405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6363ca-ef77-443b-ba5a-eb779110709a None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:18.589915 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6363ca-ef77-443b-ba5a-eb779110709a None admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:18.590755 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6363ca-ef77-443b-ba5a-eb779110709a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:18.592418 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6363ca-ef77-443b-ba5a-eb779110709a None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:18.595190 dv-cinder-862679-1-smb devstack@keystone.service[81622]: WARNING keystone.server.flask.common [None req-6f6363ca-ef77-443b-ba5a-eb779110709a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 26 10:51:18.617237 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0798b4-12e7-4de6-bf72-82e8ca2a99a6 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:18.632957 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.sql.core [None req-6f6363ca-ef77-443b-ba5a-eb779110709a None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 26 10:51:18.632957 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 26 10:51:18.632957 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [parameters: {'user_id': 'c75ec6c782c243f5bf5390c19086e4fa', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 26 10:51:18.632957 dv-cinder-862679-1-smb devstack@keystone.service[81622]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81622) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 26 10:51:18.649352 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-6f6363ca-ef77-443b-ba5a-eb779110709a None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 26 10:51:18.649352 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:18.649352 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 26 10:51:18.649352 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 26 10:51:18.649352 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 26 10:51:18.649352 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 26 10:51:18.649352 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 26 10:51:18.649352 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application result = self._query(query) Oct 26 10:51:18.649352 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 26 10:51:18.649352 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application conn.query(q) Oct 26 10:51:18.649352 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 26 10:51:18.649352 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 26 10:51:18.649352 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 26 10:51:18.649352 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application result.read() Oct 26 10:51:18.649352 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 26 10:51:18.650284 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 26 10:51:18.650284 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 26 10:51:18.650284 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 26 10:51:18.650284 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 26 10:51:18.650284 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 26 10:51:18.650284 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 26 10:51:18.650284 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 26 10:51:18.650284 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 26 10:51:18.650284 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:51:18.650284 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 26 10:51:18.650284 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:51:18.650284 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:18.650284 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 26 10:51:18.650284 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 26 10:51:18.650284 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 26 10:51:18.650284 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 26 10:51:18.650284 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 26 10:51:18.650284 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application next(self.gen) Oct 26 10:51:18.651245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 26 10:51:18.651245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application yield resource Oct 26 10:51:18.651245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 26 10:51:18.651245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application next(self.gen) Oct 26 10:51:18.651245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 26 10:51:18.651245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application self.session.rollback() Oct 26 10:51:18.651245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 10:51:18.651245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application self.force_reraise() Oct 26 10:51:18.651245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 10:51:18.651245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise self.value Oct 26 10:51:18.651245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 26 10:51:18.651245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 26 10:51:18.651245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 26 10:51:18.651245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application session.commit() Oct 26 10:51:18.651245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 26 10:51:18.651245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 26 10:51:18.651245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 26 10:51:18.652214 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application self._prepare_impl() Oct 26 10:51:18.652214 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 26 10:51:18.652214 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application self.session.flush() Oct 26 10:51:18.652214 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 26 10:51:18.652214 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application self._flush(objects) Oct 26 10:51:18.652214 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 26 10:51:18.652214 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 26 10:51:18.652214 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 26 10:51:18.652214 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application compat.raise_( Oct 26 10:51:18.652214 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 26 10:51:18.652214 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception Oct 26 10:51:18.652214 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 26 10:51:18.652214 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application flush_context.execute() Oct 26 10:51:18.652214 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 26 10:51:18.652214 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rec.execute(self) Oct 26 10:51:18.652214 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 26 10:51:18.652214 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 26 10:51:18.657830 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 26 10:51:18.657830 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 26 10:51:18.657830 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 26 10:51:18.657830 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 26 10:51:18.657830 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 26 10:51:18.657830 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 26 10:51:18.657830 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 26 10:51:18.657830 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 26 10:51:18.657830 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 26 10:51:18.657830 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 26 10:51:18.657830 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 26 10:51:18.657830 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 26 10:51:18.657830 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 26 10:51:18.657830 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 26 10:51:18.657830 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 26 10:51:18.657830 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception Oct 26 10:51:18.658671 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 26 10:51:18.658671 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 26 10:51:18.658671 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 26 10:51:18.658671 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 26 10:51:18.658671 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 26 10:51:18.658671 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application result = self._query(query) Oct 26 10:51:18.658671 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 26 10:51:18.658671 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application conn.query(q) Oct 26 10:51:18.658671 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 26 10:51:18.658671 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 26 10:51:18.658671 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 26 10:51:18.658671 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application result.read() Oct 26 10:51:18.658671 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 26 10:51:18.658671 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 26 10:51:18.658671 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 26 10:51:18.658671 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 26 10:51:18.659498 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 26 10:51:18.659498 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 26 10:51:18.659498 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 26 10:51:18.659498 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 26 10:51:18.659498 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 26 10:51:18.659498 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 26 10:51:18.659498 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [parameters: {'user_id': 'c75ec6c782c243f5bf5390c19086e4fa', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 26 10:51:18.659498 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 26 10:51:18.659498 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:51:18.659498 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:51:18.659498 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:51:18.659498 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:18.659498 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:18.659498 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:18.659498 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:18.660407 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:18.660407 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:18.660407 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:18.660407 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:18.660407 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:18.660407 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:18.660407 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:18.660407 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 26 10:51:18.660407 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 26 10:51:18.660407 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:18.660407 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:18.660407 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:51:18.660407 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:51:18.660407 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:51:18.660407 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:51:18.660407 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 26 10:51:18.660407 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 26 10:51:18.661339 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 26 10:51:18.661339 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 26 10:51:18.661339 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 26 10:51:18.661339 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 26 10:51:18.661339 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 26 10:51:18.661339 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:51:18.661339 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 382/768] 10.222.0.45 () {60 vars in 1131 bytes} [Wed Oct 26 10:51:18 2022] POST /identity/v3/users => generated 160 bytes in 227 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:51:18.661339 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6363ca-ef77-443b-ba5a-eb779110709a None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:18.669803 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4722c04-8b89-4f9f-8fd2-82391487cd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:18.670939 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4722c04-8b89-4f9f-8fd2-82391487cd4b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:18.671418 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4722c04-8b89-4f9f-8fd2-82391487cd4b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:18.671933 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4722c04-8b89-4f9f-8fd2-82391487cd4b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:18.672886 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4722c04-8b89-4f9f-8fd2-82391487cd4b None admin] RBAC: Adding query filter params (interface=public, service_id=076de621afab4ab8be9f9bc523e7f6aa, region_id=RegionOne) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:18.673395 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4722c04-8b89-4f9f-8fd2-82391487cd4b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:18.675073 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4722c04-8b89-4f9f-8fd2-82391487cd4b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:18.686487 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 387/769] 10.222.0.45 () {56 vars in 1251 bytes} [Wed Oct 26 10:51:18 2022] GET /identity/v3/endpoints?service_id=076de621afab4ab8be9f9bc523e7f6aa&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:18.688034 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4722c04-8b89-4f9f-8fd2-82391487cd4b None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:18.788200 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6363ca-ef77-443b-ba5a-eb779110709a None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:18.805538 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4722c04-8b89-4f9f-8fd2-82391487cd4b None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:18.808884 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:18.816123 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:18.828859 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061961b8-6d9a-4bdf-a9ca-a30eca92a238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:18.829743 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061961b8-6d9a-4bdf-a9ca-a30eca92a238 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:18.830315 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061961b8-6d9a-4bdf-a9ca-a30eca92a238 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:18.830740 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061961b8-6d9a-4bdf-a9ca-a30eca92a238 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:18.841498 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061961b8-6d9a-4bdf-a9ca-a30eca92a238 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:18.844875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e295c37-8f38-472e-b0f5-c4150a5edd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:18.845089 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061961b8-6d9a-4bdf-a9ca-a30eca92a238 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:18.845461 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e295c37-8f38-472e-b0f5-c4150a5edd7b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:18.845743 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e295c37-8f38-472e-b0f5-c4150a5edd7b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:18.846026 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e295c37-8f38-472e-b0f5-c4150a5edd7b None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:18.846629 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e295c37-8f38-472e-b0f5-c4150a5edd7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:18.848206 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e295c37-8f38-472e-b0f5-c4150a5edd7b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:18.856656 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 388/770] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Oct 26 10:51:18 2022] GET /identity/v3/services => generated 1957 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 10:51:18.859549 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-061961b8-6d9a-4bdf-a9ca-a30eca92a238 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 26 10:51:18.859549 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:18.859549 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:18.859549 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:18.859549 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:18.859549 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:18.859549 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:18.859549 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:18.859549 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:18.859549 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:18.859549 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:18.859549 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:18.859549 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:51:18.859549 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:51:18.859549 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:51:18.859549 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:51:18.860642 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:18.860642 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:18.860642 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:51:18.860642 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:51:18.860642 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:51:18.860642 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:51:18.860642 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:18.860642 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:18.860642 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:18.860642 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:18.860642 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:18.860642 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:18.860642 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:18.860642 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:18.860642 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:18.860642 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:18.860642 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:18.860642 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:18.861610 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:18.861610 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:18.861610 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:51:18.861610 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:51:18.861610 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:51:18.861610 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:51:18.861610 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:51:18.861610 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:51:18.861610 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 26 10:51:18.861610 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:51:18.872087 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 383/771] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 26 10:51:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:18.872290 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e295c37-8f38-472e-b0f5-c4150a5edd7b None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:19.001472 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e295c37-8f38-472e-b0f5-c4150a5edd7b None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:19.043205 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b85e71-f6db-4324-bd59-b55464239b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:19.044237 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b85e71-f6db-4324-bd59-b55464239b5d None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:19.044742 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b85e71-f6db-4324-bd59-b55464239b5d None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:19.045501 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b85e71-f6db-4324-bd59-b55464239b5d None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:19.046425 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b85e71-f6db-4324-bd59-b55464239b5d None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:19.046939 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b85e71-f6db-4324-bd59-b55464239b5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:19.048621 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b85e71-f6db-4324-bd59-b55464239b5d None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:19.086443 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 389/772] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Oct 26 10:51:18 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:19.660427 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff5d37-421b-4105-8bf1-0253cc0c9015 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:19.660965 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff5d37-421b-4105-8bf1-0253cc0c9015 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:19.660965 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff5d37-421b-4105-8bf1-0253cc0c9015 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:19.665219 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 384/773] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:51:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:19.670614 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ed5c8-bd6a-4837-b7e8-465219268c05 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:19.670907 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ed5c8-bd6a-4837-b7e8-465219268c05 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:19.671186 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ed5c8-bd6a-4837-b7e8-465219268c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:19.694112 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-940ed5c8-bd6a-4837-b7e8-465219268c05 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:19.695981 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-940ed5c8-bd6a-4837-b7e8-465219268c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:19.721264 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:19.765883 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 390/774] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:19 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:51:19.886405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25e886-eb7e-47ab-bbe8-60cd00f6e576 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:19.886746 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25e886-eb7e-47ab-bbe8-60cd00f6e576 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:19.886960 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25e886-eb7e-47ab-bbe8-60cd00f6e576 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:19.888498 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 385/775] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:51:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:19.893449 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef875132-5986-4fff-901f-a819580c0d2c None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:19.893748 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef875132-5986-4fff-901f-a819580c0d2c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:19.894031 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef875132-5986-4fff-901f-a819580c0d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:19.912297 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-ef875132-5986-4fff-901f-a819580c0d2c None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:19.913958 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ef875132-5986-4fff-901f-a819580c0d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:19.979771 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 391/776] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:19 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:51:20.035313 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25e886-eb7e-47ab-bbe8-60cd00f6e576 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:20.139191 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25e886-eb7e-47ab-bbe8-60cd00f6e576 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:20.172540 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab03fc-0889-4724-b341-e311d4eeea6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:20.173107 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab03fc-0889-4724-b341-e311d4eeea6f None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:20.173438 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab03fc-0889-4724-b341-e311d4eeea6f None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:20.173777 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab03fc-0889-4724-b341-e311d4eeea6f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:20.174885 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab03fc-0889-4724-b341-e311d4eeea6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:20.176403 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab03fc-0889-4724-b341-e311d4eeea6f None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:20.180210 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 386/777] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:51:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:20.184372 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef875132-5986-4fff-901f-a819580c0d2c None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:20.253240 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab03fc-0889-4724-b341-e311d4eeea6f None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:20.277164 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:20.287664 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef875132-5986-4fff-901f-a819580c0d2c None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:20.301165 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:20.324838 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c33121-103b-44d5-8c47-d5eb9ddb18ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:20.325568 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c33121-103b-44d5-8c47-d5eb9ddb18ef None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:20.325853 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c33121-103b-44d5-8c47-d5eb9ddb18ef None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:20.326129 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c33121-103b-44d5-8c47-d5eb9ddb18ef None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:20.326795 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c33121-103b-44d5-8c47-d5eb9ddb18ef None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:20.328266 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c33121-103b-44d5-8c47-d5eb9ddb18ef None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:20.364322 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab03fc-0889-4724-b341-e311d4eeea6f None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:20.398374 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97535568-e14c-488e-96f5-456e609ef18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:20.398997 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97535568-e14c-488e-96f5-456e609ef18f None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:20.399279 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97535568-e14c-488e-96f5-456e609ef18f None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:20.399552 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97535568-e14c-488e-96f5-456e609ef18f None admin] PATH_INFO: `/v3/services/compute` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:20.400159 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97535568-e14c-488e-96f5-456e609ef18f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:20.401534 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97535568-e14c-488e-96f5-456e609ef18f None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:20.410137 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-97535568-e14c-488e-96f5-456e609ef18f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 26 10:51:20.410137 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:20.410137 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:51:20.410137 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:51:20.410137 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:51:20.410137 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:51:20.410137 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:51:20.410137 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:51:20.410137 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 26 10:51:20.410137 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:51:20.410137 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:51:20.410137 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:51:20.410137 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:20.410137 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:20.410137 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:20.410137 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:20.410137 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:20.411405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:20.411405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:20.411405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:20.411405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:20.411405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:20.411405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:20.411405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:51:20.411405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:51:20.411405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:51:20.411405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:51:20.411405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:20.411405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:20.411405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:20.411405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:20.411405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:20.411405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:20.412417 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:20.412417 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:20.412417 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:20.412417 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:20.412417 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:20.412417 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:20.412417 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:20.412417 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:20.412417 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:20.412417 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:20.412417 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:51:20.412417 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:51:20.412417 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 26 10:51:20.412417 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:51:20.412417 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 387/778] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 26 10:51:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:51:20.417238 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97535568-e14c-488e-96f5-456e609ef18f None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:20.434821 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 392/779] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Oct 26 10:51:20 2022] POST /identity/v3/projects => generated 311 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:51:20.533485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97535568-e14c-488e-96f5-456e609ef18f None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:20.544251 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:20.572124 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171f479-033b-4bec-90b7-6faa545a5afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:20.572760 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171f479-033b-4bec-90b7-6faa545a5afb None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:20.573047 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171f479-033b-4bec-90b7-6faa545a5afb None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:20.573325 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171f479-033b-4bec-90b7-6faa545a5afb None admin] PATH_INFO: `/v3/services` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:20.573971 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171f479-033b-4bec-90b7-6faa545a5afb None admin] RBAC: Adding query filter params (name=compute) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:20.574275 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171f479-033b-4bec-90b7-6faa545a5afb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:20.575665 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171f479-033b-4bec-90b7-6faa545a5afb None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:20.581759 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 388/780] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Oct 26 10:51:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:51:20.589876 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c33121-103b-44d5-8c47-d5eb9ddb18ef None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:20.697235 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c33121-103b-44d5-8c47-d5eb9ddb18ef None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:20.732211 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef104a-b30f-41d8-88d5-e407725cdcdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:20.732829 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef104a-b30f-41d8-88d5-e407725cdcdc None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:20.733114 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef104a-b30f-41d8-88d5-e407725cdcdc None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:20.733396 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef104a-b30f-41d8-88d5-e407725cdcdc None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:20.734036 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef104a-b30f-41d8-88d5-e407725cdcdc None admin] RBAC: Adding query filter params (type=compute) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:20.734341 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef104a-b30f-41d8-88d5-e407725cdcdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:20.735711 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef104a-b30f-41d8-88d5-e407725cdcdc None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:20.745945 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 393/781] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Oct 26 10:51:20 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:51:20.747072 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171f479-033b-4bec-90b7-6faa545a5afb None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:20.852208 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171f479-033b-4bec-90b7-6faa545a5afb None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:20.886238 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875dac0e-298c-4671-b372-c4ecab9211f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:20.886854 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875dac0e-298c-4671-b372-c4ecab9211f8 None admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:20.887140 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875dac0e-298c-4671-b372-c4ecab9211f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:20.887416 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875dac0e-298c-4671-b372-c4ecab9211f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:20.888104 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875dac0e-298c-4671-b372-c4ecab9211f8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:20.889472 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875dac0e-298c-4671-b372-c4ecab9211f8 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:20.995442 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 389/782] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 10:51:20 2022] POST /identity/v3/endpoints => generated 334 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:51:21.063733 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96497789-ea4b-4d8c-b66c-c03dc5ad066d None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:21.064119 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96497789-ea4b-4d8c-b66c-c03dc5ad066d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:21.064317 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96497789-ea4b-4d8c-b66c-c03dc5ad066d None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:21.065836 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 394/783] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:51:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:21.072277 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057eb21-276f-4d01-88f7-ca6c93e7c30f None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:21.072608 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057eb21-276f-4d01-88f7-ca6c93e7c30f None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:21.072899 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057eb21-276f-4d01-88f7-ca6c93e7c30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:21.092340 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-6057eb21-276f-4d01-88f7-ca6c93e7c30f None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:21.093933 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-6057eb21-276f-4d01-88f7-ca6c93e7c30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:21.119584 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:21.177905 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 390/784] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:21 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:51:21.451005 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96497789-ea4b-4d8c-b66c-c03dc5ad066d None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:21.461339 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:21.555938 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96497789-ea4b-4d8c-b66c-c03dc5ad066d None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:21.589817 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de6224-d8bb-4abd-afeb-08a41378b7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:21.590454 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de6224-d8bb-4abd-afeb-08a41378b7b6 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:21.590791 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de6224-d8bb-4abd-afeb-08a41378b7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:21.591017 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de6224-d8bb-4abd-afeb-08a41378b7b6 None admin] PATH_INFO: `/v3/services/image` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:21.591645 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95de6224-d8bb-4abd-afeb-08a41378b7b6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:21.593004 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95de6224-d8bb-4abd-afeb-08a41378b7b6 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:21.602443 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-95de6224-d8bb-4abd-afeb-08a41378b7b6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 26 10:51:21.602443 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:21.602443 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:51:21.602443 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:51:21.602443 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:51:21.602443 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:51:21.602443 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:51:21.602443 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:51:21.602443 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 26 10:51:21.602443 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:21.602443 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:51:21.602443 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:21.602443 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:21.602443 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:21.602443 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:21.602443 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:21.602443 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:21.603449 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:21.603449 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:21.603449 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:21.603449 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:21.603449 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:21.603449 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:21.603449 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:51:21.603449 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:51:21.603449 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:51:21.603449 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:51:21.603449 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:21.603449 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:21.603449 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:21.603449 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:21.603449 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:21.603449 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:21.604788 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:21.604788 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:21.604788 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:21.604788 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:21.604788 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:21.604788 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:21.604788 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:21.604788 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:21.604788 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:21.604788 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:21.604788 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:51:21.604788 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:51:21.604788 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 26 10:51:21.604788 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:21.608378 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 395/785] 10.222.0.45 () {56 vars in 1105 bytes} [Wed Oct 26 10:51:21 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:21.609561 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6057eb21-276f-4d01-88f7-ca6c93e7c30f None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:21.713820 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6057eb21-276f-4d01-88f7-ca6c93e7c30f None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:21.750229 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c03808-1c78-4b5c-866c-e41cf8cfbbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:21.750882 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c03808-1c78-4b5c-866c-e41cf8cfbbec None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:21.751113 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c03808-1c78-4b5c-866c-e41cf8cfbbec None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:21.751384 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c03808-1c78-4b5c-866c-e41cf8cfbbec None admin] PATH_INFO: `/v3/services` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:21.752016 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c03808-1c78-4b5c-866c-e41cf8cfbbec None admin] RBAC: Adding query filter params (name=image) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:21.752347 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c03808-1c78-4b5c-866c-e41cf8cfbbec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:21.753724 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c03808-1c78-4b5c-866c-e41cf8cfbbec None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:21.758928 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 391/786] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:51:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:21.764651 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de6224-d8bb-4abd-afeb-08a41378b7b6 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:21.837998 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:21.868687 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de6224-d8bb-4abd-afeb-08a41378b7b6 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:21.902976 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b31123-2ab5-4eeb-a13e-9081b8e54533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:21.903639 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b31123-2ab5-4eeb-a13e-9081b8e54533 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:21.903926 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b31123-2ab5-4eeb-a13e-9081b8e54533 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:21.904277 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b31123-2ab5-4eeb-a13e-9081b8e54533 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:21.904913 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b31123-2ab5-4eeb-a13e-9081b8e54533 None admin] RBAC: Adding query filter params (type=image) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:21.905216 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b31123-2ab5-4eeb-a13e-9081b8e54533 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:21.906581 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b31123-2ab5-4eeb-a13e-9081b8e54533 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:21.916749 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 396/787] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:51:21 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:21.917858 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c03808-1c78-4b5c-866c-e41cf8cfbbec None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:21.937313 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:22.021765 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c03808-1c78-4b5c-866c-e41cf8cfbbec None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:22.056049 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af173a6-2014-422f-aee3-ab32bdc4c82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:22.056682 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af173a6-2014-422f-aee3-ab32bdc4c82d None admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:22.056964 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af173a6-2014-422f-aee3-ab32bdc4c82d None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:22.057238 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af173a6-2014-422f-aee3-ab32bdc4c82d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:22.057899 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af173a6-2014-422f-aee3-ab32bdc4c82d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:22.059251 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af173a6-2014-422f-aee3-ab32bdc4c82d None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:22.142636 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 392/788] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 10:51:21 2022] POST /identity/v3/endpoints => generated 327 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:51:22.669311 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef629a7-1d4c-47d1-ac8d-169568c4e484 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:22.669862 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef629a7-1d4c-47d1-ac8d-169568c4e484 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:22.669862 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef629a7-1d4c-47d1-ac8d-169568c4e484 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:22.671490 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 397/789] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:22.676715 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6309a-9514-47a6-8ee4-4c2e247ce19d None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:22.677004 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6309a-9514-47a6-8ee4-4c2e247ce19d None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:22.677279 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6309a-9514-47a6-8ee4-4c2e247ce19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:22.695915 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-e2e6309a-9514-47a6-8ee4-4c2e247ce19d None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:22.697119 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-e2e6309a-9514-47a6-8ee4-4c2e247ce19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:22.765590 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:22.775278 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 393/790] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:51:23.046591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef629a7-1d4c-47d1-ac8d-169568c4e484 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:23.153627 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef629a7-1d4c-47d1-ac8d-169568c4e484 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:23.187392 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e536720f-963c-4b40-af21-5bc2a5214bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:23.188021 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536720f-963c-4b40-af21-5bc2a5214bbe None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:23.188333 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536720f-963c-4b40-af21-5bc2a5214bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:23.188604 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536720f-963c-4b40-af21-5bc2a5214bbe None admin] PATH_INFO: `/v3/domains/default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:23.189703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e536720f-963c-4b40-af21-5bc2a5214bbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:23.191128 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e536720f-963c-4b40-af21-5bc2a5214bbe None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:23.192716 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 398/791] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:51:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:23.198392 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6309a-9514-47a6-8ee4-4c2e247ce19d None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:23.223292 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82476122-c982-4d2d-a83a-4463c2071f37 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:23.223585 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82476122-c982-4d2d-a83a-4463c2071f37 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:23.223865 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82476122-c982-4d2d-a83a-4463c2071f37 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:23.225258 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 399/792] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:51:23.230373 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3eb0d-b313-42af-8cd0-c149e54b3e51 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:23.230666 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3eb0d-b313-42af-8cd0-c149e54b3e51 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:23.230948 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3eb0d-b313-42af-8cd0-c149e54b3e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:23.237502 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:23.250104 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-1ef3eb0d-b313-42af-8cd0-c149e54b3e51 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:23.253023 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1ef3eb0d-b313-42af-8cd0-c149e54b3e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:23.309734 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6309a-9514-47a6-8ee4-4c2e247ce19d None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:23.325660 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 400/793] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 26 10:51:23.352802 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1495f-83be-449f-8c3c-eb6050055afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:23.353415 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1495f-83be-449f-8c3c-eb6050055afe None admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:23.353692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1495f-83be-449f-8c3c-eb6050055afe None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:23.353961 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1495f-83be-449f-8c3c-eb6050055afe None admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:23.354619 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a1495f-83be-449f-8c3c-eb6050055afe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:23.356020 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a1495f-83be-449f-8c3c-eb6050055afe None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:23.460132 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 394/794] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Oct 26 10:51:23 2022] POST /identity/v3/users => generated 285 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:51:23.596609 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3eb0d-b313-42af-8cd0-c149e54b3e51 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:23.701093 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3eb0d-b313-42af-8cd0-c149e54b3e51 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:23.737443 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:23.743131 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c0700-5668-4ee5-b4af-020b3b521d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:23.743769 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c0700-5668-4ee5-b4af-020b3b521d77 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:23.744047 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c0700-5668-4ee5-b4af-020b3b521d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:23.744349 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c0700-5668-4ee5-b4af-020b3b521d77 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:23.754242 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56c0700-5668-4ee5-b4af-020b3b521d77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:51:23.759075 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-e56c0700-5668-4ee5-b4af-020b3b521d77 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 26 10:51:23.759075 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:23.759075 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:23.759075 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:23.759075 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:23.759075 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:23.759075 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:23.759075 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:23.759075 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:23.759075 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:23.759075 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:23.759075 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:23.759075 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:51:23.759075 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:51:23.759075 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:51:23.759075 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:51:23.760386 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:51:23.760386 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:51:23.760386 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:51:23.760386 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:51:23.760386 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:23.760386 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:23.760386 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:23.760386 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:23.760386 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:23.760386 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:23.760386 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:23.760386 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:23.760386 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:23.760386 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:23.760386 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:23.760386 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:23.761296 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:23.761296 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:23.761296 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:23.761296 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:23.761296 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:51:23.761296 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:51:23.761296 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:51:23.761296 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:51:23.761296 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:51:23.761296 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:51:23.761296 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 26 10:51:23.761296 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:23.761296 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 401/795] 10.222.0.45 () {56 vars in 1120 bytes} [Wed Oct 26 10:51:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:23.766236 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1495f-83be-449f-8c3c-eb6050055afe None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:23.825227 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:23.875982 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1495f-83be-449f-8c3c-eb6050055afe None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:23.910164 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77ae30-0a6c-4f64-9c96-c892c40507b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:23.910778 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77ae30-0a6c-4f64-9c96-c892c40507b1 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:23.911055 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77ae30-0a6c-4f64-9c96-c892c40507b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:23.911326 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77ae30-0a6c-4f64-9c96-c892c40507b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:23.911986 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f77ae30-0a6c-4f64-9c96-c892c40507b1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:23.912309 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f77ae30-0a6c-4f64-9c96-c892c40507b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:23.914260 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f77ae30-0a6c-4f64-9c96-c892c40507b1 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:23.927456 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 395/796] 10.222.0.45 () {56 vars in 1115 bytes} [Wed Oct 26 10:51:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:23.928642 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c0700-5668-4ee5-b4af-020b3b521d77 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:24.029842 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c0700-5668-4ee5-b4af-020b3b521d77 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:24.064078 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a843ae-0691-463e-ad85-bebea1a1d7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:24.064724 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a843ae-0691-463e-ad85-bebea1a1d7b6 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:24.065001 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a843ae-0691-463e-ad85-bebea1a1d7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:24.065270 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a843ae-0691-463e-ad85-bebea1a1d7b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:24.075259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a843ae-0691-463e-ad85-bebea1a1d7b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:24.076726 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a843ae-0691-463e-ad85-bebea1a1d7b6 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:24.091531 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-49a843ae-0691-463e-ad85-bebea1a1d7b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:51:24.091531 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:24.091531 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:24.091531 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:24.091531 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:24.091531 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:24.091531 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:24.091531 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:24.091531 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:24.091531 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:24.091531 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:24.091531 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:24.091531 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:51:24.091531 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:51:24.091531 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:51:24.091531 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:51:24.092759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:24.092759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:24.092759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:24.092759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:24.092759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:24.092759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:24.092759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:24.092759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:24.092759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:24.092759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:24.092759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:24.092759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:24.092759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:24.092759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:24.092759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:24.092759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:24.092759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:51:24.093656 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:51:24.093656 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:51:24.093656 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:24.093656 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 402/797] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:51:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:51:24.098299 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77ae30-0a6c-4f64-9c96-c892c40507b1 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:24.202822 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77ae30-0a6c-4f64-9c96-c892c40507b1 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:24.220740 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:24.240193 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ed100-69d2-441f-bf73-3c4aa239490f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:24.247318 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ed100-69d2-441f-bf73-3c4aa239490f None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:24.247318 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ed100-69d2-441f-bf73-3c4aa239490f None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:24.247318 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ed100-69d2-441f-bf73-3c4aa239490f None admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:24.247318 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ed100-69d2-441f-bf73-3c4aa239490f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:24.247318 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ed100-69d2-441f-bf73-3c4aa239490f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:24.247318 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ed100-69d2-441f-bf73-3c4aa239490f None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:24.262592 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 396/798] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:24.264260 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a843ae-0691-463e-ad85-bebea1a1d7b6 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:24.311436 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:24.346785 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6ca46-5dc8-45f1-8442-c81f3a61261f None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:24.347075 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6ca46-5dc8-45f1-8442-c81f3a61261f None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:24.347356 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6ca46-5dc8-45f1-8442-c81f3a61261f None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:24.348870 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 397/799] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:51:24.354165 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068fe64-bc0c-4ed4-ac58-b2332d96132f None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:24.354452 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068fe64-bc0c-4ed4-ac58-b2332d96132f None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:24.354730 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068fe64-bc0c-4ed4-ac58-b2332d96132f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:24.373280 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-a068fe64-bc0c-4ed4-ac58-b2332d96132f None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:24.374476 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-a068fe64-bc0c-4ed4-ac58-b2332d96132f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:24.376747 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a843ae-0691-463e-ad85-bebea1a1d7b6 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:24.415394 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15b28e-5f6b-40b7-a744-419eccea41e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:24.416029 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15b28e-5f6b-40b7-a744-419eccea41e4 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:24.416337 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15b28e-5f6b-40b7-a744-419eccea41e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:24.416610 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15b28e-5f6b-40b7-a744-419eccea41e4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:24.424483 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15b28e-5f6b-40b7-a744-419eccea41e4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:24.425926 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15b28e-5f6b-40b7-a744-419eccea41e4 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:24.437282 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-1e15b28e-5f6b-40b7-a744-419eccea41e4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 26 10:51:24.437282 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:24.437282 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:24.437282 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:24.437282 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:24.437282 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:24.437282 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:24.437282 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:24.437282 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:24.437282 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:24.437282 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:24.437282 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:24.437282 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:51:24.437282 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:51:24.437282 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:51:24.437282 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:51:24.438245 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:24.438245 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:24.438245 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:51:24.438245 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:51:24.438245 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:51:24.438245 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:51:24.438245 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:24.438245 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:24.438245 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:24.438245 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:24.438245 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:24.438245 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:24.438245 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:24.438245 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:24.438245 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:24.438245 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:24.438245 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:24.438245 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:24.439613 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:24.439613 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:24.439613 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:51:24.439613 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:51:24.439613 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:51:24.439613 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:51:24.439613 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:51:24.439613 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:51:24.439613 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 26 10:51:24.439613 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:24.439613 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 403/800] 10.222.0.45 () {56 vars in 1093 bytes} [Wed Oct 26 10:51:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:24.443952 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15b28e-5f6b-40b7-a744-419eccea41e4 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:24.448898 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 398/801] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 26 10:51:24.547756 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15b28e-5f6b-40b7-a744-419eccea41e4 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:24.550108 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:24.582375 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59227473-ca9c-4645-bf46-dd23a5821080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:24.582978 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59227473-ca9c-4645-bf46-dd23a5821080 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:24.583259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59227473-ca9c-4645-bf46-dd23a5821080 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:24.583535 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59227473-ca9c-4645-bf46-dd23a5821080 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:24.584276 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59227473-ca9c-4645-bf46-dd23a5821080 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:24.584587 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59227473-ca9c-4645-bf46-dd23a5821080 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:24.586048 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59227473-ca9c-4645-bf46-dd23a5821080 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:24.603492 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 404/802] 10.222.0.45 () {56 vars in 1133 bytes} [Wed Oct 26 10:51:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:51:24.609021 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068fe64-bc0c-4ed4-ac58-b2332d96132f None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:24.706617 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068fe64-bc0c-4ed4-ac58-b2332d96132f None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:24.716248 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:24.718859 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59227473-ca9c-4645-bf46-dd23a5821080 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:24.745256 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054fc596-4be1-4462-ad5b-f71ee7ec0aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:24.745901 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fc596-4be1-4462-ad5b-f71ee7ec0aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:24.746183 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fc596-4be1-4462-ad5b-f71ee7ec0aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:24.746459 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fc596-4be1-4462-ad5b-f71ee7ec0aa4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:24.759325 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054fc596-4be1-4462-ad5b-f71ee7ec0aa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:24.760799 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054fc596-4be1-4462-ad5b-f71ee7ec0aa4 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:24.775893 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-054fc596-4be1-4462-ad5b-f71ee7ec0aa4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:51:24.775893 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:24.775893 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:24.775893 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:24.775893 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:24.775893 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:24.775893 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:24.775893 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:24.775893 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:24.775893 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:24.775893 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:24.775893 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:24.775893 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:51:24.775893 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:51:24.775893 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:51:24.775893 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:51:24.777729 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:24.777729 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:24.777729 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:24.777729 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:24.777729 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:24.777729 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:24.777729 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:24.777729 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:24.777729 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:24.777729 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:24.777729 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:24.777729 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:24.777729 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:24.777729 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:24.777729 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:24.777729 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:24.777729 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:51:24.778837 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:51:24.778837 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:51:24.778837 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:51:24.778837 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 399/803] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:51:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:24.782773 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054fc596-4be1-4462-ad5b-f71ee7ec0aa4 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:24.827321 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59227473-ca9c-4645-bf46-dd23a5821080 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:24.861973 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56d7f6-5e5e-4ee5-9a8e-9f0995db7c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:24.862633 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56d7f6-5e5e-4ee5-9a8e-9f0995db7c07 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:24.863030 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56d7f6-5e5e-4ee5-9a8e-9f0995db7c07 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:24.863317 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56d7f6-5e5e-4ee5-9a8e-9f0995db7c07 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:24.863985 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d56d7f6-5e5e-4ee5-9a8e-9f0995db7c07 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:24.865375 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d56d7f6-5e5e-4ee5-9a8e-9f0995db7c07 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:24.884043 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054fc596-4be1-4462-ad5b-f71ee7ec0aa4 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:24.899857 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.sql.core [None req-6d56d7f6-5e5e-4ee5-9a8e-9f0995db7c07 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 26 10:51:24.899857 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 26 10:51:24.899857 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [parameters: {'id': '7c6d23a39d4d4a6089f69b7bbb8083f6', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 26 10:51:24.899857 dv-cinder-862679-1-smb devstack@keystone.service[81623]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81623) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 26 10:51:24.907591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-6d56d7f6-5e5e-4ee5-9a8e-9f0995db7c07 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 26 10:51:24.907591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:24.907591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 26 10:51:24.907591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 26 10:51:24.907591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 26 10:51:24.907591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 26 10:51:24.907591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 26 10:51:24.907591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application result = self._query(query) Oct 26 10:51:24.907591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 26 10:51:24.907591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application conn.query(q) Oct 26 10:51:24.907591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 26 10:51:24.907591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 26 10:51:24.907591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 26 10:51:24.907591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application result.read() Oct 26 10:51:24.908458 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 26 10:51:24.908458 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 26 10:51:24.908458 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 26 10:51:24.908458 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 26 10:51:24.908458 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 26 10:51:24.908458 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 26 10:51:24.908458 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 26 10:51:24.908458 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 26 10:51:24.908458 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 26 10:51:24.908458 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:24.908458 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 26 10:51:24.908458 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:24.908458 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:24.908458 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 26 10:51:24.908458 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 26 10:51:24.908458 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 26 10:51:24.908458 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 26 10:51:24.908458 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 26 10:51:24.912541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application next(self.gen) Oct 26 10:51:24.912541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 26 10:51:24.912541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application yield resource Oct 26 10:51:24.912541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 26 10:51:24.912541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application next(self.gen) Oct 26 10:51:24.912541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 26 10:51:24.912541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.session.rollback() Oct 26 10:51:24.912541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 10:51:24.912541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.force_reraise() Oct 26 10:51:24.912541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 10:51:24.912541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise self.value Oct 26 10:51:24.912541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 26 10:51:24.912541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 26 10:51:24.912541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 26 10:51:24.912541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application session.commit() Oct 26 10:51:24.912541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 26 10:51:24.912541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 26 10:51:24.914042 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 26 10:51:24.914042 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._prepare_impl() Oct 26 10:51:24.914042 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 26 10:51:24.914042 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.session.flush() Oct 26 10:51:24.914042 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 26 10:51:24.914042 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._flush(objects) Oct 26 10:51:24.914042 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 26 10:51:24.914042 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 26 10:51:24.914042 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 26 10:51:24.914042 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application compat.raise_( Oct 26 10:51:24.914042 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 26 10:51:24.914042 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception Oct 26 10:51:24.914042 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 26 10:51:24.914042 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application flush_context.execute() Oct 26 10:51:24.914042 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 26 10:51:24.914042 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rec.execute(self) Oct 26 10:51:24.914042 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 26 10:51:24.914987 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 26 10:51:24.914987 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 26 10:51:24.914987 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 26 10:51:24.914987 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 26 10:51:24.914987 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 26 10:51:24.914987 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 26 10:51:24.914987 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 26 10:51:24.914987 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 26 10:51:24.914987 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 26 10:51:24.914987 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 26 10:51:24.914987 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 26 10:51:24.914987 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 26 10:51:24.914987 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 26 10:51:24.914987 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 26 10:51:24.914987 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 26 10:51:24.915984 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 26 10:51:24.915984 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception Oct 26 10:51:24.915984 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 26 10:51:24.915984 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 26 10:51:24.915984 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 26 10:51:24.915984 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 26 10:51:24.915984 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 26 10:51:24.915984 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application result = self._query(query) Oct 26 10:51:24.915984 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 26 10:51:24.915984 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application conn.query(q) Oct 26 10:51:24.915984 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 26 10:51:24.915984 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 26 10:51:24.915984 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 26 10:51:24.915984 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application result.read() Oct 26 10:51:24.915984 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 26 10:51:24.915984 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 26 10:51:24.915984 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 26 10:51:24.917107 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 26 10:51:24.917107 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 26 10:51:24.917107 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 26 10:51:24.917107 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 26 10:51:24.917107 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 26 10:51:24.917107 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 26 10:51:24.917107 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 26 10:51:24.917107 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [parameters: {'id': '7c6d23a39d4d4a6089f69b7bbb8083f6', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 26 10:51:24.917107 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 26 10:51:24.917107 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:24.917107 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:51:24.917107 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:24.917107 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:24.917107 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 26 10:51:24.917107 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 26 10:51:24.918098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 26 10:51:24.918098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 26 10:51:24.918098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 26 10:51:24.918098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:24.918098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:51:24.918098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:24.918098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:24.918098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:24.918098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:24.918098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:24.918098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:24.918098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:24.918098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:24.918098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:24.918098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:24.918098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:24.918098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:24.919347 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 26 10:51:24.919347 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 26 10:51:24.919347 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:24.919347 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:24.919347 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 26 10:51:24.919347 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 26 10:51:24.919347 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:24.919347 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:24.919347 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 26 10:51:24.919347 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 26 10:51:24.919347 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 26 10:51:24.919347 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:24.919347 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 405/804] 10.222.0.45 () {60 vars in 1137 bytes} [Wed Oct 26 10:51:24 2022] POST /identity/v3/domains => generated 190 bytes in 191 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:51:24.921529 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56d7f6-5e5e-4ee5-9a8e-9f0995db7c07 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:24.922300 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba9b15-3561-4e33-a065-d07f412345e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:24.922907 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba9b15-3561-4e33-a065-d07f412345e6 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:24.923239 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba9b15-3561-4e33-a065-d07f412345e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:24.923516 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba9b15-3561-4e33-a065-d07f412345e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:24.924223 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ba9b15-3561-4e33-a065-d07f412345e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:24.924580 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ba9b15-3561-4e33-a065-d07f412345e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:24.925939 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ba9b15-3561-4e33-a065-d07f412345e6 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:24.942390 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 400/805] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:51:24.943337 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba9b15-3561-4e33-a065-d07f412345e6 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:24.958021 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:24.966237 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:25.033452 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56d7f6-5e5e-4ee5-9a8e-9f0995db7c07 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:25.043632 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba9b15-3561-4e33-a065-d07f412345e6 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:25.069892 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380e048-9417-44f7-9e61-363e8cf68230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:25.070528 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380e048-9417-44f7-9e61-363e8cf68230 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:25.070811 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380e048-9417-44f7-9e61-363e8cf68230 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:25.071086 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380e048-9417-44f7-9e61-363e8cf68230 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:25.079666 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b12738a-45a4-4b20-a04d-0692fa7e425a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:25.080265 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12738a-45a4-4b20-a04d-0692fa7e425a None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:25.080550 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12738a-45a4-4b20-a04d-0692fa7e425a None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:25.080828 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12738a-45a4-4b20-a04d-0692fa7e425a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:25.081701 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d380e048-9417-44f7-9e61-363e8cf68230 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:25.083148 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d380e048-9417-44f7-9e61-363e8cf68230 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:25.087761 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b12738a-45a4-4b20-a04d-0692fa7e425a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:25.089218 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b12738a-45a4-4b20-a04d-0692fa7e425a None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:25.097971 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-d380e048-9417-44f7-9e61-363e8cf68230 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:51:25.097971 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:25.097971 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:25.097971 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:25.097971 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:25.097971 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:25.097971 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:25.097971 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:25.097971 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:25.097971 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:25.097971 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:25.097971 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:25.097971 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:51:25.097971 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:51:25.097971 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:51:25.097971 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:51:25.098934 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:25.098934 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:25.098934 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:25.098934 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:25.098934 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:25.098934 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:25.098934 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:25.098934 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:25.098934 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:25.098934 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:25.098934 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:25.098934 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:25.098934 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:25.098934 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:25.098934 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:25.098934 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:25.098934 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:51:25.101074 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:51:25.101074 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:51:25.101074 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:25.101074 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 406/806] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:51:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:25.105366 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380e048-9417-44f7-9e61-363e8cf68230 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:25.105609 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-7b12738a-45a4-4b20-a04d-0692fa7e425a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:51:25.105609 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:25.105609 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:25.105609 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:25.105609 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:25.105609 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:25.105609 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:25.105609 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:25.105609 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:25.105609 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:25.105609 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:25.105609 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:25.105609 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:51:25.105609 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:51:25.105609 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:51:25.106485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:51:25.106485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:25.106485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:25.106485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:25.106485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:25.106485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:25.106485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:25.106485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:25.106485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:25.106485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:25.106485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:25.106485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:25.106485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:25.106485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:25.106485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:25.106485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:25.106485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:25.107389 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:51:25.107389 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:51:25.107389 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:51:25.107389 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:51:25.107389 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:51:25.107389 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:51:25.107389 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:51:25.107389 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:51:25.107389 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 401/807] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 26 10:51:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:25.112486 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b12738a-45a4-4b20-a04d-0692fa7e425a None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:25.195385 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:25.198758 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:25.217186 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380e048-9417-44f7-9e61-363e8cf68230 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:25.217541 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b12738a-45a4-4b20-a04d-0692fa7e425a None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:25.251274 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419a4a6-a53b-4f0c-8343-6b68c5024d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:25.252316 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419a4a6-a53b-4f0c-8343-6b68c5024d76 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:25.252940 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419a4a6-a53b-4f0c-8343-6b68c5024d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:25.253764 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7623ca8-e9e1-4bcd-ba99-8e946fabe150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:25.253887 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419a4a6-a53b-4f0c-8343-6b68c5024d76 None admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:25.254381 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7623ca8-e9e1-4bcd-ba99-8e946fabe150 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:25.254477 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d419a4a6-a53b-4f0c-8343-6b68c5024d76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:25.254665 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7623ca8-e9e1-4bcd-ba99-8e946fabe150 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:25.254842 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d419a4a6-a53b-4f0c-8343-6b68c5024d76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:25.254942 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7623ca8-e9e1-4bcd-ba99-8e946fabe150 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:25.255570 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7623ca8-e9e1-4bcd-ba99-8e946fabe150 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:25.255876 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7623ca8-e9e1-4bcd-ba99-8e946fabe150 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:25.256247 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d419a4a6-a53b-4f0c-8343-6b68c5024d76 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:25.257820 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7623ca8-e9e1-4bcd-ba99-8e946fabe150 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:25.280088 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 407/808] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:51:25.392438 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 402/809] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 26 10:51:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:51:25.394763 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7623ca8-e9e1-4bcd-ba99-8e946fabe150 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:25.508661 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7623ca8-e9e1-4bcd-ba99-8e946fabe150 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:25.549074 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a1f5f-bb69-4108-9f7d-ddea0cf842dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:25.549743 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a1f5f-bb69-4108-9f7d-ddea0cf842dd None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:25.550025 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a1f5f-bb69-4108-9f7d-ddea0cf842dd None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:25.550300 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a1f5f-bb69-4108-9f7d-ddea0cf842dd None admin] PATH_INFO: `/v3/projects/e8f0f02a607a49e0b88c75019795b726/users/a852a777cb6a4863bebdb949cc71ea65/roles/bb4187021aea4d30a339f0c0e79a6601` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:25.552539 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a1f5f-bb69-4108-9f7d-ddea0cf842dd None admin] RBAC: Authorizing `identity:create_grant(project_id=e8f0f02a607a49e0b88c75019795b726, user_id=a852a777cb6a4863bebdb949cc71ea65, role_id=bb4187021aea4d30a339f0c0e79a6601)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:25.554018 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a1f5f-bb69-4108-9f7d-ddea0cf842dd None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:25.606323 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:25.611383 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 408/810] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 26 10:51:25 2022] PUT /identity/v3/projects/e8f0f02a607a49e0b88c75019795b726/users/a852a777cb6a4863bebdb949cc71ea65/roles/bb4187021aea4d30a339f0c0e79a6601 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:51:25.689964 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769084b5-6154-4128-8af6-d7ca7cf4a0e4 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:25.690253 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769084b5-6154-4128-8af6-d7ca7cf4a0e4 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:25.690528 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769084b5-6154-4128-8af6-d7ca7cf4a0e4 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:25.691904 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 403/811] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:25.698223 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c047fff-ee36-42de-bf68-fd90e1525337 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:25.698508 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c047fff-ee36-42de-bf68-fd90e1525337 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:25.698788 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c047fff-ee36-42de-bf68-fd90e1525337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:25.718266 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-9c047fff-ee36-42de-bf68-fd90e1525337 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:25.719505 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9c047fff-ee36-42de-bf68-fd90e1525337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:25.794502 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 409/812] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:51:26.069958 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769084b5-6154-4128-8af6-d7ca7cf4a0e4 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:26.168714 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769084b5-6154-4128-8af6-d7ca7cf4a0e4 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:26.201931 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b71a6c-a9c6-4c75-bf9b-21e3c970cef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:26.202547 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b71a6c-a9c6-4c75-bf9b-21e3c970cef3 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:26.202822 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b71a6c-a9c6-4c75-bf9b-21e3c970cef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:26.203089 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b71a6c-a9c6-4c75-bf9b-21e3c970cef3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:26.210260 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:26.213150 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b71a6c-a9c6-4c75-bf9b-21e3c970cef3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:51:26.218137 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-23b71a6c-a9c6-4c75-bf9b-21e3c970cef3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:51:26.218137 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:26.218137 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:26.218137 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:26.218137 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:26.218137 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:26.218137 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:26.218137 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:26.218137 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:26.218137 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:26.218137 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:26.218137 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:26.218137 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:51:26.218137 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:51:26.218137 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:51:26.218137 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:51:26.226335 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:51:26.226335 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:51:26.226335 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:51:26.226335 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:51:26.226335 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:26.226335 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:26.226335 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:26.226335 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:26.226335 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:26.226335 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:26.226335 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:26.226335 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:26.226335 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:26.226335 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:26.226335 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:26.226335 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:26.227325 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:26.227325 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:26.227325 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:26.227325 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:26.227325 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:51:26.227325 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:51:26.227325 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:51:26.227325 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:51:26.227325 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:51:26.227325 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:51:26.227325 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:51:26.227325 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:51:26.227325 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 404/813] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 26 10:51:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:26.228038 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c047fff-ee36-42de-bf68-fd90e1525337 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:26.323796 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c047fff-ee36-42de-bf68-fd90e1525337 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:26.352432 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:26.360359 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba408ea2-553f-42c4-89e0-6b38d6e11b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:26.360978 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba408ea2-553f-42c4-89e0-6b38d6e11b25 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:26.367940 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba408ea2-553f-42c4-89e0-6b38d6e11b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:26.367940 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba408ea2-553f-42c4-89e0-6b38d6e11b25 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:26.367940 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba408ea2-553f-42c4-89e0-6b38d6e11b25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:26.367940 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba408ea2-553f-42c4-89e0-6b38d6e11b25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:26.367940 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba408ea2-553f-42c4-89e0-6b38d6e11b25 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:26.371741 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 410/814] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 26 10:51:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:26.377606 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b71a6c-a9c6-4c75-bf9b-21e3c970cef3 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:26.475415 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b71a6c-a9c6-4c75-bf9b-21e3c970cef3 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:26.510795 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48c39c-b544-49e2-8cc0-7eef5abf9d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:26.511433 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48c39c-b544-49e2-8cc0-7eef5abf9d1a None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:26.511715 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48c39c-b544-49e2-8cc0-7eef5abf9d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:26.511990 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48c39c-b544-49e2-8cc0-7eef5abf9d1a None admin] PATH_INFO: `/v3/users/59841b42bcba415d8efe9a89805147f2` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:26.525762 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48c39c-b544-49e2-8cc0-7eef5abf9d1a None admin] RBAC: Authorizing `identity:get_user(user_id=59841b42bcba415d8efe9a89805147f2)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:26.527196 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48c39c-b544-49e2-8cc0-7eef5abf9d1a None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:26.528828 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 405/815] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 26 10:51:26 2022] GET /identity/v3/users/59841b42bcba415d8efe9a89805147f2 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:51:26.534748 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba408ea2-553f-42c4-89e0-6b38d6e11b25 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:26.631452 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba408ea2-553f-42c4-89e0-6b38d6e11b25 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:26.664399 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1021bc0d-3a10-4bd9-b939-c494ed06eb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:26.665024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021bc0d-3a10-4bd9-b939-c494ed06eb81 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:26.665306 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021bc0d-3a10-4bd9-b939-c494ed06eb81 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:26.665581 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021bc0d-3a10-4bd9-b939-c494ed06eb81 None admin] PATH_INFO: `/v3/projects/4437de10dd66456eafd94404dbcde8b4` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:26.666688 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1021bc0d-3a10-4bd9-b939-c494ed06eb81 None admin] RBAC: Authorizing `identity:get_project(project_id=4437de10dd66456eafd94404dbcde8b4)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:26.668152 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1021bc0d-3a10-4bd9-b939-c494ed06eb81 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:26.669761 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 411/816] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 26 10:51:26 2022] GET /identity/v3/projects/4437de10dd66456eafd94404dbcde8b4 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:26.676028 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48c39c-b544-49e2-8cc0-7eef5abf9d1a None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:26.732826 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:26.773432 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48c39c-b544-49e2-8cc0-7eef5abf9d1a None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:26.807996 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fb2ac-ca60-46e3-8c54-0048a4d601b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:26.808746 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fb2ac-ca60-46e3-8c54-0048a4d601b2 None admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:26.809029 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fb2ac-ca60-46e3-8c54-0048a4d601b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:26.809306 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fb2ac-ca60-46e3-8c54-0048a4d601b2 None admin] PATH_INFO: `/v3/projects/4437de10dd66456eafd94404dbcde8b4/users/59841b42bcba415d8efe9a89805147f2/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:26.811205 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2fb2ac-ca60-46e3-8c54-0048a4d601b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=4437de10dd66456eafd94404dbcde8b4, user_id=59841b42bcba415d8efe9a89805147f2, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:26.812650 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2fb2ac-ca60-46e3-8c54-0048a4d601b2 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:26.901910 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 406/817] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 26 10:51:26 2022] PUT /identity/v3/projects/4437de10dd66456eafd94404dbcde8b4/users/59841b42bcba415d8efe9a89805147f2/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:51:27.744095 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251073af-c787-4515-8798-4394ff2aaa20 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:27.744631 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251073af-c787-4515-8798-4394ff2aaa20 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:27.744631 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251073af-c787-4515-8798-4394ff2aaa20 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:27.745953 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 412/818] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:27.751900 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e637c-19bf-4677-acb8-18f2992cfae4 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:27.752489 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e637c-19bf-4677-acb8-18f2992cfae4 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:27.752579 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e637c-19bf-4677-acb8-18f2992cfae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:27.776423 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-853e637c-19bf-4677-acb8-18f2992cfae4 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:27.777988 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-853e637c-19bf-4677-acb8-18f2992cfae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:27.841863 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 407/819] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:51:28.113783 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251073af-c787-4515-8798-4394ff2aaa20 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:28.172752 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:28.214597 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251073af-c787-4515-8798-4394ff2aaa20 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:28.247256 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d3f99-c7b9-4edf-a060-4ea9a36c869d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:28.247884 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d3f99-c7b9-4edf-a060-4ea9a36c869d None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:28.248192 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d3f99-c7b9-4edf-a060-4ea9a36c869d None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:28.248468 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d3f99-c7b9-4edf-a060-4ea9a36c869d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:28.258641 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7d3f99-c7b9-4edf-a060-4ea9a36c869d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:51:28.263445 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-de7d3f99-c7b9-4edf-a060-4ea9a36c869d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 26 10:51:28.263445 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:28.263445 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:28.263445 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:28.263445 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:28.263445 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:28.263445 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:28.263445 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:28.263445 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:28.263445 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:28.263445 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:28.263445 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:28.263445 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:51:28.263445 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:51:28.263445 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:51:28.263445 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:51:28.264482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:51:28.264482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:51:28.264482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:51:28.264482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:51:28.264482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:28.264482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:28.264482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:28.264482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:28.264482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:28.264482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:28.264482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:28.264482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:28.264482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:28.264482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:28.264482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:28.264482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:28.266005 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:28.266005 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:28.266005 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:28.266005 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:28.266005 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:51:28.266005 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:51:28.266005 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:51:28.266005 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:51:28.266005 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:51:28.266005 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:51:28.266005 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 26 10:51:28.266005 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:28.266005 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 413/820] 10.222.0.45 () {56 vars in 1120 bytes} [Wed Oct 26 10:51:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:28.270465 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e637c-19bf-4677-acb8-18f2992cfae4 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:28.317105 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:28.370308 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e637c-19bf-4677-acb8-18f2992cfae4 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:28.404013 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67213fa9-663c-4beb-ac7d-752e4377a6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:28.404650 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67213fa9-663c-4beb-ac7d-752e4377a6ff None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:28.404928 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67213fa9-663c-4beb-ac7d-752e4377a6ff None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:28.405200 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67213fa9-663c-4beb-ac7d-752e4377a6ff None admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:28.405861 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67213fa9-663c-4beb-ac7d-752e4377a6ff None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:28.406162 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67213fa9-663c-4beb-ac7d-752e4377a6ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:28.407517 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67213fa9-663c-4beb-ac7d-752e4377a6ff None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:28.415410 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 408/821] 10.222.0.45 () {56 vars in 1115 bytes} [Wed Oct 26 10:51:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:28.421585 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d3f99-c7b9-4edf-a060-4ea9a36c869d None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:28.518606 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d3f99-c7b9-4edf-a060-4ea9a36c869d None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:28.535155 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:28.552261 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d184a26-dcec-491d-8fdd-071110003cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:28.552894 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d184a26-dcec-491d-8fdd-071110003cb0 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:28.553173 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d184a26-dcec-491d-8fdd-071110003cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:28.553959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d184a26-dcec-491d-8fdd-071110003cb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:28.565775 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d184a26-dcec-491d-8fdd-071110003cb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:28.567250 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d184a26-dcec-491d-8fdd-071110003cb0 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:28.581480 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-8d184a26-dcec-491d-8fdd-071110003cb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:51:28.581480 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:28.581480 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:28.581480 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:28.581480 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:28.581480 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:28.581480 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:28.581480 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:28.581480 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:28.581480 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:28.581480 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:28.581480 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:28.581480 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:51:28.581480 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:51:28.581480 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:51:28.581480 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:51:28.587303 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:28.587303 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:28.587303 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:28.587303 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:28.587303 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:28.587303 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:28.587303 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:28.587303 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:28.587303 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:28.587303 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:28.587303 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:28.587303 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:28.587303 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:28.587303 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:28.587303 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:28.587303 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:28.587303 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:51:28.588327 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:51:28.588327 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:51:28.588327 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:28.588327 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 414/822] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:51:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:51:28.588570 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67213fa9-663c-4beb-ac7d-752e4377a6ff None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:28.684748 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67213fa9-663c-4beb-ac7d-752e4377a6ff None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:28.695160 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:28.717226 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e23aa-8933-4ec4-8b65-af56e58658cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:28.717825 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e23aa-8933-4ec4-8b65-af56e58658cf None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:28.718103 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e23aa-8933-4ec4-8b65-af56e58658cf None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:28.718372 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e23aa-8933-4ec4-8b65-af56e58658cf None admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:28.718994 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75e23aa-8933-4ec4-8b65-af56e58658cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:28.719336 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75e23aa-8933-4ec4-8b65-af56e58658cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:28.720783 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75e23aa-8933-4ec4-8b65-af56e58658cf None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:28.732846 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 409/823] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:28.738498 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d184a26-dcec-491d-8fdd-071110003cb0 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:28.836560 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d184a26-dcec-491d-8fdd-071110003cb0 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:28.869948 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6029b-541e-4931-8376-577d20dab9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:28.870569 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6029b-541e-4931-8376-577d20dab9c6 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:28.870847 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6029b-541e-4931-8376-577d20dab9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:28.871116 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6029b-541e-4931-8376-577d20dab9c6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:28.878271 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b6029b-541e-4931-8376-577d20dab9c6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:28.879693 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b6029b-541e-4931-8376-577d20dab9c6 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:28.890491 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-a0b6029b-541e-4931-8376-577d20dab9c6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 26 10:51:28.890491 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:28.890491 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:28.890491 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:28.890491 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:28.890491 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:28.890491 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:28.890491 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:28.890491 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:28.890491 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:28.890491 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:28.890491 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:28.890491 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:51:28.890491 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:51:28.890491 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:51:28.890491 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:51:28.891430 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:28.891430 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:28.891430 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:51:28.891430 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:51:28.891430 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:51:28.891430 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:51:28.891430 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:28.891430 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:28.891430 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:28.891430 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:28.891430 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:28.891430 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:28.891430 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:28.891430 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:28.891430 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:28.891430 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:28.891430 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:28.891430 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:28.892441 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:28.892441 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:28.892441 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:51:28.892441 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:51:28.892441 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:51:28.892441 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:51:28.892441 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:51:28.892441 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:51:28.892441 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 26 10:51:28.892441 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:28.892441 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 415/824] 10.222.0.45 () {56 vars in 1093 bytes} [Wed Oct 26 10:51:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:51:28.897547 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e23aa-8933-4ec4-8b65-af56e58658cf None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:29.000761 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e23aa-8933-4ec4-8b65-af56e58658cf None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:29.020792 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6ab28-3cf0-4988-9023-ca184ed01bef None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:29.021085 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6ab28-3cf0-4988-9023-ca184ed01bef None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:29.021365 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6ab28-3cf0-4988-9023-ca184ed01bef None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:29.022726 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 416/825] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:29.027501 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb503b5-a8ec-4a0f-a207-973fcd115a0b None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:29.027789 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb503b5-a8ec-4a0f-a207-973fcd115a0b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:29.028083 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb503b5-a8ec-4a0f-a207-973fcd115a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:29.033018 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39960b29-a914-4e77-9691-46a7dcbdb79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:29.033618 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39960b29-a914-4e77-9691-46a7dcbdb79e None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:29.033896 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39960b29-a914-4e77-9691-46a7dcbdb79e None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:29.034168 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39960b29-a914-4e77-9691-46a7dcbdb79e None admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:29.034957 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39960b29-a914-4e77-9691-46a7dcbdb79e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:29.035263 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39960b29-a914-4e77-9691-46a7dcbdb79e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:29.036704 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39960b29-a914-4e77-9691-46a7dcbdb79e None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:29.046599 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-1fb503b5-a8ec-4a0f-a207-973fcd115a0b None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:29.047785 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1fb503b5-a8ec-4a0f-a207-973fcd115a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:29.054927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 410/826] 10.222.0.45 () {56 vars in 1133 bytes} [Wed Oct 26 10:51:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:29.060582 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39960b29-a914-4e77-9691-46a7dcbdb79e None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:29.076268 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:29.088049 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:29.118976 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 417/827] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 26 10:51:29.157446 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39960b29-a914-4e77-9691-46a7dcbdb79e None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:29.190046 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16107480-5414-49e4-802d-5e5ffd1f793c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:29.190644 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16107480-5414-49e4-802d-5e5ffd1f793c None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:29.190923 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16107480-5414-49e4-802d-5e5ffd1f793c None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:29.191192 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16107480-5414-49e4-802d-5e5ffd1f793c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:29.256170 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16107480-5414-49e4-802d-5e5ffd1f793c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:29.257574 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16107480-5414-49e4-802d-5e5ffd1f793c None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:29.283493 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:29.353134 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 411/828] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 26 10:51:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 26 10:51:29.358829 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb503b5-a8ec-4a0f-a207-973fcd115a0b None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:29.388539 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16107480-5414-49e4-802d-5e5ffd1f793c None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:29.456669 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb503b5-a8ec-4a0f-a207-973fcd115a0b None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:29.485259 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16107480-5414-49e4-802d-5e5ffd1f793c None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:29.489419 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623c2be-d276-45a7-985f-0aa8e0905f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:29.490051 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623c2be-d276-45a7-985f-0aa8e0905f0d None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:29.490332 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623c2be-d276-45a7-985f-0aa8e0905f0d None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:29.490602 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623c2be-d276-45a7-985f-0aa8e0905f0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:29.500902 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3623c2be-d276-45a7-985f-0aa8e0905f0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:29.502338 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3623c2be-d276-45a7-985f-0aa8e0905f0d None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:29.511664 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:29.516875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-3623c2be-d276-45a7-985f-0aa8e0905f0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:51:29.516875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:29.516875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:29.516875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:29.516875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:29.516875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:29.516875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:29.516875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:29.516875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:29.516875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:29.516875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:29.516875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:29.516875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:51:29.516875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:51:29.516875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:51:29.516875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:51:29.523239 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:29.523239 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:29.523239 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:29.523239 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:29.523239 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:29.523239 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:29.523239 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:29.523239 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:29.523239 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:29.523239 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:29.523239 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:29.523239 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:29.523239 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:29.523239 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:29.523239 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:29.523239 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:29.523239 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:51:29.524154 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:51:29.524154 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:51:29.524154 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:29.524154 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 418/829] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:51:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:29.524402 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d4a45-4035-4928-b386-b700190f1178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:29.524402 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d4a45-4035-4928-b386-b700190f1178 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:29.524402 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d4a45-4035-4928-b386-b700190f1178 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:29.524402 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d4a45-4035-4928-b386-b700190f1178 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:29.524683 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623c2be-d276-45a7-985f-0aa8e0905f0d None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:29.530860 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d4a45-4035-4928-b386-b700190f1178 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:51:29.535692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-892d4a45-4035-4928-b386-b700190f1178 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:51:29.535692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:29.535692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:29.535692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:29.535692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:29.535692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:29.535692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:29.535692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:29.535692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:29.535692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:29.535692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:29.535692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:29.535692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:51:29.535692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:51:29.535692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:51:29.535692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:51:29.536740 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:51:29.536740 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:51:29.536740 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:51:29.536740 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:51:29.536740 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:29.536740 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:29.536740 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:29.536740 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:29.536740 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:29.536740 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:29.536740 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:29.536740 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:29.536740 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:29.536740 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:29.536740 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:29.536740 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:29.538483 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:29.538483 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:29.538483 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:29.538483 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:29.538483 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:51:29.538483 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:51:29.538483 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:51:29.538483 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:51:29.538483 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:51:29.538483 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:51:29.538483 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:51:29.538483 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:51:29.538483 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 412/830] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 26 10:51:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:51:29.539699 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:29.543134 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d4a45-4035-4928-b386-b700190f1178 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:29.624866 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623c2be-d276-45a7-985f-0aa8e0905f0d None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:29.640570 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d4a45-4035-4928-b386-b700190f1178 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:29.657940 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708beea6-51a1-490a-881f-47e74c4a3694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:29.658542 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708beea6-51a1-490a-881f-47e74c4a3694 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:29.658821 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708beea6-51a1-490a-881f-47e74c4a3694 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:29.659095 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708beea6-51a1-490a-881f-47e74c4a3694 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:29.659724 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708beea6-51a1-490a-881f-47e74c4a3694 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:29.660024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708beea6-51a1-490a-881f-47e74c4a3694 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:29.661419 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708beea6-51a1-490a-881f-47e74c4a3694 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:29.673134 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 419/831] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:29.675532 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9315f-480a-44d5-8a00-fadd4ce4ff2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:29.676165 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9315f-480a-44d5-8a00-fadd4ce4ff2e None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:29.676447 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9315f-480a-44d5-8a00-fadd4ce4ff2e None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:29.676721 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9315f-480a-44d5-8a00-fadd4ce4ff2e None admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:29.677377 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9315f-480a-44d5-8a00-fadd4ce4ff2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:29.677681 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9315f-480a-44d5-8a00-fadd4ce4ff2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:29.679276 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708beea6-51a1-490a-881f-47e74c4a3694 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:29.679589 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9315f-480a-44d5-8a00-fadd4ce4ff2e None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:29.689696 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 413/832] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 26 10:51:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:51:29.693734 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9315f-480a-44d5-8a00-fadd4ce4ff2e None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:29.742576 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:29.748684 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:29.778506 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708beea6-51a1-490a-881f-47e74c4a3694 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:29.796725 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9315f-480a-44d5-8a00-fadd4ce4ff2e None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:29.812032 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510dddc3-9dda-460d-b457-60369321ddc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:29.812826 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510dddc3-9dda-460d-b457-60369321ddc6 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:29.813069 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510dddc3-9dda-460d-b457-60369321ddc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:29.813342 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510dddc3-9dda-460d-b457-60369321ddc6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:29.819826 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510dddc3-9dda-460d-b457-60369321ddc6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:29.821309 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510dddc3-9dda-460d-b457-60369321ddc6 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:29.829459 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b1e86-f1bf-4878-b800-b37eb3243875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:29.830078 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b1e86-f1bf-4878-b800-b37eb3243875 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:29.830355 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b1e86-f1bf-4878-b800-b37eb3243875 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:29.830626 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b1e86-f1bf-4878-b800-b37eb3243875 None admin] PATH_INFO: `/v3/users/59841b42bcba415d8efe9a89805147f2` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:29.831759 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0b1e86-f1bf-4878-b800-b37eb3243875 None admin] RBAC: Authorizing `identity:get_user(user_id=59841b42bcba415d8efe9a89805147f2)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:29.832383 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-510dddc3-9dda-460d-b457-60369321ddc6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:51:29.832383 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:29.832383 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:29.832383 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:29.832383 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:29.832383 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:29.832383 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:29.832383 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:29.832383 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:29.832383 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:29.832383 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:29.832383 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:29.832383 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:51:29.832383 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:51:29.832383 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:51:29.833410 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:51:29.833410 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:29.833410 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:29.833410 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:29.833410 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:29.833410 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:29.833410 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:29.833410 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:29.833410 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:29.833410 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:29.833410 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:29.833410 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:29.833410 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:29.833410 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:29.833410 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:29.833410 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:29.833410 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:29.834458 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:51:29.834458 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:51:29.834458 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:51:29.834458 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:51:29.834458 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:51:29.834458 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:51:29.834458 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:51:29.834458 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:29.835411 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0b1e86-f1bf-4878-b800-b37eb3243875 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:29.835411 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 414/833] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 26 10:51:29 2022] GET /identity/v3/users/59841b42bcba415d8efe9a89805147f2 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:51:29.838811 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 420/834] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 26 10:51:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:29.839985 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b1e86-f1bf-4878-b800-b37eb3243875 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:29.840821 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510dddc3-9dda-460d-b457-60369321ddc6 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:29.943971 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510dddc3-9dda-460d-b457-60369321ddc6 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:29.944913 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b1e86-f1bf-4878-b800-b37eb3243875 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:29.962044 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:29.973456 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:29.978903 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e08bda-519c-4064-8a0e-6a6a0d884be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:29.983160 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694180c3-33e7-4ddf-895f-c058f32b18cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:29.983282 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e08bda-519c-4064-8a0e-6a6a0d884be8 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:29.983282 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e08bda-519c-4064-8a0e-6a6a0d884be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:29.983420 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694180c3-33e7-4ddf-895f-c058f32b18cf None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:29.983502 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e08bda-519c-4064-8a0e-6a6a0d884be8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:29.983584 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694180c3-33e7-4ddf-895f-c058f32b18cf None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:29.983584 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694180c3-33e7-4ddf-895f-c058f32b18cf None admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:29.983584 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694180c3-33e7-4ddf-895f-c058f32b18cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:29.983584 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694180c3-33e7-4ddf-895f-c058f32b18cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:29.983584 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694180c3-33e7-4ddf-895f-c058f32b18cf None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:29.995135 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 415/835] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 26 10:51:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:51:30.000919 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694180c3-33e7-4ddf-895f-c058f32b18cf None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:30.047612 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e08bda-519c-4064-8a0e-6a6a0d884be8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:30.049158 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e08bda-519c-4064-8a0e-6a6a0d884be8 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:30.099142 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694180c3-33e7-4ddf-895f-c058f32b18cf None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:30.133208 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d071ed-b670-409b-86d4-6753b9039299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:30.133809 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d071ed-b670-409b-86d4-6753b9039299 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:30.134087 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d071ed-b670-409b-86d4-6753b9039299 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:30.134357 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d071ed-b670-409b-86d4-6753b9039299 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:30.135071 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d071ed-b670-409b-86d4-6753b9039299 None admin] RBAC: Adding query filter params (role.id=bb4187021aea4d30a339f0c0e79a6601, scope.project.id=e8f0f02a607a49e0b88c75019795b726, user.id=a852a777cb6a4863bebdb949cc71ea65) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:30.135376 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d071ed-b670-409b-86d4-6753b9039299 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:30.136817 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d071ed-b670-409b-86d4-6753b9039299 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:30.142423 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 416/836] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 26 10:51:30 2022] GET /identity/v3/role_assignments?user.id=a852a777cb6a4863bebdb949cc71ea65&scope.project.id=e8f0f02a607a49e0b88c75019795b726&role.id=bb4187021aea4d30a339f0c0e79a6601 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:51:30.146881 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 421/837] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 26 10:51:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 26 10:51:30.152470 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d071ed-b670-409b-86d4-6753b9039299 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:30.199305 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:30.257903 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d071ed-b670-409b-86d4-6753b9039299 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:30.293098 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54504272-565d-4284-aaa7-a1868c840397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:30.293740 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54504272-565d-4284-aaa7-a1868c840397 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:30.294020 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54504272-565d-4284-aaa7-a1868c840397 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:30.294293 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54504272-565d-4284-aaa7-a1868c840397 None admin] PATH_INFO: `/v3/projects/4437de10dd66456eafd94404dbcde8b4` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:30.295700 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54504272-565d-4284-aaa7-a1868c840397 None admin] RBAC: Authorizing `identity:get_project(project_id=4437de10dd66456eafd94404dbcde8b4)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:30.297173 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54504272-565d-4284-aaa7-a1868c840397 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:30.298888 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 417/838] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 26 10:51:30 2022] GET /identity/v3/projects/4437de10dd66456eafd94404dbcde8b4 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:30.305059 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e08bda-519c-4064-8a0e-6a6a0d884be8 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:30.340100 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:30.412390 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e08bda-519c-4064-8a0e-6a6a0d884be8 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:30.451057 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a658c2-6c7f-49d9-a2be-39f2cf2dec7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:30.451667 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a658c2-6c7f-49d9-a2be-39f2cf2dec7f None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:30.451949 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a658c2-6c7f-49d9-a2be-39f2cf2dec7f None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:30.452251 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a658c2-6c7f-49d9-a2be-39f2cf2dec7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:30.452975 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a658c2-6c7f-49d9-a2be-39f2cf2dec7f None admin] RBAC: Adding query filter params (role.id=d6876897d7c548b7900d4e01cb45a007, scope.project.id=4437de10dd66456eafd94404dbcde8b4, user.id=59841b42bcba415d8efe9a89805147f2) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:30.453282 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a658c2-6c7f-49d9-a2be-39f2cf2dec7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:30.454701 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a658c2-6c7f-49d9-a2be-39f2cf2dec7f None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:30.461070 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 422/839] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 26 10:51:30 2022] GET /identity/v3/role_assignments?user.id=59841b42bcba415d8efe9a89805147f2&scope.project.id=4437de10dd66456eafd94404dbcde8b4&role.id=d6876897d7c548b7900d4e01cb45a007 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:32.616313 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7907062-b0d9-4a67-bae6-64bd1c5e14a4 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:32.616807 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7907062-b0d9-4a67-bae6-64bd1c5e14a4 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:32.616807 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7907062-b0d9-4a67-bae6-64bd1c5e14a4 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:32.618107 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 418/840] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:32.623348 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92948b96-7c97-4666-aeee-efcc8b370e77 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:32.623747 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92948b96-7c97-4666-aeee-efcc8b370e77 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:32.623885 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92948b96-7c97-4666-aeee-efcc8b370e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:32.642199 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-92948b96-7c97-4666-aeee-efcc8b370e77 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:32.643375 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-92948b96-7c97-4666-aeee-efcc8b370e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:32.707210 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 423/841] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 26 10:51:32.977217 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7907062-b0d9-4a67-bae6-64bd1c5e14a4 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:33.075800 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7907062-b0d9-4a67-bae6-64bd1c5e14a4 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:33.086568 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:33.109204 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a115c54-d3f1-46e7-933a-8ef22d786261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:33.109829 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a115c54-d3f1-46e7-933a-8ef22d786261 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:33.110109 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a115c54-d3f1-46e7-933a-8ef22d786261 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:33.110384 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a115c54-d3f1-46e7-933a-8ef22d786261 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:33.111493 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a115c54-d3f1-46e7-933a-8ef22d786261 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:33.112941 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a115c54-d3f1-46e7-933a-8ef22d786261 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:33.114474 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 419/842] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:51:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:51:33.120102 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92948b96-7c97-4666-aeee-efcc8b370e77 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:33.145470 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:33.215634 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92948b96-7c97-4666-aeee-efcc8b370e77 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:33.247307 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158d4ad-466f-4256-8af3-c4856960022c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:33.247850 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158d4ad-466f-4256-8af3-c4856960022c None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:33.248155 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158d4ad-466f-4256-8af3-c4856960022c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:33.248430 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158d4ad-466f-4256-8af3-c4856960022c None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:33.249065 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1158d4ad-466f-4256-8af3-c4856960022c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:33.250470 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1158d4ad-466f-4256-8af3-c4856960022c None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:33.357069 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 424/843] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Oct 26 10:51:33 2022] POST /identity/v3/users => generated 286 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:51:35.498516 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157a431-aff4-4816-bfc8-e2a645430b2c None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:35.499039 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157a431-aff4-4816-bfc8-e2a645430b2c None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:35.499039 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157a431-aff4-4816-bfc8-e2a645430b2c None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:35.500431 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 420/844] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:35.505739 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4bcc9-04e2-447c-bb11-a99e1ebd0b36 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:35.506674 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4bcc9-04e2-447c-bb11-a99e1ebd0b36 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:35.506884 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4bcc9-04e2-447c-bb11-a99e1ebd0b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:35.525257 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-45e4bcc9-04e2-447c-bb11-a99e1ebd0b36 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:35.526446 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-45e4bcc9-04e2-447c-bb11-a99e1ebd0b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:35.591209 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 425/845] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:51:35.865098 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157a431-aff4-4816-bfc8-e2a645430b2c None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:35.964343 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157a431-aff4-4816-bfc8-e2a645430b2c None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:36.057449 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8a3f6-0d7e-4566-917d-03b7120703f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:36.058077 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8a3f6-0d7e-4566-917d-03b7120703f1 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:36.058361 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8a3f6-0d7e-4566-917d-03b7120703f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:36.058638 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8a3f6-0d7e-4566-917d-03b7120703f1 None admin] PATH_INFO: `/v3/roles/a29ce5d75abc411488ef339c191e6d05` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:36.060014 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c8a3f6-0d7e-4566-917d-03b7120703f1 None admin] RBAC: Authorizing `identity:get_role(role_id=a29ce5d75abc411488ef339c191e6d05)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:36.061429 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c8a3f6-0d7e-4566-917d-03b7120703f1 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:36.062741 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 421/846] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 26 10:51:35 2022] GET /identity/v3/roles/a29ce5d75abc411488ef339c191e6d05 => generated 223 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:36.068589 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4bcc9-04e2-447c-bb11-a99e1ebd0b36 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:36.082469 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:36.166047 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4bcc9-04e2-447c-bb11-a99e1ebd0b36 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:36.200413 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfc864-45ea-4e28-b7ec-97f9d3b52ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:36.201043 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfc864-45ea-4e28-b7ec-97f9d3b52ac4 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:36.201322 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfc864-45ea-4e28-b7ec-97f9d3b52ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:36.201597 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfc864-45ea-4e28-b7ec-97f9d3b52ac4 None admin] PATH_INFO: `/v3/users/48da0480da4d48639e12fee9408afe76` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:36.214789 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbfc864-45ea-4e28-b7ec-97f9d3b52ac4 None admin] RBAC: Authorizing `identity:get_user(user_id=48da0480da4d48639e12fee9408afe76)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:36.216251 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbfc864-45ea-4e28-b7ec-97f9d3b52ac4 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:36.218040 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 426/847] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 26 10:51:36 2022] GET /identity/v3/users/48da0480da4d48639e12fee9408afe76 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:36.223483 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8a3f6-0d7e-4566-917d-03b7120703f1 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:36.268829 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:36.320072 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8a3f6-0d7e-4566-917d-03b7120703f1 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:36.353367 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a6130-2a88-481d-a90c-e48792b3a549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:36.353993 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a6130-2a88-481d-a90c-e48792b3a549 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:36.354270 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a6130-2a88-481d-a90c-e48792b3a549 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:36.354540 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a6130-2a88-481d-a90c-e48792b3a549 None admin] PATH_INFO: `/v3/projects/4437de10dd66456eafd94404dbcde8b4` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:36.355622 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a6130-2a88-481d-a90c-e48792b3a549 None admin] RBAC: Authorizing `identity:get_project(project_id=4437de10dd66456eafd94404dbcde8b4)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:36.357060 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a6130-2a88-481d-a90c-e48792b3a549 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:36.358658 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 422/848] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 26 10:51:36 2022] GET /identity/v3/projects/4437de10dd66456eafd94404dbcde8b4 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:36.364823 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfc864-45ea-4e28-b7ec-97f9d3b52ac4 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:36.433350 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:36.463576 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfc864-45ea-4e28-b7ec-97f9d3b52ac4 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:36.495689 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a25316-54b6-45ad-9274-65cabe6cb80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:36.496364 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a25316-54b6-45ad-9274-65cabe6cb80b None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:36.496645 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a25316-54b6-45ad-9274-65cabe6cb80b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:36.496917 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a25316-54b6-45ad-9274-65cabe6cb80b None admin] PATH_INFO: `/v3/projects/4437de10dd66456eafd94404dbcde8b4/users/48da0480da4d48639e12fee9408afe76/roles/a29ce5d75abc411488ef339c191e6d05` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:36.498991 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a25316-54b6-45ad-9274-65cabe6cb80b None admin] RBAC: Authorizing `identity:create_grant(project_id=4437de10dd66456eafd94404dbcde8b4, user_id=48da0480da4d48639e12fee9408afe76, role_id=a29ce5d75abc411488ef339c191e6d05)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:36.500420 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a25316-54b6-45ad-9274-65cabe6cb80b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:36.590150 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 427/849] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 26 10:51:36 2022] PUT /identity/v3/projects/4437de10dd66456eafd94404dbcde8b4/users/48da0480da4d48639e12fee9408afe76/roles/a29ce5d75abc411488ef339c191e6d05 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:51:38.710890 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068ba3e-8a71-42f7-bf89-c4eb40f1abb5 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:38.711389 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068ba3e-8a71-42f7-bf89-c4eb40f1abb5 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:38.711389 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068ba3e-8a71-42f7-bf89-c4eb40f1abb5 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:38.712732 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 423/850] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:38.717990 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b988d-4acf-41e6-9be8-9bf2a6ba6a51 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:38.718375 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b988d-4acf-41e6-9be8-9bf2a6ba6a51 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:38.718552 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b988d-4acf-41e6-9be8-9bf2a6ba6a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:38.736959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-3f0b988d-4acf-41e6-9be8-9bf2a6ba6a51 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:38.738154 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3f0b988d-4acf-41e6-9be8-9bf2a6ba6a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:38.802676 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 428/851] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:51:39.071133 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068ba3e-8a71-42f7-bf89-c4eb40f1abb5 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:39.169081 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068ba3e-8a71-42f7-bf89-c4eb40f1abb5 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:39.183136 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:39.202312 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b0bb37-6257-4ea5-9575-b11695870dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:39.202931 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0bb37-6257-4ea5-9575-b11695870dc2 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:39.203210 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0bb37-6257-4ea5-9575-b11695870dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:39.203482 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0bb37-6257-4ea5-9575-b11695870dc2 None admin] PATH_INFO: `/v3/roles/a29ce5d75abc411488ef339c191e6d05` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:39.204876 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b0bb37-6257-4ea5-9575-b11695870dc2 None admin] RBAC: Authorizing `identity:get_role(role_id=a29ce5d75abc411488ef339c191e6d05)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:39.206266 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b0bb37-6257-4ea5-9575-b11695870dc2 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:39.207553 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 424/852] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 26 10:51:39 2022] GET /identity/v3/roles/a29ce5d75abc411488ef339c191e6d05 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:39.213282 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b988d-4acf-41e6-9be8-9bf2a6ba6a51 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:39.269891 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:39.310075 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b988d-4acf-41e6-9be8-9bf2a6ba6a51 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:39.343342 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98bdc9-5917-4df7-bd5b-8722b51e1ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:39.343972 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98bdc9-5917-4df7-bd5b-8722b51e1ae3 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:39.344273 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98bdc9-5917-4df7-bd5b-8722b51e1ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:39.344544 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98bdc9-5917-4df7-bd5b-8722b51e1ae3 None admin] PATH_INFO: `/v3/users/48da0480da4d48639e12fee9408afe76` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:39.345637 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98bdc9-5917-4df7-bd5b-8722b51e1ae3 None admin] RBAC: Authorizing `identity:get_user(user_id=48da0480da4d48639e12fee9408afe76)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:39.347092 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98bdc9-5917-4df7-bd5b-8722b51e1ae3 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:39.348681 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 429/853] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 26 10:51:39 2022] GET /identity/v3/users/48da0480da4d48639e12fee9408afe76 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:39.354952 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b0bb37-6257-4ea5-9575-b11695870dc2 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:39.451276 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b0bb37-6257-4ea5-9575-b11695870dc2 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:39.483553 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a197322-4015-4cd5-98e7-becab55e1e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:39.484167 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a197322-4015-4cd5-98e7-becab55e1e78 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:39.484447 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a197322-4015-4cd5-98e7-becab55e1e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:39.484718 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a197322-4015-4cd5-98e7-becab55e1e78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:39.530255 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:39.548232 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a197322-4015-4cd5-98e7-becab55e1e78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:39.549649 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a197322-4015-4cd5-98e7-becab55e1e78 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:39.643166 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 425/854] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 26 10:51:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 26 10:51:39.649056 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98bdc9-5917-4df7-bd5b-8722b51e1ae3 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:39.744322 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98bdc9-5917-4df7-bd5b-8722b51e1ae3 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:39.769714 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:39.777141 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa1854-5709-4787-989f-ba60871313fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:39.777789 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa1854-5709-4787-989f-ba60871313fc None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:39.778084 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa1854-5709-4787-989f-ba60871313fc None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:39.778338 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa1854-5709-4787-989f-ba60871313fc None admin] PATH_INFO: `/v3/projects/4437de10dd66456eafd94404dbcde8b4` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:39.779424 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa1854-5709-4787-989f-ba60871313fc None admin] RBAC: Authorizing `identity:get_project(project_id=4437de10dd66456eafd94404dbcde8b4)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:39.780864 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa1854-5709-4787-989f-ba60871313fc None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:39.782460 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 430/855] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 26 10:51:39 2022] GET /identity/v3/projects/4437de10dd66456eafd94404dbcde8b4 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:39.788903 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a197322-4015-4cd5-98e7-becab55e1e78 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:39.871110 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:39.889427 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a197322-4015-4cd5-98e7-becab55e1e78 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:39.923379 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2b4f3-5cea-4661-9e8e-1f63c36e5be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:39.923921 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2b4f3-5cea-4661-9e8e-1f63c36e5be1 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:39.924230 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2b4f3-5cea-4661-9e8e-1f63c36e5be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:39.924504 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2b4f3-5cea-4661-9e8e-1f63c36e5be1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:39.925219 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2b4f3-5cea-4661-9e8e-1f63c36e5be1 None admin] RBAC: Adding query filter params (role.id=a29ce5d75abc411488ef339c191e6d05, scope.project.id=4437de10dd66456eafd94404dbcde8b4, user.id=48da0480da4d48639e12fee9408afe76) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:39.925526 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2b4f3-5cea-4661-9e8e-1f63c36e5be1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:39.926948 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2b4f3-5cea-4661-9e8e-1f63c36e5be1 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:39.932495 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 426/856] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 26 10:51:39 2022] GET /identity/v3/role_assignments?user.id=48da0480da4d48639e12fee9408afe76&scope.project.id=4437de10dd66456eafd94404dbcde8b4&role.id=a29ce5d75abc411488ef339c191e6d05 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:51:42.069250 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05228909-b4e7-4343-82d5-fda379443c6a None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:42.069779 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05228909-b4e7-4343-82d5-fda379443c6a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:42.069779 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05228909-b4e7-4343-82d5-fda379443c6a None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:42.071139 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 431/857] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:51:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:42.076512 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65415d-6980-406c-bbb0-ead6e2917112 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:42.076925 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65415d-6980-406c-bbb0-ead6e2917112 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:42.077060 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65415d-6980-406c-bbb0-ead6e2917112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:42.094616 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-5a65415d-6980-406c-bbb0-ead6e2917112 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:42.095787 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-5a65415d-6980-406c-bbb0-ead6e2917112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:42.159188 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 427/858] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:51:42.424308 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05228909-b4e7-4343-82d5-fda379443c6a None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:42.522535 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05228909-b4e7-4343-82d5-fda379443c6a None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:42.555573 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab06f14-da0f-425d-a3dc-3dee95c12ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:42.556219 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab06f14-da0f-425d-a3dc-3dee95c12ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:42.556502 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab06f14-da0f-425d-a3dc-3dee95c12ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:42.556776 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab06f14-da0f-425d-a3dc-3dee95c12ad3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:42.557871 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab06f14-da0f-425d-a3dc-3dee95c12ad3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:42.559297 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab06f14-da0f-425d-a3dc-3dee95c12ad3 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:42.560858 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 432/859] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:51:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:42.566500 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65415d-6980-406c-bbb0-ead6e2917112 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:42.638846 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:42.660611 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65415d-6980-406c-bbb0-ead6e2917112 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:42.694844 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9b5f5-fd06-482e-b7ef-80ff35e23c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:42.695439 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9b5f5-fd06-482e-b7ef-80ff35e23c67 None admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:42.695717 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9b5f5-fd06-482e-b7ef-80ff35e23c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:42.695987 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9b5f5-fd06-482e-b7ef-80ff35e23c67 None admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:42.696655 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d9b5f5-fd06-482e-b7ef-80ff35e23c67 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:42.698078 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d9b5f5-fd06-482e-b7ef-80ff35e23c67 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:42.803644 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 428/860] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Oct 26 10:51:42 2022] POST /identity/v3/projects => generated 311 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:51:44.944540 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad655de-8c13-4cff-b3be-3a0370dca4bc None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:44.945072 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad655de-8c13-4cff-b3be-3a0370dca4bc None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:44.945072 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad655de-8c13-4cff-b3be-3a0370dca4bc None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:44.946437 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 433/861] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:44.951541 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bc49c-fa31-469b-ba34-a5be93479bc8 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:44.951940 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bc49c-fa31-469b-ba34-a5be93479bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:44.952120 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bc49c-fa31-469b-ba34-a5be93479bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:44.970388 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-2f9bc49c-fa31-469b-ba34-a5be93479bc8 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:44.971580 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-2f9bc49c-fa31-469b-ba34-a5be93479bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:45.035321 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 429/862] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:51:45.304797 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad655de-8c13-4cff-b3be-3a0370dca4bc None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:45.366983 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:45.405580 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad655de-8c13-4cff-b3be-3a0370dca4bc None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:45.437519 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a710234-4a78-4927-87ae-a619f4ae4a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:45.438149 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a710234-4a78-4927-87ae-a619f4ae4a94 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:45.438430 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a710234-4a78-4927-87ae-a619f4ae4a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:45.438702 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a710234-4a78-4927-87ae-a619f4ae4a94 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:45.439801 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a710234-4a78-4927-87ae-a619f4ae4a94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:45.441256 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a710234-4a78-4927-87ae-a619f4ae4a94 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:45.442803 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 434/863] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:51:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:45.449136 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9bc49c-fa31-469b-ba34-a5be93479bc8 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:45.503742 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:45.543669 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9bc49c-fa31-469b-ba34-a5be93479bc8 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:45.576779 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb245197-9eca-4cd4-b9db-22968c7486cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:45.577319 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb245197-9eca-4cd4-b9db-22968c7486cb None admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:45.577597 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb245197-9eca-4cd4-b9db-22968c7486cb None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:45.577868 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb245197-9eca-4cd4-b9db-22968c7486cb None admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:45.578523 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb245197-9eca-4cd4-b9db-22968c7486cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:45.579931 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb245197-9eca-4cd4-b9db-22968c7486cb None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:45.666579 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 430/864] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Oct 26 10:51:45 2022] POST /identity/v3/users => generated 286 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 10:51:47.835782 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff286686-10df-43ec-ae84-02398172711a None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:47.836376 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff286686-10df-43ec-ae84-02398172711a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:47.836376 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff286686-10df-43ec-ae84-02398172711a None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:47.837689 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 435/865] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:47.842957 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a4597-096c-4a75-b4ac-cc6612b61cee None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:47.843359 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a4597-096c-4a75-b4ac-cc6612b61cee None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:47.843503 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a4597-096c-4a75-b4ac-cc6612b61cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:47.861863 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-e24a4597-096c-4a75-b4ac-cc6612b61cee None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:47.863033 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-e24a4597-096c-4a75-b4ac-cc6612b61cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:47.927210 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 431/866] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:51:48.199624 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff286686-10df-43ec-ae84-02398172711a None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:48.299658 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff286686-10df-43ec-ae84-02398172711a None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:48.328364 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:48.333052 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a747e8-e5fe-44dc-937c-d54d5e5bce00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:48.334286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a747e8-e5fe-44dc-937c-d54d5e5bce00 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:48.334571 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a747e8-e5fe-44dc-937c-d54d5e5bce00 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:48.341896 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a747e8-e5fe-44dc-937c-d54d5e5bce00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:48.344961 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a747e8-e5fe-44dc-937c-d54d5e5bce00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:51:48.349870 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-57a747e8-e5fe-44dc-937c-d54d5e5bce00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:51:48.349870 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:48.349870 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:48.349870 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:48.349870 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:48.349870 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:48.349870 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:48.349870 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:48.349870 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:48.349870 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:48.349870 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:48.349870 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:48.349870 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:51:48.349870 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:51:48.349870 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:51:48.349870 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:51:48.350876 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:51:48.350876 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:51:48.350876 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:51:48.350876 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:51:48.350876 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:48.350876 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:48.350876 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:48.350876 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:48.350876 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:48.350876 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:48.350876 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:48.350876 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:48.350876 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:48.350876 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:48.350876 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:48.350876 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:48.351730 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:48.351730 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:48.351730 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:48.351730 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:48.351730 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:51:48.351730 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:51:48.351730 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:51:48.351730 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:51:48.351730 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:51:48.351730 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:51:48.351730 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:51:48.351730 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:51:48.351730 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 436/867] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 26 10:51:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:48.357052 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a4597-096c-4a75-b4ac-cc6612b61cee None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:48.400209 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:48.452550 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a4597-096c-4a75-b4ac-cc6612b61cee None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:48.485641 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67531ae7-0805-49dd-9d3d-a0dbb8d76c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:48.486239 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67531ae7-0805-49dd-9d3d-a0dbb8d76c35 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:48.486519 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67531ae7-0805-49dd-9d3d-a0dbb8d76c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:48.486791 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67531ae7-0805-49dd-9d3d-a0dbb8d76c35 None admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:48.487443 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67531ae7-0805-49dd-9d3d-a0dbb8d76c35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:48.487747 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67531ae7-0805-49dd-9d3d-a0dbb8d76c35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:48.489141 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67531ae7-0805-49dd-9d3d-a0dbb8d76c35 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:48.497373 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 432/868] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 26 10:51:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:48.503094 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a747e8-e5fe-44dc-937c-d54d5e5bce00 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:48.599350 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a747e8-e5fe-44dc-937c-d54d5e5bce00 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:48.631548 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad17b7d-ee55-45e4-8221-b1485e60f82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:48.632183 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad17b7d-ee55-45e4-8221-b1485e60f82c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:48.632464 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad17b7d-ee55-45e4-8221-b1485e60f82c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:48.632736 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad17b7d-ee55-45e4-8221-b1485e60f82c None admin] PATH_INFO: `/v3/users/cb56a53b30204643baa3076e7acae529` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:48.645167 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad17b7d-ee55-45e4-8221-b1485e60f82c None admin] RBAC: Authorizing `identity:get_user(user_id=cb56a53b30204643baa3076e7acae529)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:48.647150 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad17b7d-ee55-45e4-8221-b1485e60f82c None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:48.648857 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 437/869] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 26 10:51:48 2022] GET /identity/v3/users/cb56a53b30204643baa3076e7acae529 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:48.654442 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67531ae7-0805-49dd-9d3d-a0dbb8d76c35 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:48.750196 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67531ae7-0805-49dd-9d3d-a0dbb8d76c35 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:48.757407 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:48.782805 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed5661-4872-43af-8b81-ab5c8fb8df1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:48.783429 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed5661-4872-43af-8b81-ab5c8fb8df1a None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:48.783737 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed5661-4872-43af-8b81-ab5c8fb8df1a None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:48.784012 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed5661-4872-43af-8b81-ab5c8fb8df1a None admin] PATH_INFO: `/v3/projects/01ae53f37405440399a8586826fe85bd` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:48.785135 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed5661-4872-43af-8b81-ab5c8fb8df1a None admin] RBAC: Authorizing `identity:get_project(project_id=01ae53f37405440399a8586826fe85bd)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:48.786553 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed5661-4872-43af-8b81-ab5c8fb8df1a None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:48.788180 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 433/870] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 26 10:51:48 2022] GET /identity/v3/projects/01ae53f37405440399a8586826fe85bd => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:48.793935 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad17b7d-ee55-45e4-8221-b1485e60f82c None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:48.843228 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:48.892164 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad17b7d-ee55-45e4-8221-b1485e60f82c None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:48.924786 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492d74d-ddb2-41bb-84fa-8b222d540c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:48.925443 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492d74d-ddb2-41bb-84fa-8b222d540c48 None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:48.925727 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492d74d-ddb2-41bb-84fa-8b222d540c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:48.926002 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492d74d-ddb2-41bb-84fa-8b222d540c48 None admin] PATH_INFO: `/v3/projects/01ae53f37405440399a8586826fe85bd/users/cb56a53b30204643baa3076e7acae529/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:48.928541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5492d74d-ddb2-41bb-84fa-8b222d540c48 None admin] RBAC: Authorizing `identity:create_grant(project_id=01ae53f37405440399a8586826fe85bd, user_id=cb56a53b30204643baa3076e7acae529, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:48.929974 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5492d74d-ddb2-41bb-84fa-8b222d540c48 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:48.991995 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 438/871] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 26 10:51:48 2022] PUT /identity/v3/projects/01ae53f37405440399a8586826fe85bd/users/cb56a53b30204643baa3076e7acae529/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:51:51.094280 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0edc3d-f181-444c-b538-e2bf1ff1c96d None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:51.094866 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0edc3d-f181-444c-b538-e2bf1ff1c96d None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:51.094866 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0edc3d-f181-444c-b538-e2bf1ff1c96d None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:51.096415 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 434/872] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:51.101636 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29770038-6c15-41cd-a3ef-9454116e7142 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:51.102157 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29770038-6c15-41cd-a3ef-9454116e7142 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:51.102261 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29770038-6c15-41cd-a3ef-9454116e7142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:51.120494 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-29770038-6c15-41cd-a3ef-9454116e7142 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:51.121691 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-29770038-6c15-41cd-a3ef-9454116e7142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:51.186237 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 439/873] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 26 10:51:51.451522 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0edc3d-f181-444c-b538-e2bf1ff1c96d None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:51.549293 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0edc3d-f181-444c-b538-e2bf1ff1c96d None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:51.581981 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cecf13-9e7c-449f-a45c-55aca72111d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:51.582589 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cecf13-9e7c-449f-a45c-55aca72111d0 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:51.582864 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cecf13-9e7c-449f-a45c-55aca72111d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:51.583133 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cecf13-9e7c-449f-a45c-55aca72111d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:51.592880 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cecf13-9e7c-449f-a45c-55aca72111d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:51:51.597565 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-d2cecf13-9e7c-449f-a45c-55aca72111d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:51:51.597565 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:51.597565 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:51.597565 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:51.597565 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:51.597565 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:51.597565 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:51.597565 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:51.597565 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:51.597565 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:51.597565 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:51.597565 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:51.597565 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:51:51.597565 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:51:51.597565 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:51:51.597565 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:51:51.598713 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:51:51.598713 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:51:51.598713 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:51:51.598713 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:51:51.598713 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:51.598713 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:51.598713 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:51.598713 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:51.598713 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:51.598713 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:51.598713 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:51.598713 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:51.598713 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:51.598713 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:51.598713 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:51.598713 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:51.599620 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:51.599620 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:51.599620 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:51.599620 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:51.599620 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:51:51.599620 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:51:51.599620 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:51:51.599620 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:51:51.599620 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:51:51.599620 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:51:51.599620 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:51:51.599620 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:51:51.599620 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 435/874] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 26 10:51:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:51.604599 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29770038-6c15-41cd-a3ef-9454116e7142 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:51.645067 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:51.701068 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29770038-6c15-41cd-a3ef-9454116e7142 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:51.733555 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b0e31-2147-4851-a22a-044caf68abfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:51.734103 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b0e31-2147-4851-a22a-044caf68abfa None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:51.734384 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b0e31-2147-4851-a22a-044caf68abfa None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:51.734658 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b0e31-2147-4851-a22a-044caf68abfa None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:51.735312 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b0e31-2147-4851-a22a-044caf68abfa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:51.735616 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b0e31-2147-4851-a22a-044caf68abfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:51.737002 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b0e31-2147-4851-a22a-044caf68abfa None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:51.745226 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 440/875] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 26 10:51:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:51.750938 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cecf13-9e7c-449f-a45c-55aca72111d0 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:51.784227 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:51.847535 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cecf13-9e7c-449f-a45c-55aca72111d0 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:51.879978 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a150bf8-5c8e-4bed-8d42-6f54cfeb251e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:51.880638 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a150bf8-5c8e-4bed-8d42-6f54cfeb251e None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:51.880919 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a150bf8-5c8e-4bed-8d42-6f54cfeb251e None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:51.881192 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a150bf8-5c8e-4bed-8d42-6f54cfeb251e None admin] PATH_INFO: `/v3/users/cb56a53b30204643baa3076e7acae529` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:51.882295 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a150bf8-5c8e-4bed-8d42-6f54cfeb251e None admin] RBAC: Authorizing `identity:get_user(user_id=cb56a53b30204643baa3076e7acae529)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:51.883712 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a150bf8-5c8e-4bed-8d42-6f54cfeb251e None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:51.885289 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 436/876] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 26 10:51:51 2022] GET /identity/v3/users/cb56a53b30204643baa3076e7acae529 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:51.890841 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b0e31-2147-4851-a22a-044caf68abfa None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:51.992741 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b0e31-2147-4851-a22a-044caf68abfa None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:51.994150 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:52.026136 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf9bab-7ec7-4c7e-bab8-109907410751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:52.026751 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf9bab-7ec7-4c7e-bab8-109907410751 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:52.027288 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf9bab-7ec7-4c7e-bab8-109907410751 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:52.027566 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf9bab-7ec7-4c7e-bab8-109907410751 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:52.092837 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdf9bab-7ec7-4c7e-bab8-109907410751 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:52.094283 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdf9bab-7ec7-4c7e-bab8-109907410751 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:52.187663 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 441/877] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 26 10:51:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 26 10:51:52.194097 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a150bf8-5c8e-4bed-8d42-6f54cfeb251e None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:52.289653 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a150bf8-5c8e-4bed-8d42-6f54cfeb251e None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:52.291118 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:52.324421 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a60a6-e4cb-4c9b-a026-c553e04a5cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:52.325039 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a60a6-e4cb-4c9b-a026-c553e04a5cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:52.325319 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a60a6-e4cb-4c9b-a026-c553e04a5cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:52.325589 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a60a6-e4cb-4c9b-a026-c553e04a5cf9 None admin] PATH_INFO: `/v3/projects/01ae53f37405440399a8586826fe85bd` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:52.326696 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a60a6-e4cb-4c9b-a026-c553e04a5cf9 None admin] RBAC: Authorizing `identity:get_project(project_id=01ae53f37405440399a8586826fe85bd)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:52.328154 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a60a6-e4cb-4c9b-a026-c553e04a5cf9 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:52.329791 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 437/878] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 26 10:51:52 2022] GET /identity/v3/projects/01ae53f37405440399a8586826fe85bd => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:52.335916 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf9bab-7ec7-4c7e-bab8-109907410751 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:52.338109 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:52.431829 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf9bab-7ec7-4c7e-bab8-109907410751 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:52.464205 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ddd3b3-1acf-42f2-8823-bd41f07c2ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:52.464809 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ddd3b3-1acf-42f2-8823-bd41f07c2ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:52.465097 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ddd3b3-1acf-42f2-8823-bd41f07c2ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:52.465374 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ddd3b3-1acf-42f2-8823-bd41f07c2ee6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:52.466093 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ddd3b3-1acf-42f2-8823-bd41f07c2ee6 None admin] RBAC: Adding query filter params (role.id=d6876897d7c548b7900d4e01cb45a007, scope.project.id=01ae53f37405440399a8586826fe85bd, user.id=cb56a53b30204643baa3076e7acae529) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:52.466404 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ddd3b3-1acf-42f2-8823-bd41f07c2ee6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:52.467836 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ddd3b3-1acf-42f2-8823-bd41f07c2ee6 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:52.473469 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 442/879] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 26 10:51:52 2022] GET /identity/v3/role_assignments?user.id=cb56a53b30204643baa3076e7acae529&scope.project.id=01ae53f37405440399a8586826fe85bd&role.id=d6876897d7c548b7900d4e01cb45a007 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:51:54.643800 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23069b3-2919-4dae-9341-2d2680404a6b None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:54.644348 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23069b3-2919-4dae-9341-2d2680404a6b None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:54.644348 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23069b3-2919-4dae-9341-2d2680404a6b None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:54.645624 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 438/880] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:54.651255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e9d0f-28ca-4570-bec1-def2495902bc None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:54.651637 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e9d0f-28ca-4570-bec1-def2495902bc None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:54.651817 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e9d0f-28ca-4570-bec1-def2495902bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:54.670547 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-dc4e9d0f-28ca-4570-bec1-def2495902bc None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:54.671735 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-dc4e9d0f-28ca-4570-bec1-def2495902bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:54.728861 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:54.735947 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 443/881] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:51:55.002762 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23069b3-2919-4dae-9341-2d2680404a6b None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:55.101054 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23069b3-2919-4dae-9341-2d2680404a6b None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:55.133444 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c34115-3c2c-4990-87a5-e24fbfdff89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:55.134036 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c34115-3c2c-4990-87a5-e24fbfdff89c None admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:55.134319 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c34115-3c2c-4990-87a5-e24fbfdff89c None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:55.134592 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c34115-3c2c-4990-87a5-e24fbfdff89c None admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:55.135251 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c34115-3c2c-4990-87a5-e24fbfdff89c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:55.136630 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c34115-3c2c-4990-87a5-e24fbfdff89c None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:55.215937 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 439/882] 10.222.0.45 () {60 vars in 1138 bytes} [Wed Oct 26 10:51:55 2022] POST /identity/v3/domains => generated 267 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:51:57.361407 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b609d20-64c6-4308-b310-d2eda7dc97a9 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:57.361891 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b609d20-64c6-4308-b310-d2eda7dc97a9 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:57.361981 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b609d20-64c6-4308-b310-d2eda7dc97a9 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:57.363291 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 444/883] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:57.369266 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678e422-9213-49ae-ad72-310f4b557bad None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:57.369696 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678e422-9213-49ae-ad72-310f4b557bad None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:57.369820 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678e422-9213-49ae-ad72-310f4b557bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:57.387494 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-4678e422-9213-49ae-ad72-310f4b557bad None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:57.388712 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-4678e422-9213-49ae-ad72-310f4b557bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:57.411128 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:57.453191 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 440/884] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:51:57.733237 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b609d20-64c6-4308-b310-d2eda7dc97a9 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:57.825009 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b609d20-64c6-4308-b310-d2eda7dc97a9 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:57.858447 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b8166-ce21-47f3-ac28-7a546e00af6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:57.859075 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b8166-ce21-47f3-ac28-7a546e00af6d None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:57.859361 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b8166-ce21-47f3-ac28-7a546e00af6d None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:57.859639 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b8166-ce21-47f3-ac28-7a546e00af6d None admin] PATH_INFO: `/v3/domains/003a9f87c746479cbf5adb6c7fa5f863` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:57.869752 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b8166-ce21-47f3-ac28-7a546e00af6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=003a9f87c746479cbf5adb6c7fa5f863)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:57.871196 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b8166-ce21-47f3-ac28-7a546e00af6d None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:57.872805 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 445/885] 10.222.0.45 () {56 vars in 1183 bytes} [Wed Oct 26 10:51:57 2022] GET /identity/v3/domains/003a9f87c746479cbf5adb6c7fa5f863 => generated 267 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:57.878707 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678e422-9213-49ae-ad72-310f4b557bad None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:57.975386 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678e422-9213-49ae-ad72-310f4b557bad None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:58.013188 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b1698c-52f4-4148-be93-846d4ad327bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:58.013730 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1698c-52f4-4148-be93-846d4ad327bf None admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:58.014010 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1698c-52f4-4148-be93-846d4ad327bf None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:58.014287 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1698c-52f4-4148-be93-846d4ad327bf None admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:58.014947 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b1698c-52f4-4148-be93-846d4ad327bf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:58.016387 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b1698c-52f4-4148-be93-846d4ad327bf None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:58.123634 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 441/886] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Oct 26 10:51:57 2022] POST /identity/v3/projects => generated 361 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:52:00.277424 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd66f1-8445-40d4-bcc7-c200182f8ac1 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:00.277967 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd66f1-8445-40d4-bcc7-c200182f8ac1 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:00.277967 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd66f1-8445-40d4-bcc7-c200182f8ac1 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:00.279352 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 446/887] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:00.284503 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c84f8f-82b7-4b4a-bb45-52a824688f42 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:00.284881 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c84f8f-82b7-4b4a-bb45-52a824688f42 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:00.285062 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c84f8f-82b7-4b4a-bb45-52a824688f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:00.304156 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-13c84f8f-82b7-4b4a-bb45-52a824688f42 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:00.305280 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-13c84f8f-82b7-4b4a-bb45-52a824688f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:00.312405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:00.371587 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 442/888] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:52:00.642069 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd66f1-8445-40d4-bcc7-c200182f8ac1 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:00.698398 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:00.741493 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd66f1-8445-40d4-bcc7-c200182f8ac1 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:00.774160 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3dd62-3c71-4583-86df-64354ec74988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:00.774790 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3dd62-3c71-4583-86df-64354ec74988 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:00.775071 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3dd62-3c71-4583-86df-64354ec74988 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:00.775350 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3dd62-3c71-4583-86df-64354ec74988 None admin] PATH_INFO: `/v3/domains/003a9f87c746479cbf5adb6c7fa5f863` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:00.776477 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b3dd62-3c71-4583-86df-64354ec74988 None admin] RBAC: Authorizing `identity:get_domain(domain_id=003a9f87c746479cbf5adb6c7fa5f863)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:00.777907 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b3dd62-3c71-4583-86df-64354ec74988 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:00.779470 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 447/889] 10.222.0.45 () {56 vars in 1183 bytes} [Wed Oct 26 10:52:00 2022] GET /identity/v3/domains/003a9f87c746479cbf5adb6c7fa5f863 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:00.786298 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c84f8f-82b7-4b4a-bb45-52a824688f42 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:00.883064 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c84f8f-82b7-4b4a-bb45-52a824688f42 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:00.915148 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0e104-8aa1-44f1-8d83-00f07e7a05bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:00.915686 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0e104-8aa1-44f1-8d83-00f07e7a05bb None admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:00.915966 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0e104-8aa1-44f1-8d83-00f07e7a05bb None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:00.916270 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0e104-8aa1-44f1-8d83-00f07e7a05bb None admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:00.916912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0e104-8aa1-44f1-8d83-00f07e7a05bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:00.918323 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0e104-8aa1-44f1-8d83-00f07e7a05bb None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:01.030164 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:01.035622 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 443/890] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Oct 26 10:52:00 2022] POST /identity/v3/users => generated 311 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:52:03.185887 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d21c8a-9695-4bdb-a120-965357a9e883 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:03.186435 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d21c8a-9695-4bdb-a120-965357a9e883 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:03.186435 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d21c8a-9695-4bdb-a120-965357a9e883 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:03.187764 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 448/891] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:03.193525 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e2c97-4f3f-4210-9614-8f94efdf34b1 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:03.193905 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e2c97-4f3f-4210-9614-8f94efdf34b1 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:03.194067 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e2c97-4f3f-4210-9614-8f94efdf34b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:03.211648 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-ad5e2c97-4f3f-4210-9614-8f94efdf34b1 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:03.212855 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-ad5e2c97-4f3f-4210-9614-8f94efdf34b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:03.275955 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 444/892] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:52:03.545249 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d21c8a-9695-4bdb-a120-965357a9e883 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:03.643886 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d21c8a-9695-4bdb-a120-965357a9e883 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:03.665984 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:03.676343 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c441363-091f-4bb7-8f52-e1dea8c829d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:03.677485 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c441363-091f-4bb7-8f52-e1dea8c829d6 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:03.682765 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c441363-091f-4bb7-8f52-e1dea8c829d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:03.682765 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c441363-091f-4bb7-8f52-e1dea8c829d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:03.687866 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c441363-091f-4bb7-8f52-e1dea8c829d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:52:03.692953 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-1c441363-091f-4bb7-8f52-e1dea8c829d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:52:03.692953 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:03.692953 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:03.692953 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:03.692953 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:03.692953 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:03.692953 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:03.692953 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:03.692953 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:03.692953 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:03.692953 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:03.692953 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:03.692953 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:52:03.692953 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:52:03.692953 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:52:03.692953 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:52:03.694086 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:52:03.694086 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:52:03.694086 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:52:03.694086 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:52:03.694086 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:03.694086 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:03.694086 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:03.694086 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:03.694086 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:03.694086 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:03.694086 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:03.694086 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:03.694086 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:03.694086 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:03.694086 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:03.694086 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:03.695000 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:03.695000 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:03.695000 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:03.695000 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:03.695000 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:52:03.695000 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:52:03.695000 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:52:03.695000 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:52:03.695000 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:52:03.695000 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:52:03.695000 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:52:03.695000 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:52:03.695000 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 449/893] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 26 10:52:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:03.700419 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e2c97-4f3f-4210-9614-8f94efdf34b1 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:03.796547 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e2c97-4f3f-4210-9614-8f94efdf34b1 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:03.821522 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:03.828921 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56646b-2018-4cd0-84c6-4930371cf3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:03.829526 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56646b-2018-4cd0-84c6-4930371cf3b1 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:03.829811 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56646b-2018-4cd0-84c6-4930371cf3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:03.830083 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56646b-2018-4cd0-84c6-4930371cf3b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:03.830737 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56646b-2018-4cd0-84c6-4930371cf3b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:03.831038 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56646b-2018-4cd0-84c6-4930371cf3b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:03.832421 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56646b-2018-4cd0-84c6-4930371cf3b1 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:03.840586 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 445/894] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 26 10:52:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:03.846435 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c441363-091f-4bb7-8f52-e1dea8c829d6 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:03.942808 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c441363-091f-4bb7-8f52-e1dea8c829d6 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:03.976020 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b0abd-7fdf-42ff-a135-c8f061714839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:03.976683 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b0abd-7fdf-42ff-a135-c8f061714839 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:03.976945 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b0abd-7fdf-42ff-a135-c8f061714839 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:03.977222 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b0abd-7fdf-42ff-a135-c8f061714839 None admin] PATH_INFO: `/v3/users/58f85f9a02fa4dceb006520a8a2d57ee` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:03.990580 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b0abd-7fdf-42ff-a135-c8f061714839 None admin] RBAC: Authorizing `identity:get_user(user_id=58f85f9a02fa4dceb006520a8a2d57ee)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:03.992014 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b0abd-7fdf-42ff-a135-c8f061714839 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:03.993610 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 450/895] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 26 10:52:03 2022] GET /identity/v3/users/58f85f9a02fa4dceb006520a8a2d57ee => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:03.999223 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56646b-2018-4cd0-84c6-4930371cf3b1 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:04.100786 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56646b-2018-4cd0-84c6-4930371cf3b1 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:04.137029 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb701d-2f2e-426e-80dd-0a79b99a3d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:04.137655 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb701d-2f2e-426e-80dd-0a79b99a3d72 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:04.137935 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb701d-2f2e-426e-80dd-0a79b99a3d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:04.138210 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb701d-2f2e-426e-80dd-0a79b99a3d72 None admin] PATH_INFO: `/v3/projects/2477a495f392448ca90895420e3d5736` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:04.139318 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bb701d-2f2e-426e-80dd-0a79b99a3d72 None admin] RBAC: Authorizing `identity:get_project(project_id=2477a495f392448ca90895420e3d5736)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:04.140777 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bb701d-2f2e-426e-80dd-0a79b99a3d72 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:04.142401 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 446/896] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 26 10:52:03 2022] GET /identity/v3/projects/2477a495f392448ca90895420e3d5736 => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:04.148467 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b0abd-7fdf-42ff-a135-c8f061714839 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:04.190916 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:04.244456 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b0abd-7fdf-42ff-a135-c8f061714839 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:04.276432 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16c96a-7dc9-4b8c-9113-2f5caf4445a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:04.277078 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16c96a-7dc9-4b8c-9113-2f5caf4445a2 None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:04.277358 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16c96a-7dc9-4b8c-9113-2f5caf4445a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:04.277633 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16c96a-7dc9-4b8c-9113-2f5caf4445a2 None admin] PATH_INFO: `/v3/projects/2477a495f392448ca90895420e3d5736/users/58f85f9a02fa4dceb006520a8a2d57ee/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:04.279519 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c16c96a-7dc9-4b8c-9113-2f5caf4445a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=2477a495f392448ca90895420e3d5736, user_id=58f85f9a02fa4dceb006520a8a2d57ee, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:04.280968 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c16c96a-7dc9-4b8c-9113-2f5caf4445a2 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:04.354239 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 451/897] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 26 10:52:04 2022] PUT /identity/v3/projects/2477a495f392448ca90895420e3d5736/users/58f85f9a02fa4dceb006520a8a2d57ee/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:52:06.447857 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1acf1-7a67-49fc-b1f0-95f796a4517b None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:06.448420 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1acf1-7a67-49fc-b1f0-95f796a4517b None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:06.448420 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1acf1-7a67-49fc-b1f0-95f796a4517b None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:06.449769 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 447/898] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:06.454878 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e928a-4aac-492e-b8c4-2940cff3e840 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:06.455317 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e928a-4aac-492e-b8c4-2940cff3e840 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:06.455423 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e928a-4aac-492e-b8c4-2940cff3e840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:06.473923 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-c04e928a-4aac-492e-b8c4-2940cff3e840 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:06.475110 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c04e928a-4aac-492e-b8c4-2940cff3e840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:06.538858 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 452/899] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:52:06.802065 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e1acf1-7a67-49fc-b1f0-95f796a4517b None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:06.859535 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:06.901754 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e1acf1-7a67-49fc-b1f0-95f796a4517b None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:06.933919 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ddfe5-fdfa-442b-815c-063bbd8f79a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:06.934599 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ddfe5-fdfa-442b-815c-063bbd8f79a8 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:06.934878 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ddfe5-fdfa-442b-815c-063bbd8f79a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:06.935146 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ddfe5-fdfa-442b-815c-063bbd8f79a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:06.945299 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ddfe5-fdfa-442b-815c-063bbd8f79a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:52:06.950396 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-ec9ddfe5-fdfa-442b-815c-063bbd8f79a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:52:06.950396 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:06.950396 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:06.950396 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:06.950396 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:06.950396 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:06.950396 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:06.950396 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:06.950396 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:06.950396 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:06.950396 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:06.950396 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:06.950396 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:52:06.950396 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:52:06.950396 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:52:06.950396 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:52:06.951469 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:52:06.951469 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:52:06.951469 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:52:06.951469 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:52:06.951469 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:06.951469 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:06.951469 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:06.951469 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:06.951469 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:06.951469 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:06.951469 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:06.951469 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:06.951469 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:06.951469 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:06.951469 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:06.951469 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:06.952692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:06.952692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:06.952692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:06.952692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:06.952692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:52:06.952692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:52:06.952692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:52:06.952692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:52:06.952692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:52:06.952692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:52:06.952692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:52:06.952692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:52:06.952692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 448/900] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 26 10:52:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:06.957386 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e928a-4aac-492e-b8c4-2940cff3e840 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:06.987703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:07.054458 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e928a-4aac-492e-b8c4-2940cff3e840 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:07.086679 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0454350-0b10-4ebd-b4cc-59a016b7522a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:07.087284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0454350-0b10-4ebd-b4cc-59a016b7522a None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:07.087569 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0454350-0b10-4ebd-b4cc-59a016b7522a None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:07.087847 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0454350-0b10-4ebd-b4cc-59a016b7522a None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:07.088530 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0454350-0b10-4ebd-b4cc-59a016b7522a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:07.088837 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0454350-0b10-4ebd-b4cc-59a016b7522a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:07.090207 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0454350-0b10-4ebd-b4cc-59a016b7522a None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:07.097928 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 453/901] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 26 10:52:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:07.104305 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ddfe5-fdfa-442b-815c-063bbd8f79a8 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:07.200563 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ddfe5-fdfa-442b-815c-063bbd8f79a8 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:07.216999 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:07.232598 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6a4ed-7323-4a6b-8f95-1ed8615ac91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:07.233222 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6a4ed-7323-4a6b-8f95-1ed8615ac91e None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:07.233503 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6a4ed-7323-4a6b-8f95-1ed8615ac91e None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:07.233778 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6a4ed-7323-4a6b-8f95-1ed8615ac91e None admin] PATH_INFO: `/v3/users/58f85f9a02fa4dceb006520a8a2d57ee` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:07.234888 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f6a4ed-7323-4a6b-8f95-1ed8615ac91e None admin] RBAC: Authorizing `identity:get_user(user_id=58f85f9a02fa4dceb006520a8a2d57ee)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:07.236348 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f6a4ed-7323-4a6b-8f95-1ed8615ac91e None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:07.237899 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 449/902] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 26 10:52:07 2022] GET /identity/v3/users/58f85f9a02fa4dceb006520a8a2d57ee => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:07.243788 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0454350-0b10-4ebd-b4cc-59a016b7522a None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:07.334867 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:07.341337 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0454350-0b10-4ebd-b4cc-59a016b7522a None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:07.374197 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ada929-fa29-41a2-b808-0cf54a98eba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:07.374799 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ada929-fa29-41a2-b808-0cf54a98eba5 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:07.375077 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ada929-fa29-41a2-b808-0cf54a98eba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:07.375345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ada929-fa29-41a2-b808-0cf54a98eba5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:07.439433 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ada929-fa29-41a2-b808-0cf54a98eba5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:07.440891 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ada929-fa29-41a2-b808-0cf54a98eba5 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:07.527519 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:07.534459 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 454/903] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 26 10:52:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 26 10:52:07.540416 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6a4ed-7323-4a6b-8f95-1ed8615ac91e None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:07.637405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6a4ed-7323-4a6b-8f95-1ed8615ac91e None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:07.669154 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b2afa-bb47-434d-9d59-2b67505339c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:07.670029 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b2afa-bb47-434d-9d59-2b67505339c6 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:07.670309 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b2afa-bb47-434d-9d59-2b67505339c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:07.670582 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b2afa-bb47-434d-9d59-2b67505339c6 None admin] PATH_INFO: `/v3/projects/2477a495f392448ca90895420e3d5736` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:07.671678 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b2afa-bb47-434d-9d59-2b67505339c6 None admin] RBAC: Authorizing `identity:get_project(project_id=2477a495f392448ca90895420e3d5736)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:07.673129 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b2afa-bb47-434d-9d59-2b67505339c6 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:07.674725 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 450/904] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 26 10:52:07 2022] GET /identity/v3/projects/2477a495f392448ca90895420e3d5736 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:07.681139 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ada929-fa29-41a2-b808-0cf54a98eba5 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:07.775221 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ada929-fa29-41a2-b808-0cf54a98eba5 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:07.809009 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae64b2cf-aecc-4ed3-8329-9cf3f3b52ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:07.809603 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64b2cf-aecc-4ed3-8329-9cf3f3b52ff8 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:07.809887 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64b2cf-aecc-4ed3-8329-9cf3f3b52ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:07.810162 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64b2cf-aecc-4ed3-8329-9cf3f3b52ff8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:07.810872 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae64b2cf-aecc-4ed3-8329-9cf3f3b52ff8 None admin] RBAC: Adding query filter params (role.id=d6876897d7c548b7900d4e01cb45a007, scope.project.id=2477a495f392448ca90895420e3d5736, user.id=58f85f9a02fa4dceb006520a8a2d57ee) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:07.811180 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae64b2cf-aecc-4ed3-8329-9cf3f3b52ff8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:07.812629 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae64b2cf-aecc-4ed3-8329-9cf3f3b52ff8 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:07.818198 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 455/905] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 26 10:52:07 2022] GET /identity/v3/role_assignments?user.id=58f85f9a02fa4dceb006520a8a2d57ee&scope.project.id=2477a495f392448ca90895420e3d5736&role.id=d6876897d7c548b7900d4e01cb45a007 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:17.665144 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=73 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:17.815641 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=71 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:27.240112 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b54b2-b450-4d88-9fc0-6d15f415154c None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:27.240700 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b54b2-b450-4d88-9fc0-6d15f415154c None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:27.240700 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b54b2-b450-4d88-9fc0-6d15f415154c None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:27.242004 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 451/906] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:27.247317 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a51696-010b-4082-a066-dd7a23d75ec3 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:27.247815 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a51696-010b-4082-a066-dd7a23d75ec3 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:27.247916 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a51696-010b-4082-a066-dd7a23d75ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:27.266305 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-e8a51696-010b-4082-a066-dd7a23d75ec3 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:27.267996 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e8a51696-010b-4082-a066-dd7a23d75ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:27.336048 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 456/907] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:53:27.603707 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b54b2-b450-4d88-9fc0-6d15f415154c None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:27.703830 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b54b2-b450-4d88-9fc0-6d15f415154c None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:27.737055 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ca1b0-b391-491e-a9a1-eab1f472ab71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:27.737680 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ca1b0-b391-491e-a9a1-eab1f472ab71 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:27.737962 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ca1b0-b391-491e-a9a1-eab1f472ab71 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:27.738237 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ca1b0-b391-491e-a9a1-eab1f472ab71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:27.748141 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ca1b0-b391-491e-a9a1-eab1f472ab71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:27.749585 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ca1b0-b391-491e-a9a1-eab1f472ab71 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:27.764277 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-1f7ca1b0-b391-491e-a9a1-eab1f472ab71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:53:27.764277 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:27.764277 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:27.764277 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:27.764277 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:27.764277 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:27.764277 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:27.764277 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:27.764277 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:27.764277 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:27.764277 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:27.764277 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:27.764277 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:53:27.764277 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:53:27.764277 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:53:27.764277 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:53:27.767252 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:27.767252 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:27.767252 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:27.767252 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:27.767252 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:27.767252 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:27.767252 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:27.767252 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:27.767252 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:27.767252 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:27.767252 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:27.767252 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:27.767252 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:27.767252 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:27.767252 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:27.767252 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:27.767252 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:53:27.768487 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:53:27.768487 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:53:27.768487 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:53:27.768487 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 452/908] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:53:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:27.772206 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a51696-010b-4082-a066-dd7a23d75ec3 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:27.868748 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a51696-010b-4082-a066-dd7a23d75ec3 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:27.896969 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:27.902565 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2436c2b-bfd0-4d84-95f9-11e45c3a9a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:27.903177 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2436c2b-bfd0-4d84-95f9-11e45c3a9a5c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:27.903465 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2436c2b-bfd0-4d84-95f9-11e45c3a9a5c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:27.903739 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2436c2b-bfd0-4d84-95f9-11e45c3a9a5c None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:27.904406 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2436c2b-bfd0-4d84-95f9-11e45c3a9a5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:27.904712 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2436c2b-bfd0-4d84-95f9-11e45c3a9a5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:27.906079 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2436c2b-bfd0-4d84-95f9-11e45c3a9a5c None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:27.916800 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 457/909] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:27.922732 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ca1b0-b391-491e-a9a1-eab1f472ab71 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:27.974936 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:28.020013 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ca1b0-b391-491e-a9a1-eab1f472ab71 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:28.052125 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728b661-ff88-4b18-b58f-a552ab41b9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:28.052727 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728b661-ff88-4b18-b58f-a552ab41b9dd None admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:28.053010 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728b661-ff88-4b18-b58f-a552ab41b9dd None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:28.053285 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728b661-ff88-4b18-b58f-a552ab41b9dd None admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:28.053926 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f728b661-ff88-4b18-b58f-a552ab41b9dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:28.055344 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f728b661-ff88-4b18-b58f-a552ab41b9dd None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:28.321536 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 453/910] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Oct 26 10:53:27 2022] POST /identity/v3/users => generated 251 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:53:30.474926 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ff4c1-e6ca-4a20-b84e-f1911241d52c None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:30.475474 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ff4c1-e6ca-4a20-b84e-f1911241d52c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:30.475474 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ff4c1-e6ca-4a20-b84e-f1911241d52c None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:30.476845 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 458/911] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:30.481918 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668bb35-a27f-4341-9714-d7c6c11683f2 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:30.482338 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668bb35-a27f-4341-9714-d7c6c11683f2 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:30.482466 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668bb35-a27f-4341-9714-d7c6c11683f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:30.502230 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-2668bb35-a27f-4341-9714-d7c6c11683f2 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:30.503400 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-2668bb35-a27f-4341-9714-d7c6c11683f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:30.568350 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 454/912] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:53:30.843606 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ff4c1-e6ca-4a20-b84e-f1911241d52c None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:30.945070 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ff4c1-e6ca-4a20-b84e-f1911241d52c None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:30.977809 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb62d58-1622-4d53-b069-06844f208c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:30.978431 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb62d58-1622-4d53-b069-06844f208c3a None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:30.978718 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb62d58-1622-4d53-b069-06844f208c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:30.978993 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb62d58-1622-4d53-b069-06844f208c3a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:30.989398 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb62d58-1622-4d53-b069-06844f208c3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:53:30.994163 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-5eb62d58-1622-4d53-b069-06844f208c3a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:53:30.994163 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:30.994163 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:30.994163 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:30.994163 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:30.994163 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:30.994163 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:30.994163 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:30.994163 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:30.994163 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:30.994163 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:30.994163 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:30.994163 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:53:30.994163 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:53:30.994163 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:53:30.994163 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:53:30.995304 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:53:30.995304 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:53:30.995304 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:53:30.995304 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:53:30.995304 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:30.995304 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:30.995304 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:30.995304 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:30.995304 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:30.995304 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:30.995304 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:30.995304 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:30.995304 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:30.995304 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:30.995304 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:30.995304 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:30.996420 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:30.996420 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:30.996420 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:30.996420 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:30.996420 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:53:30.996420 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:53:30.996420 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:53:30.996420 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:53:30.996420 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:53:30.996420 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:53:30.996420 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:53:30.996420 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:53:30.996420 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 459/913] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Oct 26 10:53:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:31.001197 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668bb35-a27f-4341-9714-d7c6c11683f2 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:31.040127 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:31.099186 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668bb35-a27f-4341-9714-d7c6c11683f2 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:31.131455 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881fe60-a7f5-45c3-a933-0a21f61b9fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:31.132075 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881fe60-a7f5-45c3-a933-0a21f61b9fab None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:31.132359 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881fe60-a7f5-45c3-a933-0a21f61b9fab None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:31.132628 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881fe60-a7f5-45c3-a933-0a21f61b9fab None admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:31.133281 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881fe60-a7f5-45c3-a933-0a21f61b9fab None admin] RBAC: Adding query filter params (name=service) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:31.133579 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881fe60-a7f5-45c3-a933-0a21f61b9fab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:31.134933 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881fe60-a7f5-45c3-a933-0a21f61b9fab None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:31.142967 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 455/914] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Oct 26 10:53:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:31.148823 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb62d58-1622-4d53-b069-06844f208c3a None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:31.198425 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:31.246007 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb62d58-1622-4d53-b069-06844f208c3a None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:31.277880 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff4c7bf-ed6d-4d7a-b592-3f8192d4bc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:31.278500 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4c7bf-ed6d-4d7a-b592-3f8192d4bc4d None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:31.278780 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4c7bf-ed6d-4d7a-b592-3f8192d4bc4d None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:31.279053 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4c7bf-ed6d-4d7a-b592-3f8192d4bc4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:31.289670 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff4c7bf-ed6d-4d7a-b592-3f8192d4bc4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:31.291101 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff4c7bf-ed6d-4d7a-b592-3f8192d4bc4d None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:31.304959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-7ff4c7bf-ed6d-4d7a-b592-3f8192d4bc4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:53:31.304959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:31.304959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:31.304959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:31.304959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:31.304959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:31.304959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:31.304959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:31.304959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:31.304959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:31.304959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:31.304959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:31.304959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:53:31.304959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:53:31.304959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:53:31.304959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:53:31.311482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:31.311482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:31.311482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:31.311482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:31.311482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:31.311482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:31.311482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:31.311482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:31.311482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:31.311482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:31.311482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:31.311482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:31.311482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:31.311482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:31.311482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:31.311482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:31.311482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:53:31.312749 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:53:31.312749 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:53:31.312749 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:53:31.312749 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 460/915] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:53:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:31.313034 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881fe60-a7f5-45c3-a933-0a21f61b9fab None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:31.406934 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:31.410294 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881fe60-a7f5-45c3-a933-0a21f61b9fab None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:31.443446 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf1806-36f8-4461-be38-d87a6683fcfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:31.444047 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf1806-36f8-4461-be38-d87a6683fcfd None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:31.444358 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf1806-36f8-4461-be38-d87a6683fcfd None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:31.444644 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf1806-36f8-4461-be38-d87a6683fcfd None admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:31.445282 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf1806-36f8-4461-be38-d87a6683fcfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:31.445582 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf1806-36f8-4461-be38-d87a6683fcfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:31.446943 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf1806-36f8-4461-be38-d87a6683fcfd None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:31.458274 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 456/916] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:31.463981 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff4c7bf-ed6d-4d7a-b592-3f8192d4bc4d None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:31.560834 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff4c7bf-ed6d-4d7a-b592-3f8192d4bc4d None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:31.562330 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:31.596095 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60269135-6716-40c1-9569-bd01538db6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:31.596723 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60269135-6716-40c1-9569-bd01538db6d9 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:31.597001 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60269135-6716-40c1-9569-bd01538db6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:31.597270 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60269135-6716-40c1-9569-bd01538db6d9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:31.604137 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60269135-6716-40c1-9569-bd01538db6d9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:31.605613 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60269135-6716-40c1-9569-bd01538db6d9 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:31.616688 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-60269135-6716-40c1-9569-bd01538db6d9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 26 10:53:31.616688 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:31.616688 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:31.616688 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:31.616688 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:31.616688 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:31.616688 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:31.616688 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:31.616688 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:31.616688 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:31.616688 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:31.616688 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:31.616688 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:53:31.616688 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:53:31.616688 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:53:31.616688 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:53:31.617859 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:31.617859 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:31.617859 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:53:31.617859 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:53:31.617859 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:53:31.617859 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:53:31.617859 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:31.617859 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:31.617859 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:31.617859 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:31.617859 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:31.617859 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:31.617859 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:31.617859 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:31.617859 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:31.617859 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:31.617859 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:31.617859 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:31.619059 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:31.619059 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:31.619059 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:53:31.619059 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:53:31.619059 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:53:31.619059 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:53:31.619059 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:53:31.619059 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:53:31.619059 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 26 10:53:31.619059 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:53:31.619059 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 461/917] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:53:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:31.623598 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf1806-36f8-4461-be38-d87a6683fcfd None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:31.721722 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf1806-36f8-4461-be38-d87a6683fcfd None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:31.754720 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f6423-c8b9-45d2-b9e6-90cf3cbfb346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:31.755322 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f6423-c8b9-45d2-b9e6-90cf3cbfb346 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:31.755604 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f6423-c8b9-45d2-b9e6-90cf3cbfb346 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:31.755880 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f6423-c8b9-45d2-b9e6-90cf3cbfb346 None admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:31.756622 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f6423-c8b9-45d2-b9e6-90cf3cbfb346 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:31.756928 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f6423-c8b9-45d2-b9e6-90cf3cbfb346 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:31.758351 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f6423-c8b9-45d2-b9e6-90cf3cbfb346 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:31.775328 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 457/918] 10.222.0.45 () {56 vars in 1143 bytes} [Wed Oct 26 10:53:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:31.781171 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60269135-6716-40c1-9569-bd01538db6d9 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:31.880899 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60269135-6716-40c1-9569-bd01538db6d9 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:31.912925 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c3117-921c-4ac0-92ec-29bac06743f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:31.913540 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c3117-921c-4ac0-92ec-29bac06743f8 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:31.913894 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c3117-921c-4ac0-92ec-29bac06743f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:31.914162 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c3117-921c-4ac0-92ec-29bac06743f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:31.925395 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517c3117-921c-4ac0-92ec-29bac06743f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:31.928320 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517c3117-921c-4ac0-92ec-29bac06743f8 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:31.941272 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-517c3117-921c-4ac0-92ec-29bac06743f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:53:31.941272 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:31.941272 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:31.941272 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:31.941272 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:31.941272 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:31.941272 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:31.941272 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:31.941272 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:31.941272 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:31.941272 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:31.941272 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:31.941272 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:53:31.941272 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:53:31.941272 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:53:31.941272 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:53:31.942360 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:31.942360 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:31.942360 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:31.942360 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:31.942360 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:31.942360 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:31.942360 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:31.942360 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:31.942360 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:31.942360 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:31.942360 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:31.942360 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:31.942360 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:31.942360 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:31.942360 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:31.942360 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:31.942360 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:53:31.943465 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:53:31.943465 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:53:31.943465 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:53:31.943465 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 462/919] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:53:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:31.948284 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f6423-c8b9-45d2-b9e6-90cf3cbfb346 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:31.966610 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:32.042931 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f6423-c8b9-45d2-b9e6-90cf3cbfb346 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:32.077855 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9552b21-77b2-44dc-a4d3-ff672660e388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:32.078461 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9552b21-77b2-44dc-a4d3-ff672660e388 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:32.078738 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9552b21-77b2-44dc-a4d3-ff672660e388 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:32.079008 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9552b21-77b2-44dc-a4d3-ff672660e388 None admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:32.079680 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9552b21-77b2-44dc-a4d3-ff672660e388 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:32.079980 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9552b21-77b2-44dc-a4d3-ff672660e388 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:32.081415 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9552b21-77b2-44dc-a4d3-ff672660e388 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:32.092438 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 458/920] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:53:32.098298 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c3117-921c-4ac0-92ec-29bac06743f8 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:32.114685 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:32.195919 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c3117-921c-4ac0-92ec-29bac06743f8 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:32.229133 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b7b2c-9595-4684-b42d-539198cf6d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:32.229846 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b7b2c-9595-4684-b42d-539198cf6d6b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:32.230129 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b7b2c-9595-4684-b42d-539198cf6d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:32.230403 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b7b2c-9595-4684-b42d-539198cf6d6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:32.237417 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3b7b2c-9595-4684-b42d-539198cf6d6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:32.238951 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3b7b2c-9595-4684-b42d-539198cf6d6b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:32.249824 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-ea3b7b2c-9595-4684-b42d-539198cf6d6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:53:32.249824 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:32.249824 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:32.249824 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:32.249824 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:32.249824 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:32.249824 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:32.249824 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:32.249824 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:32.249824 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:32.249824 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:32.249824 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:32.249824 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:53:32.249824 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:53:32.249824 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:53:32.250869 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:53:32.250869 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:32.250869 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:32.250869 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:32.250869 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:32.250869 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:32.250869 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:32.250869 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:32.250869 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:32.250869 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:32.250869 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:32.250869 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:32.250869 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:32.250869 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:32.250869 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:32.250869 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:32.250869 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:32.251779 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:53:32.251779 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:53:32.251779 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:53:32.251779 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:53:32.251779 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:53:32.251779 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:53:32.251779 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:53:32.251779 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:53:32.251779 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 463/921] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 26 10:53:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:32.256880 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9552b21-77b2-44dc-a4d3-ff672660e388 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:32.335302 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:32.356290 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9552b21-77b2-44dc-a4d3-ff672660e388 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:32.388552 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339e358-5a0a-4480-b684-6e22ff99888a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:32.401081 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339e358-5a0a-4480-b684-6e22ff99888a None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:32.401081 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339e358-5a0a-4480-b684-6e22ff99888a None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:32.401081 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339e358-5a0a-4480-b684-6e22ff99888a None admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:32.401081 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339e358-5a0a-4480-b684-6e22ff99888a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:32.401081 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339e358-5a0a-4480-b684-6e22ff99888a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:32.401081 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339e358-5a0a-4480-b684-6e22ff99888a None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:32.404651 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 459/922] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 26 10:53:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:32.411275 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b7b2c-9595-4684-b42d-539198cf6d6b None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:32.484872 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:32.508459 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b7b2c-9595-4684-b42d-539198cf6d6b None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:32.541730 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f71c9d-1a53-4a58-afef-20eb1951a7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:32.542382 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f71c9d-1a53-4a58-afef-20eb1951a7cc None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:32.542662 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f71c9d-1a53-4a58-afef-20eb1951a7cc None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:32.542935 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f71c9d-1a53-4a58-afef-20eb1951a7cc None admin] PATH_INFO: `/v3/projects/e8f0f02a607a49e0b88c75019795b726/users/b4f9a2bba0e748b6a98fa7dea2482ddf/roles/9102b6e1623a43e99513d6ad55d55c7b` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:32.556741 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f71c9d-1a53-4a58-afef-20eb1951a7cc None admin] RBAC: Authorizing `identity:create_grant(project_id=e8f0f02a607a49e0b88c75019795b726, user_id=b4f9a2bba0e748b6a98fa7dea2482ddf, role_id=9102b6e1623a43e99513d6ad55d55c7b)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:32.558172 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f71c9d-1a53-4a58-afef-20eb1951a7cc None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:32.651720 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 464/923] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 26 10:53:32 2022] PUT /identity/v3/projects/e8f0f02a607a49e0b88c75019795b726/users/b4f9a2bba0e748b6a98fa7dea2482ddf/roles/9102b6e1623a43e99513d6ad55d55c7b => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:53:34.797024 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4971b-bad9-4a04-9915-2760150c8947 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:34.797569 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4971b-bad9-4a04-9915-2760150c8947 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:34.797569 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4971b-bad9-4a04-9915-2760150c8947 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:34.798937 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 460/924] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:53:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:34.804301 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d7bb7-c836-432c-8cd0-74d938b953c5 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:34.809829 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d7bb7-c836-432c-8cd0-74d938b953c5 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:34.809829 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d7bb7-c836-432c-8cd0-74d938b953c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:34.822436 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-1b1d7bb7-c836-432c-8cd0-74d938b953c5 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:34.823608 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1b1d7bb7-c836-432c-8cd0-74d938b953c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:34.889323 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 465/925] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:53:35.158224 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4971b-bad9-4a04-9915-2760150c8947 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:35.258789 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4971b-bad9-4a04-9915-2760150c8947 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:35.291959 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781fd39-39ce-44e4-8dfc-dfc904488720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:35.292600 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781fd39-39ce-44e4-8dfc-dfc904488720 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:35.292886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781fd39-39ce-44e4-8dfc-dfc904488720 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:35.293156 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781fd39-39ce-44e4-8dfc-dfc904488720 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:35.300116 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:35.303982 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8781fd39-39ce-44e4-8dfc-dfc904488720 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:53:35.308664 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-8781fd39-39ce-44e4-8dfc-dfc904488720 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:53:35.308664 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:35.308664 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:35.308664 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:35.308664 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:35.308664 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:35.308664 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:35.308664 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:35.308664 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:35.308664 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:35.308664 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:35.308664 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:35.308664 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:53:35.308664 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:53:35.308664 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:53:35.308664 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:53:35.309741 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:53:35.309741 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:53:35.309741 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:53:35.309741 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:53:35.309741 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:35.309741 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:35.309741 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:35.309741 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:35.309741 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:35.309741 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:35.309741 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:35.309741 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:35.309741 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:35.309741 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:35.309741 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:35.309741 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:35.310709 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:35.310709 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:35.310709 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:35.310709 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:35.310709 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:53:35.310709 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:53:35.310709 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:53:35.310709 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:53:35.310709 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:53:35.310709 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:53:35.310709 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:53:35.310709 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:53:35.310709 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 461/926] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Oct 26 10:53:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:35.316354 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d7bb7-c836-432c-8cd0-74d938b953c5 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:35.370563 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:35.415538 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d7bb7-c836-432c-8cd0-74d938b953c5 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:35.448441 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a14ccd-a5c8-4655-94fd-7c96ff249eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:35.449038 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a14ccd-a5c8-4655-94fd-7c96ff249eed None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:35.449318 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a14ccd-a5c8-4655-94fd-7c96ff249eed None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:35.449590 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a14ccd-a5c8-4655-94fd-7c96ff249eed None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:35.450239 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a14ccd-a5c8-4655-94fd-7c96ff249eed None admin] RBAC: Adding query filter params (name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:35.450542 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a14ccd-a5c8-4655-94fd-7c96ff249eed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:35.451970 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a14ccd-a5c8-4655-94fd-7c96ff249eed None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:35.459545 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 466/927] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Oct 26 10:53:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:35.465442 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781fd39-39ce-44e4-8dfc-dfc904488720 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:35.563811 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781fd39-39ce-44e4-8dfc-dfc904488720 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:35.597653 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bbd3bc-dd26-41e6-947b-e9c172396d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:35.598290 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbd3bc-dd26-41e6-947b-e9c172396d63 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:35.598598 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbd3bc-dd26-41e6-947b-e9c172396d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:35.598878 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbd3bc-dd26-41e6-947b-e9c172396d63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:35.608676 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bbd3bc-dd26-41e6-947b-e9c172396d63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:35.610122 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bbd3bc-dd26-41e6-947b-e9c172396d63 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:35.624563 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-19bbd3bc-dd26-41e6-947b-e9c172396d63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:53:35.624563 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:35.624563 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:35.624563 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:35.624563 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:35.624563 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:35.624563 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:35.624563 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:35.624563 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:35.624563 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:35.624563 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:35.624563 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:35.624563 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:53:35.624563 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:53:35.624563 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:53:35.624563 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:53:35.633605 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:35.633605 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:35.633605 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:35.633605 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:35.633605 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:35.633605 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:35.633605 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:35.633605 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:35.633605 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:35.633605 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:35.633605 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:35.633605 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:35.633605 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:35.633605 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:35.633605 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:35.633605 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:35.633605 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:53:35.634583 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:53:35.634583 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:53:35.634583 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:53:35.634583 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 462/928] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:53:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:35.634827 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a14ccd-a5c8-4655-94fd-7c96ff249eed None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:35.730545 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a14ccd-a5c8-4655-94fd-7c96ff249eed None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:35.745951 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:35.762810 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc113e4c-ca64-43ba-be20-bc6cd450dd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:35.763436 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc113e4c-ca64-43ba-be20-bc6cd450dd87 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:35.763713 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc113e4c-ca64-43ba-be20-bc6cd450dd87 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:35.763982 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc113e4c-ca64-43ba-be20-bc6cd450dd87 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:35.764648 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc113e4c-ca64-43ba-be20-bc6cd450dd87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:35.764950 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc113e4c-ca64-43ba-be20-bc6cd450dd87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:35.766335 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc113e4c-ca64-43ba-be20-bc6cd450dd87 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:35.778451 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 467/929] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:35.784927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bbd3bc-dd26-41e6-947b-e9c172396d63 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:35.835459 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:35.883869 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bbd3bc-dd26-41e6-947b-e9c172396d63 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:35.916728 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a6695-8db3-4a3a-9ff2-edcf13aadef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:35.917379 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a6695-8db3-4a3a-9ff2-edcf13aadef0 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:35.917656 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a6695-8db3-4a3a-9ff2-edcf13aadef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:35.917929 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a6695-8db3-4a3a-9ff2-edcf13aadef0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:35.925526 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a6695-8db3-4a3a-9ff2-edcf13aadef0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:35.926947 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a6695-8db3-4a3a-9ff2-edcf13aadef0 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:35.937716 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-b66a6695-8db3-4a3a-9ff2-edcf13aadef0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 26 10:53:35.937716 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:35.937716 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:35.937716 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:35.937716 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:35.937716 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:35.937716 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:35.937716 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:35.937716 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:35.937716 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:35.937716 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:35.937716 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:35.937716 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:53:35.937716 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:53:35.937716 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:53:35.937716 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:53:35.939308 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:35.939308 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:35.939308 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:53:35.939308 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:53:35.939308 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:53:35.939308 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:53:35.939308 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:35.939308 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:35.939308 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:35.939308 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:35.939308 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:35.939308 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:35.939308 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:35.939308 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:35.939308 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:35.939308 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:35.939308 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:35.939308 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:35.940612 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:35.940612 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:35.940612 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:53:35.940612 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:53:35.940612 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:53:35.940612 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:53:35.940612 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:53:35.940612 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:53:35.940612 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 26 10:53:35.940612 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:53:35.940612 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 463/930] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:53:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:35.945284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc113e4c-ca64-43ba-be20-bc6cd450dd87 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:36.041712 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc113e4c-ca64-43ba-be20-bc6cd450dd87 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:36.075260 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e327de-2ef5-4d9f-be18-a240f9662558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:36.075864 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e327de-2ef5-4d9f-be18-a240f9662558 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:36.076176 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e327de-2ef5-4d9f-be18-a240f9662558 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:36.076458 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e327de-2ef5-4d9f-be18-a240f9662558 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:36.077190 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e327de-2ef5-4d9f-be18-a240f9662558 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:36.077499 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e327de-2ef5-4d9f-be18-a240f9662558 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:36.078930 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e327de-2ef5-4d9f-be18-a240f9662558 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:36.096846 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 468/931] 10.222.0.45 () {56 vars in 1143 bytes} [Wed Oct 26 10:53:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:36.102700 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a6695-8db3-4a3a-9ff2-edcf13aadef0 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:36.201672 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a6695-8db3-4a3a-9ff2-edcf13aadef0 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:36.212179 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:36.234379 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e0fab-d754-404e-8107-c7c764d690e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:36.234979 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e0fab-d754-404e-8107-c7c764d690e6 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:36.235260 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e0fab-d754-404e-8107-c7c764d690e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:36.235558 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e0fab-d754-404e-8107-c7c764d690e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:36.299946 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e0fab-d754-404e-8107-c7c764d690e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:36.301359 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e0fab-d754-404e-8107-c7c764d690e6 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:36.396988 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 464/932] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 26 10:53:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 26 10:53:36.402742 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e327de-2ef5-4d9f-be18-a240f9662558 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:36.436685 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:36.499281 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e327de-2ef5-4d9f-be18-a240f9662558 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:36.531549 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fc92e-fbaa-4efd-b0b8-e22715d925c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:36.543611 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fc92e-fbaa-4efd-b0b8-e22715d925c8 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:36.543611 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fc92e-fbaa-4efd-b0b8-e22715d925c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:36.543611 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fc92e-fbaa-4efd-b0b8-e22715d925c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:36.543611 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8fc92e-fbaa-4efd-b0b8-e22715d925c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:36.543941 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8fc92e-fbaa-4efd-b0b8-e22715d925c8 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:36.558420 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-ea8fc92e-fbaa-4efd-b0b8-e22715d925c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:53:36.558420 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:36.558420 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:36.558420 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:36.558420 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:36.558420 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:36.558420 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:36.558420 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:36.558420 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:36.558420 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:36.558420 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:36.558420 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:36.558420 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:53:36.558420 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:53:36.558420 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:53:36.558420 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:53:36.564097 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:36.564097 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:36.564097 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:36.564097 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:36.564097 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:36.564097 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:36.564097 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:36.564097 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:36.564097 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:36.564097 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:36.564097 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:36.564097 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:36.564097 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:36.564097 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:36.564097 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:36.564097 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:36.564097 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:53:36.565283 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:53:36.565283 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:53:36.565283 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:53:36.565283 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 469/933] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:53:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:36.566831 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e0fab-d754-404e-8107-c7c764d690e6 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:36.578256 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:36.662973 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e0fab-d754-404e-8107-c7c764d690e6 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:36.696034 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff6727-8d8c-463d-8bfb-91e63bd04a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:36.696661 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff6727-8d8c-463d-8bfb-91e63bd04a2f None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:36.696946 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff6727-8d8c-463d-8bfb-91e63bd04a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:36.697217 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff6727-8d8c-463d-8bfb-91e63bd04a2f None admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:36.697849 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff6727-8d8c-463d-8bfb-91e63bd04a2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:36.698149 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff6727-8d8c-463d-8bfb-91e63bd04a2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:36.699490 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff6727-8d8c-463d-8bfb-91e63bd04a2f None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:36.711231 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 465/934] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:53:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:36.718482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fc92e-fbaa-4efd-b0b8-e22715d925c8 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:36.803478 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:36.818936 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fc92e-fbaa-4efd-b0b8-e22715d925c8 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:36.852819 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d5f41-322d-4834-9eb6-3508d2ced1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:36.853469 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d5f41-322d-4834-9eb6-3508d2ced1c4 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:36.853747 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d5f41-322d-4834-9eb6-3508d2ced1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:36.854021 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d5f41-322d-4834-9eb6-3508d2ced1c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:36.861110 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d5f41-322d-4834-9eb6-3508d2ced1c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:36.862566 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d5f41-322d-4834-9eb6-3508d2ced1c4 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:36.873527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-850d5f41-322d-4834-9eb6-3508d2ced1c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:53:36.873527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:36.873527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:36.873527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:36.873527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:36.873527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:36.873527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:36.873527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:36.873527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:36.873527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:36.873527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:36.873527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:36.873527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:53:36.873527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:53:36.873527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:53:36.874540 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:53:36.874540 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:36.874540 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:36.874540 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:36.874540 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:36.874540 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:36.874540 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:36.874540 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:36.874540 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:36.874540 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:36.874540 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:36.874540 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:36.874540 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:36.874540 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:36.874540 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:36.874540 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:36.874540 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:36.875791 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:53:36.875791 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:53:36.875791 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:53:36.875791 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:53:36.875791 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:53:36.875791 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:53:36.875791 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:53:36.875791 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:53:36.875791 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 470/935] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 26 10:53:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:36.880573 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff6727-8d8c-463d-8bfb-91e63bd04a2f None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:36.948705 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:36.977979 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff6727-8d8c-463d-8bfb-91e63bd04a2f None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:37.009764 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f1675-81b0-46a3-abb6-d6b7d9141d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:37.010364 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f1675-81b0-46a3-abb6-d6b7d9141d61 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:37.010654 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f1675-81b0-46a3-abb6-d6b7d9141d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:37.010953 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f1675-81b0-46a3-abb6-d6b7d9141d61 None admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:37.011630 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f1675-81b0-46a3-abb6-d6b7d9141d61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:37.011933 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f1675-81b0-46a3-abb6-d6b7d9141d61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:37.013396 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f1675-81b0-46a3-abb6-d6b7d9141d61 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:37.025435 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 466/936] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 26 10:53:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:37.031611 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d5f41-322d-4834-9eb6-3508d2ced1c4 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:37.128774 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d5f41-322d-4834-9eb6-3508d2ced1c4 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:37.162726 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5b83f-e05e-4f9c-b37d-5f71dedc29ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:37.163354 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5b83f-e05e-4f9c-b37d-5f71dedc29ab None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:37.163638 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5b83f-e05e-4f9c-b37d-5f71dedc29ab None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:37.163912 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5b83f-e05e-4f9c-b37d-5f71dedc29ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:37.164659 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5b83f-e05e-4f9c-b37d-5f71dedc29ab None admin] RBAC: Adding query filter params (role.id=9102b6e1623a43e99513d6ad55d55c7b, scope.project.id=e8f0f02a607a49e0b88c75019795b726, user.id=b4f9a2bba0e748b6a98fa7dea2482ddf) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:37.164967 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5b83f-e05e-4f9c-b37d-5f71dedc29ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:37.166398 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5b83f-e05e-4f9c-b37d-5f71dedc29ab None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:37.172271 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 471/937] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 26 10:53:37 2022] GET /identity/v3/role_assignments?user.id=b4f9a2bba0e748b6a98fa7dea2482ddf&scope.project.id=e8f0f02a607a49e0b88c75019795b726&role.id=9102b6e1623a43e99513d6ad55d55c7b => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:53:39.343296 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae27bb-7760-4bde-855b-fc5ad646d14b None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:39.343795 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae27bb-7760-4bde-855b-fc5ad646d14b None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:39.343890 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae27bb-7760-4bde-855b-fc5ad646d14b None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:39.345236 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 467/938] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:39.350543 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614317e-a2fe-4fa5-8af0-aed525a6dd3b None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:39.350939 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614317e-a2fe-4fa5-8af0-aed525a6dd3b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:39.351105 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614317e-a2fe-4fa5-8af0-aed525a6dd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:39.369506 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-9614317e-a2fe-4fa5-8af0-aed525a6dd3b None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:39.370819 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9614317e-a2fe-4fa5-8af0-aed525a6dd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:39.373575 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:39.435116 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 472/939] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:53:39.702249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae27bb-7760-4bde-855b-fc5ad646d14b None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:39.802417 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae27bb-7760-4bde-855b-fc5ad646d14b None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:39.830093 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:39.835824 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610768f-28eb-460f-a1d7-08de2500ccfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:39.836485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610768f-28eb-460f-a1d7-08de2500ccfd None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:39.836768 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610768f-28eb-460f-a1d7-08de2500ccfd None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:39.837044 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610768f-28eb-460f-a1d7-08de2500ccfd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:39.847299 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1610768f-28eb-460f-a1d7-08de2500ccfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:53:39.852101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-1610768f-28eb-460f-a1d7-08de2500ccfd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:53:39.852101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:39.852101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:39.852101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:39.852101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:39.852101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:39.852101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:39.852101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:39.852101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:39.852101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:39.852101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:39.852101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:39.852101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:53:39.852101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:53:39.852101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:53:39.852101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:53:39.853234 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:53:39.853234 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:53:39.853234 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:53:39.853234 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:53:39.853234 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:39.853234 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:39.853234 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:39.853234 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:39.853234 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:39.853234 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:39.853234 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:39.853234 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:39.853234 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:39.853234 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:39.853234 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:39.853234 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:39.854142 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:39.854142 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:39.854142 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:39.854142 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:39.854142 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:53:39.854142 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:53:39.854142 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:53:39.854142 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:53:39.854142 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:53:39.854142 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:53:39.854142 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:53:39.854142 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:53:39.854142 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 468/940] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 26 10:53:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:39.859191 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614317e-a2fe-4fa5-8af0-aed525a6dd3b None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:39.955915 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614317e-a2fe-4fa5-8af0-aed525a6dd3b None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:39.990410 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e5934d-bc2d-4410-8f19-e47b2a092e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:39.991018 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5934d-bc2d-4410-8f19-e47b2a092e38 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:39.991297 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5934d-bc2d-4410-8f19-e47b2a092e38 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:39.991569 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5934d-bc2d-4410-8f19-e47b2a092e38 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:39.992253 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e5934d-bc2d-4410-8f19-e47b2a092e38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:39.992555 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e5934d-bc2d-4410-8f19-e47b2a092e38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:39.994018 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e5934d-bc2d-4410-8f19-e47b2a092e38 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:40.002009 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 473/941] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 26 10:53:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:40.007802 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610768f-28eb-460f-a1d7-08de2500ccfd None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:40.107096 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610768f-28eb-460f-a1d7-08de2500ccfd None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:40.139863 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97463a4e-c420-48b7-927d-a833b088bdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:40.140513 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97463a4e-c420-48b7-927d-a833b088bdd2 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:40.140790 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97463a4e-c420-48b7-927d-a833b088bdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:40.141059 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97463a4e-c420-48b7-927d-a833b088bdd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:40.151617 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97463a4e-c420-48b7-927d-a833b088bdd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:40.153086 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97463a4e-c420-48b7-927d-a833b088bdd2 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:40.167835 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-97463a4e-c420-48b7-927d-a833b088bdd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:53:40.167835 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:40.167835 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:40.167835 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:40.167835 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:40.167835 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:40.167835 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:40.167835 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:40.167835 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:40.167835 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:40.167835 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:40.167835 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:40.167835 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:53:40.167835 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:53:40.167835 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:53:40.167835 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:53:40.168965 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:40.168965 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:40.168965 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:40.168965 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:40.168965 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:40.168965 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:40.168965 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:40.168965 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:40.168965 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:40.168965 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:40.168965 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:40.168965 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:40.168965 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:40.168965 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:40.168965 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:40.168965 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:40.168965 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:53:40.170249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:53:40.170249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:53:40.170249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:53:40.170249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 469/942] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:53:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:40.174996 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e5934d-bc2d-4410-8f19-e47b2a092e38 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:40.177942 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:40.272469 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e5934d-bc2d-4410-8f19-e47b2a092e38 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:40.305534 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b3416-5197-4a67-afbc-3b4e8f09685a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:40.306134 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b3416-5197-4a67-afbc-3b4e8f09685a None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:40.306419 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b3416-5197-4a67-afbc-3b4e8f09685a None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:40.306692 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b3416-5197-4a67-afbc-3b4e8f09685a None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:40.307351 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b3416-5197-4a67-afbc-3b4e8f09685a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:40.307652 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b3416-5197-4a67-afbc-3b4e8f09685a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:40.309051 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b3416-5197-4a67-afbc-3b4e8f09685a None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:40.321020 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 474/943] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:40.326726 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97463a4e-c420-48b7-927d-a833b088bdd2 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:40.368796 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:40.422944 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97463a4e-c420-48b7-927d-a833b088bdd2 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:40.455422 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8cd7c2-eda4-4246-a72e-9a7f20f505ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:40.456039 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cd7c2-eda4-4246-a72e-9a7f20f505ad None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:40.456382 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cd7c2-eda4-4246-a72e-9a7f20f505ad None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:40.456650 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cd7c2-eda4-4246-a72e-9a7f20f505ad None admin] PATH_INFO: `/v3/users/placement` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:40.463633 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8cd7c2-eda4-4246-a72e-9a7f20f505ad None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:40.465090 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8cd7c2-eda4-4246-a72e-9a7f20f505ad None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:40.477471 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-db8cd7c2-eda4-4246-a72e-9a7f20f505ad None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 26 10:53:40.477471 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:40.477471 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:40.477471 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:40.477471 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:40.477471 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:40.477471 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:40.477471 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:40.477471 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:40.477471 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:40.477471 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:40.477471 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:40.477471 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:53:40.477471 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:53:40.477471 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:53:40.477471 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:53:40.478625 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:40.478625 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:40.478625 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:53:40.478625 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:53:40.478625 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:53:40.478625 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:53:40.478625 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:40.478625 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:40.478625 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:40.478625 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:40.478625 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:40.478625 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:40.478625 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:40.478625 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:40.478625 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:40.478625 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:40.478625 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:40.478625 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:40.479955 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:40.479955 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:40.479955 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:53:40.479955 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:53:40.479955 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:53:40.479955 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:53:40.479955 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:53:40.479955 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:53:40.479955 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 26 10:53:40.479955 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:53:40.479955 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 470/944] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:53:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:40.484830 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b3416-5197-4a67-afbc-3b4e8f09685a None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:40.546798 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:40.584164 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b3416-5197-4a67-afbc-3b4e8f09685a None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:40.617206 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a972f0-ee2d-4d20-9c69-e7607a97187d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:40.617811 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a972f0-ee2d-4d20-9c69-e7607a97187d None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:40.618094 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a972f0-ee2d-4d20-9c69-e7607a97187d None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:40.618369 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a972f0-ee2d-4d20-9c69-e7607a97187d None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:40.619080 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a972f0-ee2d-4d20-9c69-e7607a97187d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:40.619385 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a972f0-ee2d-4d20-9c69-e7607a97187d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:40.620835 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a972f0-ee2d-4d20-9c69-e7607a97187d None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:40.637094 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 475/945] 10.222.0.45 () {56 vars in 1143 bytes} [Wed Oct 26 10:53:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:40.642917 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8cd7c2-eda4-4246-a72e-9a7f20f505ad None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:40.741242 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8cd7c2-eda4-4246-a72e-9a7f20f505ad None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:40.742738 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:40.775842 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285839f-4a25-4d21-9d4f-a27eab588691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:40.776524 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285839f-4a25-4d21-9d4f-a27eab588691 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:40.776820 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285839f-4a25-4d21-9d4f-a27eab588691 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:40.777096 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285839f-4a25-4d21-9d4f-a27eab588691 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:40.787356 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6285839f-4a25-4d21-9d4f-a27eab588691 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:40.788852 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6285839f-4a25-4d21-9d4f-a27eab588691 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:40.803187 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-6285839f-4a25-4d21-9d4f-a27eab588691 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:53:40.803187 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:40.803187 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:40.803187 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:40.803187 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:40.803187 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:40.803187 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:40.803187 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:40.803187 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:40.803187 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:40.803187 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:40.803187 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:40.803187 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:53:40.803187 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:53:40.803187 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:53:40.803187 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:53:40.804375 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:40.804375 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:40.804375 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:40.804375 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:40.804375 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:40.804375 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:40.804375 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:40.804375 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:40.804375 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:40.804375 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:40.804375 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:40.804375 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:40.804375 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:40.804375 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:40.804375 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:40.804375 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:40.804375 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:53:40.805651 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:53:40.805651 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:53:40.805651 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:53:40.805651 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 471/946] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:53:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:40.810015 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a972f0-ee2d-4d20-9c69-e7607a97187d None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:40.908730 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a972f0-ee2d-4d20-9c69-e7607a97187d None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:40.928230 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:40.941914 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459426d-e516-4b57-b61b-a0ba6bd94267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:40.942522 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459426d-e516-4b57-b61b-a0ba6bd94267 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:40.942806 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459426d-e516-4b57-b61b-a0ba6bd94267 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:40.943084 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459426d-e516-4b57-b61b-a0ba6bd94267 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:40.943721 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6459426d-e516-4b57-b61b-a0ba6bd94267 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:40.944027 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6459426d-e516-4b57-b61b-a0ba6bd94267 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:40.945430 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6459426d-e516-4b57-b61b-a0ba6bd94267 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:40.956865 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 476/947] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:40.962625 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285839f-4a25-4d21-9d4f-a27eab588691 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:41.061589 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285839f-4a25-4d21-9d4f-a27eab588691 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:41.095517 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5275ce3-c7bc-4593-9237-48b62ce5232a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:41.096165 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5275ce3-c7bc-4593-9237-48b62ce5232a None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:41.096448 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5275ce3-c7bc-4593-9237-48b62ce5232a None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:41.096771 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5275ce3-c7bc-4593-9237-48b62ce5232a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:41.103194 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5275ce3-c7bc-4593-9237-48b62ce5232a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:41.104664 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5275ce3-c7bc-4593-9237-48b62ce5232a None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:41.115618 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-d5275ce3-c7bc-4593-9237-48b62ce5232a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:53:41.115618 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:41.115618 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:41.115618 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:41.115618 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:41.115618 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:41.115618 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:41.115618 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:41.115618 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:41.115618 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:41.115618 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:41.115618 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:41.115618 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:53:41.115618 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:53:41.115618 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:53:41.116714 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:53:41.116714 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:41.116714 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:41.116714 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:41.116714 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:41.116714 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:41.116714 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:41.116714 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:41.116714 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:41.116714 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:41.116714 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:41.116714 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:41.116714 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:41.116714 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:41.116714 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:41.116714 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:41.116714 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:41.117834 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:53:41.117834 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:53:41.117834 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:53:41.117834 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:53:41.117834 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:53:41.117834 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:53:41.117834 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:53:41.117834 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:53:41.117834 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 472/948] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 26 10:53:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:41.122784 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459426d-e516-4b57-b61b-a0ba6bd94267 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:41.222789 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459426d-e516-4b57-b61b-a0ba6bd94267 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:41.255411 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f17c18-85cd-4c5e-a7c5-bcd70c9c6abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:41.256014 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f17c18-85cd-4c5e-a7c5-bcd70c9c6abd None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:41.256324 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f17c18-85cd-4c5e-a7c5-bcd70c9c6abd None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:41.256603 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f17c18-85cd-4c5e-a7c5-bcd70c9c6abd None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:41.257291 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f17c18-85cd-4c5e-a7c5-bcd70c9c6abd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:41.257593 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f17c18-85cd-4c5e-a7c5-bcd70c9c6abd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:41.259024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f17c18-85cd-4c5e-a7c5-bcd70c9c6abd None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:41.271443 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 477/949] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 26 10:53:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:41.277436 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5275ce3-c7bc-4593-9237-48b62ce5232a None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:41.293414 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:41.374659 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5275ce3-c7bc-4593-9237-48b62ce5232a None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:41.407912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4517ab-211c-40d4-ae9a-fa3d98fe1a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:41.408604 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4517ab-211c-40d4-ae9a-fa3d98fe1a31 None admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:41.408870 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4517ab-211c-40d4-ae9a-fa3d98fe1a31 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:41.409139 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4517ab-211c-40d4-ae9a-fa3d98fe1a31 None admin] PATH_INFO: `/v3/projects/e8f0f02a607a49e0b88c75019795b726/users/b4f9a2bba0e748b6a98fa7dea2482ddf/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:41.411268 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4517ab-211c-40d4-ae9a-fa3d98fe1a31 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8f0f02a607a49e0b88c75019795b726, user_id=b4f9a2bba0e748b6a98fa7dea2482ddf, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:41.413832 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4517ab-211c-40d4-ae9a-fa3d98fe1a31 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:41.503639 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 473/950] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 26 10:53:41 2022] PUT /identity/v3/projects/e8f0f02a607a49e0b88c75019795b726/users/b4f9a2bba0e748b6a98fa7dea2482ddf/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:53:43.636115 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372ee72-0dff-416f-8669-4a16e3d577c8 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:43.636661 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372ee72-0dff-416f-8669-4a16e3d577c8 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:43.636661 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372ee72-0dff-416f-8669-4a16e3d577c8 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:43.637931 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 478/951] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:53:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:43.643918 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a289154-955b-4321-80cc-6eca976aa949 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:43.649196 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a289154-955b-4321-80cc-6eca976aa949 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:43.649196 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a289154-955b-4321-80cc-6eca976aa949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:43.662625 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-8a289154-955b-4321-80cc-6eca976aa949 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:43.663805 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-8a289154-955b-4321-80cc-6eca976aa949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:43.728752 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 474/952] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 26 10:53:43.997343 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372ee72-0dff-416f-8669-4a16e3d577c8 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:44.040316 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:44.097496 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372ee72-0dff-416f-8669-4a16e3d577c8 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:44.129428 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f66c2-1844-48f6-9970-bf7c074254e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:44.130048 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f66c2-1844-48f6-9970-bf7c074254e8 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:44.130328 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f66c2-1844-48f6-9970-bf7c074254e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:44.130600 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f66c2-1844-48f6-9970-bf7c074254e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:44.140341 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f66c2-1844-48f6-9970-bf7c074254e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:53:44.145770 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-873f66c2-1844-48f6-9970-bf7c074254e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:53:44.145770 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:44.145770 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:44.145770 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:44.145770 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:44.145770 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:44.145770 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:44.145770 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:44.145770 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:44.145770 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:44.145770 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:44.145770 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:44.145770 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:53:44.145770 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:53:44.145770 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:53:44.145770 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:53:44.146881 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:53:44.146881 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:53:44.146881 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:53:44.146881 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:53:44.146881 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:44.146881 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:44.146881 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:44.146881 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:44.146881 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:44.146881 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:44.146881 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:44.146881 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:44.146881 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:44.146881 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:44.146881 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:44.146881 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:44.147977 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:44.147977 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:44.147977 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:44.147977 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:44.147977 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:53:44.147977 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:53:44.147977 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:53:44.147977 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:53:44.147977 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:53:44.147977 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:53:44.147977 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:53:44.147977 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:53:44.147977 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 479/953] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 26 10:53:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:44.152979 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a289154-955b-4321-80cc-6eca976aa949 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:44.156042 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:44.249853 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a289154-955b-4321-80cc-6eca976aa949 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:44.282905 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21bdeb-d8a9-4894-9ca2-10d9e0d8e0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:44.283512 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21bdeb-d8a9-4894-9ca2-10d9e0d8e0e0 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:44.283791 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21bdeb-d8a9-4894-9ca2-10d9e0d8e0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:44.284080 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21bdeb-d8a9-4894-9ca2-10d9e0d8e0e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:44.284758 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21bdeb-d8a9-4894-9ca2-10d9e0d8e0e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:44.285064 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21bdeb-d8a9-4894-9ca2-10d9e0d8e0e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:44.286447 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21bdeb-d8a9-4894-9ca2-10d9e0d8e0e0 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:44.294420 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 475/954] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 26 10:53:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:44.300608 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f66c2-1844-48f6-9970-bf7c074254e8 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:44.396297 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:44.399148 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f66c2-1844-48f6-9970-bf7c074254e8 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:44.433452 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3005c539-4f7a-4d05-98f3-e80a0772623e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:44.434078 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005c539-4f7a-4d05-98f3-e80a0772623e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:44.434358 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005c539-4f7a-4d05-98f3-e80a0772623e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:44.434631 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005c539-4f7a-4d05-98f3-e80a0772623e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:44.444164 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3005c539-4f7a-4d05-98f3-e80a0772623e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:44.445601 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3005c539-4f7a-4d05-98f3-e80a0772623e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:44.459863 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-3005c539-4f7a-4d05-98f3-e80a0772623e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:53:44.459863 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:44.459863 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:44.459863 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:44.459863 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:44.459863 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:44.459863 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:44.459863 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:44.459863 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:44.459863 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:44.459863 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:44.459863 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:44.459863 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:53:44.459863 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:53:44.459863 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:53:44.459863 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:53:44.464591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:44.464591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:44.464591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:44.464591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:44.464591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:44.464591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:44.464591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:44.464591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:44.464591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:44.464591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:44.464591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:44.464591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:44.464591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:44.464591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:44.464591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:44.464591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:44.464591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:53:44.465732 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:53:44.465732 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:53:44.465732 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:53:44.465732 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 480/955] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:53:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:44.466885 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21bdeb-d8a9-4894-9ca2-10d9e0d8e0e0 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:44.531010 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:44.564721 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21bdeb-d8a9-4894-9ca2-10d9e0d8e0e0 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:44.597387 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a83bf-6668-4981-9268-8881468cd7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:44.597997 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a83bf-6668-4981-9268-8881468cd7b3 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:44.598273 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a83bf-6668-4981-9268-8881468cd7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:44.598552 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a83bf-6668-4981-9268-8881468cd7b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:44.599187 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a83bf-6668-4981-9268-8881468cd7b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:44.599493 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a83bf-6668-4981-9268-8881468cd7b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:44.601009 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a83bf-6668-4981-9268-8881468cd7b3 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:44.612869 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 476/956] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:44.618628 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3005c539-4f7a-4d05-98f3-e80a0772623e None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:44.717707 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3005c539-4f7a-4d05-98f3-e80a0772623e None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:44.750401 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f59c37-3578-463e-ad3d-db50e9456c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:44.751052 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f59c37-3578-463e-ad3d-db50e9456c86 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:44.751334 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f59c37-3578-463e-ad3d-db50e9456c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:44.751607 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f59c37-3578-463e-ad3d-db50e9456c86 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:44.762462 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f59c37-3578-463e-ad3d-db50e9456c86 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:44.763909 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f59c37-3578-463e-ad3d-db50e9456c86 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:44.776417 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-c9f59c37-3578-463e-ad3d-db50e9456c86 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 26 10:53:44.776417 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:44.776417 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:44.776417 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:44.776417 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:44.776417 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:44.776417 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:44.776417 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:44.776417 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:44.776417 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:44.776417 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:44.776417 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:44.776417 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:53:44.776417 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:53:44.776417 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:53:44.776417 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:53:44.777595 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:44.777595 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:44.777595 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:53:44.777595 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:53:44.777595 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:53:44.777595 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:53:44.777595 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:44.777595 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:44.777595 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:44.777595 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:44.777595 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:44.777595 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:44.777595 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:44.777595 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:44.777595 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:44.777595 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:44.777595 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:44.777595 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:44.778968 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:44.778968 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:44.778968 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:53:44.778968 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:53:44.778968 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:53:44.778968 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:53:44.778968 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:53:44.778968 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:53:44.778968 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 26 10:53:44.778968 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:53:44.778968 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 481/957] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:53:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:44.784616 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a83bf-6668-4981-9268-8881468cd7b3 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:44.881286 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a83bf-6668-4981-9268-8881468cd7b3 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:44.906642 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:44.915704 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4d749-c0c5-4c1e-b0d6-91c150cf7c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:44.916332 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4d749-c0c5-4c1e-b0d6-91c150cf7c72 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:44.916610 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4d749-c0c5-4c1e-b0d6-91c150cf7c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:44.916879 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4d749-c0c5-4c1e-b0d6-91c150cf7c72 None admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:44.917585 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c4d749-c0c5-4c1e-b0d6-91c150cf7c72 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:44.917883 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c4d749-c0c5-4c1e-b0d6-91c150cf7c72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:44.919348 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c4d749-c0c5-4c1e-b0d6-91c150cf7c72 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:44.935840 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 477/958] 10.222.0.45 () {56 vars in 1143 bytes} [Wed Oct 26 10:53:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:44.942305 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f59c37-3578-463e-ad3d-db50e9456c86 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:44.958079 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:45.039180 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f59c37-3578-463e-ad3d-db50e9456c86 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:45.071803 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904cf73-203f-4e95-903a-bc55ed668f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:45.072427 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904cf73-203f-4e95-903a-bc55ed668f8b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:45.072710 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904cf73-203f-4e95-903a-bc55ed668f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:45.072986 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904cf73-203f-4e95-903a-bc55ed668f8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:45.138563 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7904cf73-203f-4e95-903a-bc55ed668f8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:45.140005 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7904cf73-203f-4e95-903a-bc55ed668f8b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:45.153417 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:45.235137 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 482/959] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 26 10:53:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 26 10:53:45.241064 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4d749-c0c5-4c1e-b0d6-91c150cf7c72 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:45.338125 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4d749-c0c5-4c1e-b0d6-91c150cf7c72 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:45.371752 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681d14a-281e-49f3-b059-d10f733c7b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:45.372401 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681d14a-281e-49f3-b059-d10f733c7b75 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:45.372677 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681d14a-281e-49f3-b059-d10f733c7b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:45.372945 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681d14a-281e-49f3-b059-d10f733c7b75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:45.383252 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681d14a-281e-49f3-b059-d10f733c7b75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:45.384715 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681d14a-281e-49f3-b059-d10f733c7b75 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:45.398840 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-9681d14a-281e-49f3-b059-d10f733c7b75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:53:45.398840 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:45.398840 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:45.398840 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:45.398840 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:45.398840 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:45.398840 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:45.398840 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:45.398840 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:45.398840 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:45.398840 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:45.398840 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:45.398840 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:53:45.398840 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:53:45.398840 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:53:45.398840 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:53:45.400013 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:45.400013 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:45.400013 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:45.400013 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:45.400013 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:45.400013 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:45.400013 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:45.400013 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:45.400013 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:45.400013 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:45.400013 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:45.400013 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:45.400013 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:45.400013 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:45.400013 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:45.400013 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:45.400013 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:53:45.400981 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:53:45.400981 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:53:45.400981 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:53:45.400981 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 478/960] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 10:53:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:45.405768 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904cf73-203f-4e95-903a-bc55ed668f8b None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:45.503469 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904cf73-203f-4e95-903a-bc55ed668f8b None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:45.516785 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:45.537142 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13eeaa-3300-4e29-badb-ee72cb1e38c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:45.537748 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13eeaa-3300-4e29-badb-ee72cb1e38c3 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:45.538028 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13eeaa-3300-4e29-badb-ee72cb1e38c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:45.538301 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13eeaa-3300-4e29-badb-ee72cb1e38c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:45.538932 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c13eeaa-3300-4e29-badb-ee72cb1e38c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:45.539233 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c13eeaa-3300-4e29-badb-ee72cb1e38c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:45.540640 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c13eeaa-3300-4e29-badb-ee72cb1e38c3 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:45.553013 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 483/961] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 26 10:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:45.558767 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681d14a-281e-49f3-b059-d10f733c7b75 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:45.593263 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:45.655903 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681d14a-281e-49f3-b059-d10f733c7b75 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:45.689193 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb532d-d951-4590-8ce4-78c873bd7365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:45.689804 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb532d-d951-4590-8ce4-78c873bd7365 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:45.690089 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb532d-d951-4590-8ce4-78c873bd7365 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:45.690363 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb532d-d951-4590-8ce4-78c873bd7365 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:45.697527 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb532d-d951-4590-8ce4-78c873bd7365 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:45.698969 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb532d-d951-4590-8ce4-78c873bd7365 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:45.709927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application [None req-53fb532d-d951-4590-8ce4-78c873bd7365 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:53:45.709927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:45.709927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:45.709927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:45.709927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:45.709927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:45.709927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:45.709927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:45.709927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:45.709927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:45.709927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:45.709927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:45.709927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:53:45.709927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:53:45.709927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:53:45.710979 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:53:45.710979 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:45.710979 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:45.710979 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:45.710979 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:45.710979 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:45.710979 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:45.710979 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:45.710979 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:45.710979 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:45.710979 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:45.710979 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:45.710979 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:45.710979 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:45.710979 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:45.710979 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:45.710979 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:45.711902 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:53:45.711902 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:53:45.711902 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:53:45.711902 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:53:45.711902 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:53:45.711902 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:53:45.711902 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:53:45.711902 dv-cinder-862679-1-smb devstack@keystone.service[81622]: ERROR keystone.server.flask.application Oct 26 10:53:45.711902 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 479/962] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 26 10:53:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:45.717166 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13eeaa-3300-4e29-badb-ee72cb1e38c3 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:45.816693 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13eeaa-3300-4e29-badb-ee72cb1e38c3 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:45.850062 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe0a0f-09a3-479c-8809-8a3a2dec8190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:45.850591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe0a0f-09a3-479c-8809-8a3a2dec8190 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:45.850873 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe0a0f-09a3-479c-8809-8a3a2dec8190 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:45.851153 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe0a0f-09a3-479c-8809-8a3a2dec8190 None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:45.851839 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe0a0f-09a3-479c-8809-8a3a2dec8190 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:45.852172 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe0a0f-09a3-479c-8809-8a3a2dec8190 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:45.853598 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe0a0f-09a3-479c-8809-8a3a2dec8190 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:45.865400 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 484/963] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 26 10:53:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:53:45.871451 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb532d-d951-4590-8ce4-78c873bd7365 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:45.963481 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:45.969363 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb532d-d951-4590-8ce4-78c873bd7365 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:46.003699 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37eb58-529b-4018-b7e4-c874df334be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:46.004345 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37eb58-529b-4018-b7e4-c874df334be8 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:46.007584 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37eb58-529b-4018-b7e4-c874df334be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:46.007584 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37eb58-529b-4018-b7e4-c874df334be8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:46.007584 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a37eb58-529b-4018-b7e4-c874df334be8 None admin] RBAC: Adding query filter params (role.id=d6876897d7c548b7900d4e01cb45a007, scope.project.id=e8f0f02a607a49e0b88c75019795b726, user.id=b4f9a2bba0e748b6a98fa7dea2482ddf) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:46.007584 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a37eb58-529b-4018-b7e4-c874df334be8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:46.007584 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a37eb58-529b-4018-b7e4-c874df334be8 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:46.012869 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 480/964] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 26 10:53:45 2022] GET /identity/v3/role_assignments?user.id=b4f9a2bba0e748b6a98fa7dea2482ddf&scope.project.id=e8f0f02a607a49e0b88c75019795b726&role.id=d6876897d7c548b7900d4e01cb45a007 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:48.157392 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b18090-dae9-406a-b4b1-34a6197bd3b4 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:48.157925 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b18090-dae9-406a-b4b1-34a6197bd3b4 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:48.158015 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b18090-dae9-406a-b4b1-34a6197bd3b4 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:48.159694 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 485/965] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:53:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:48.165187 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1543715-2cec-4f57-b771-49748da7388f None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:48.165669 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1543715-2cec-4f57-b771-49748da7388f None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:48.165760 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1543715-2cec-4f57-b771-49748da7388f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:48.184291 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-f1543715-2cec-4f57-b771-49748da7388f None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:48.185498 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-f1543715-2cec-4f57-b771-49748da7388f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:48.250137 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 481/966] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:53:48.518684 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b18090-dae9-406a-b4b1-34a6197bd3b4 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:48.550581 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:48.619522 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b18090-dae9-406a-b4b1-34a6197bd3b4 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:48.652637 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1666f4-5306-4431-9ab2-a9e07edc8673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:48.653258 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1666f4-5306-4431-9ab2-a9e07edc8673 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:48.653534 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1666f4-5306-4431-9ab2-a9e07edc8673 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:48.653804 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1666f4-5306-4431-9ab2-a9e07edc8673 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:48.654375 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1666f4-5306-4431-9ab2-a9e07edc8673 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:48.655727 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1666f4-5306-4431-9ab2-a9e07edc8673 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:48.664935 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-3d1666f4-5306-4431-9ab2-a9e07edc8673 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 26 10:53:48.664935 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:48.664935 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:53:48.664935 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:53:48.664935 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:53:48.664935 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:53:48.664935 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:53:48.664935 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:53:48.664935 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 26 10:53:48.664935 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:53:48.664935 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:53:48.664935 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:53:48.664935 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:48.664935 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:48.664935 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:48.664935 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:48.664935 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:48.666169 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:48.666169 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:48.666169 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:48.666169 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:48.666169 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:48.666169 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:48.666169 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:53:48.666169 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:53:48.666169 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:53:48.666169 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:53:48.666169 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:48.666169 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:48.666169 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:48.666169 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:48.666169 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:48.666169 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:48.667083 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:48.667083 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:48.667083 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:48.667083 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:48.667083 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:48.667083 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:48.667083 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:48.667083 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:48.667083 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:48.667083 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:48.667083 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:53:48.667083 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:53:48.667083 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 26 10:53:48.667083 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:53:48.667083 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 486/967] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Oct 26 10:53:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:48.672307 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1543715-2cec-4f57-b771-49748da7388f None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:48.760317 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:48.769692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1543715-2cec-4f57-b771-49748da7388f None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:48.803601 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05421c8-bc36-44ad-9120-bfaa547cdc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:48.804241 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05421c8-bc36-44ad-9120-bfaa547cdc66 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:48.804526 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05421c8-bc36-44ad-9120-bfaa547cdc66 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:48.804818 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05421c8-bc36-44ad-9120-bfaa547cdc66 None admin] PATH_INFO: `/v3/services` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:48.805452 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05421c8-bc36-44ad-9120-bfaa547cdc66 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:48.805799 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05421c8-bc36-44ad-9120-bfaa547cdc66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:48.807174 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05421c8-bc36-44ad-9120-bfaa547cdc66 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:48.812664 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 482/968] 10.222.0.45 () {56 vars in 1116 bytes} [Wed Oct 26 10:53:48 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:48.818666 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1666f4-5306-4431-9ab2-a9e07edc8673 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:48.911472 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:48.917126 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1666f4-5306-4431-9ab2-a9e07edc8673 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:48.950527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f090a-4432-4998-b1d0-141995c5dd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:48.951133 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f090a-4432-4998-b1d0-141995c5dd9a None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:48.951414 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f090a-4432-4998-b1d0-141995c5dd9a None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:48.951687 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f090a-4432-4998-b1d0-141995c5dd9a None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:48.952373 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631f090a-4432-4998-b1d0-141995c5dd9a None admin] RBAC: Adding query filter params (type=placement) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:48.952675 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631f090a-4432-4998-b1d0-141995c5dd9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:48.954047 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631f090a-4432-4998-b1d0-141995c5dd9a None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:48.958304 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 487/969] 10.222.0.45 () {56 vars in 1116 bytes} [Wed Oct 26 10:53:48 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:51.084434 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79fdd3-2edd-4a8d-9414-27b25998e99d None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:51.085043 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79fdd3-2edd-4a8d-9414-27b25998e99d None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:51.085043 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79fdd3-2edd-4a8d-9414-27b25998e99d None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:51.086371 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 483/970] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:53:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:51.091633 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40158ad-3740-44f6-8296-61ac5fe83fbf None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:51.092097 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40158ad-3740-44f6-8296-61ac5fe83fbf None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:51.092217 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40158ad-3740-44f6-8296-61ac5fe83fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:51.111264 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-f40158ad-3740-44f6-8296-61ac5fe83fbf None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:51.112491 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f40158ad-3740-44f6-8296-61ac5fe83fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:51.179286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 488/971] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:53:51.448689 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79fdd3-2edd-4a8d-9414-27b25998e99d None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:51.547662 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79fdd3-2edd-4a8d-9414-27b25998e99d None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:51.581464 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08630c6-6524-4abf-8555-eda00e78963a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:51.582067 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08630c6-6524-4abf-8555-eda00e78963a None admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:51.582350 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08630c6-6524-4abf-8555-eda00e78963a None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:51.582626 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08630c6-6524-4abf-8555-eda00e78963a None admin] PATH_INFO: `/v3/services` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:51.583275 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08630c6-6524-4abf-8555-eda00e78963a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:51.584665 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08630c6-6524-4abf-8555-eda00e78963a None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:51.738783 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 484/972] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Oct 26 10:53:51 2022] POST /identity/v3/services => generated 246 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:53:53.889353 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9ace8-17ee-4dd4-a3e6-7ccc75175ac7 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:53.889983 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9ace8-17ee-4dd4-a3e6-7ccc75175ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:53.889983 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9ace8-17ee-4dd4-a3e6-7ccc75175ac7 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:53.891250 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 489/973] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:53:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:53.897006 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b00c10-c345-41f9-a71f-87cf12e50a81 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:53.897437 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b00c10-c345-41f9-a71f-87cf12e50a81 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:53.897593 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b00c10-c345-41f9-a71f-87cf12e50a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:53.916074 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-c1b00c10-c345-41f9-a71f-87cf12e50a81 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:53.917273 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-c1b00c10-c345-41f9-a71f-87cf12e50a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:53.927050 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:53.988664 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 485/974] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:53 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:53:54.255843 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9ace8-17ee-4dd4-a3e6-7ccc75175ac7 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:54.347990 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:54.358163 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9ace8-17ee-4dd4-a3e6-7ccc75175ac7 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:54.390142 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63753bfe-b5c1-4eb0-863b-d45226322252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:54.390762 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63753bfe-b5c1-4eb0-863b-d45226322252 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:54.391039 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63753bfe-b5c1-4eb0-863b-d45226322252 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:54.391309 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63753bfe-b5c1-4eb0-863b-d45226322252 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:54.392413 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63753bfe-b5c1-4eb0-863b-d45226322252 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:54.393862 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63753bfe-b5c1-4eb0-863b-d45226322252 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:54.402438 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-63753bfe-b5c1-4eb0-863b-d45226322252 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 26 10:53:54.402438 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:54.402438 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:53:54.402438 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:53:54.402438 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:53:54.402438 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:53:54.402438 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:53:54.402438 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:53:54.402438 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 26 10:53:54.402438 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:53:54.402438 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:53:54.402438 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:53:54.402438 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:54.402438 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:54.402438 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:54.402438 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:54.402438 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:54.408399 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:54.408399 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:54.408399 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:54.408399 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:54.408399 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:54.408399 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:54.408399 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:53:54.408399 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:53:54.408399 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:53:54.408399 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:53:54.408399 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:54.408399 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:54.408399 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:54.408399 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:54.408399 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:54.408399 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:54.410275 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:54.410275 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:54.410275 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:54.410275 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:54.410275 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:54.410275 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:54.410275 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:54.410275 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:54.410275 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:54.410275 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:54.410275 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:53:54.410275 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:53:54.410275 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 26 10:53:54.410275 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:53:54.410275 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 490/975] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Oct 26 10:53:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:54.411908 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b00c10-c345-41f9-a71f-87cf12e50a81 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:54.510578 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b00c10-c345-41f9-a71f-87cf12e50a81 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:54.544552 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196369ea-d566-41d0-8157-b052e45724d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:54.545153 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196369ea-d566-41d0-8157-b052e45724d4 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:54.545431 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196369ea-d566-41d0-8157-b052e45724d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:54.545702 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196369ea-d566-41d0-8157-b052e45724d4 None admin] PATH_INFO: `/v3/services` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:54.546575 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196369ea-d566-41d0-8157-b052e45724d4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:54.546882 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196369ea-d566-41d0-8157-b052e45724d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:54.548260 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196369ea-d566-41d0-8157-b052e45724d4 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:54.553339 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 486/976] 10.222.0.45 () {56 vars in 1116 bytes} [Wed Oct 26 10:53:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:54.559419 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63753bfe-b5c1-4eb0-863b-d45226322252 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:54.660638 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63753bfe-b5c1-4eb0-863b-d45226322252 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:54.694707 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f56436-f9dc-41c0-be4d-77d09d639da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:54.695316 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f56436-f9dc-41c0-be4d-77d09d639da9 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:54.695601 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f56436-f9dc-41c0-be4d-77d09d639da9 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:54.695878 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f56436-f9dc-41c0-be4d-77d09d639da9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:54.696661 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f56436-f9dc-41c0-be4d-77d09d639da9 None admin] RBAC: Adding query filter params (interface=public, service_id=ceb37050a8b9425b9c43a4bac2f3d703, region_id=RegionOne) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:54.697047 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f56436-f9dc-41c0-be4d-77d09d639da9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:54.698451 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f56436-f9dc-41c0-be4d-77d09d639da9 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:54.703363 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 491/977] 10.222.0.45 () {56 vars in 1251 bytes} [Wed Oct 26 10:53:54 2022] GET /identity/v3/endpoints?service_id=ceb37050a8b9425b9c43a4bac2f3d703&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:54.709183 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196369ea-d566-41d0-8157-b052e45724d4 None admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:54.712958 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:54.809840 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196369ea-d566-41d0-8157-b052e45724d4 None admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:54.842212 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d4ef7-1bec-43a3-a648-e5bb9802f022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:54.842814 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d4ef7-1bec-43a3-a648-e5bb9802f022 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:54.843093 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d4ef7-1bec-43a3-a648-e5bb9802f022 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:54.843366 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d4ef7-1bec-43a3-a648-e5bb9802f022 None admin] PATH_INFO: `/v3/services` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:54.843965 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d4ef7-1bec-43a3-a648-e5bb9802f022 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:54.845955 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d4ef7-1bec-43a3-a648-e5bb9802f022 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:54.852777 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 487/978] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Oct 26 10:53:54 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 10:53:56.987107 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32055883-fa3c-4490-83de-644505c64954 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:56.987670 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32055883-fa3c-4490-83de-644505c64954 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:56.987670 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32055883-fa3c-4490-83de-644505c64954 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:56.989055 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 492/979] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 10:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:56.994421 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145495b1-1875-4b42-996d-db2cdd77f81a None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:56.994836 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145495b1-1875-4b42-996d-db2cdd77f81a None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:56.994973 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145495b1-1875-4b42-996d-db2cdd77f81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:57.013336 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-145495b1-1875-4b42-996d-db2cdd77f81a None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:57.014517 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-145495b1-1875-4b42-996d-db2cdd77f81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:57.075619 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:57.081738 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 488/980] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:56 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:53:57.355119 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32055883-fa3c-4490-83de-644505c64954 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:57.376225 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:57.460585 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32055883-fa3c-4490-83de-644505c64954 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:57.495200 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a25bee4-2b45-4007-b401-3ffd9836b521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:57.495837 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25bee4-2b45-4007-b401-3ffd9836b521 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:57.496153 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25bee4-2b45-4007-b401-3ffd9836b521 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:57.496548 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25bee4-2b45-4007-b401-3ffd9836b521 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:57.497017 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a25bee4-2b45-4007-b401-3ffd9836b521 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:57.498386 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a25bee4-2b45-4007-b401-3ffd9836b521 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:57.507715 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-6a25bee4-2b45-4007-b401-3ffd9836b521 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 26 10:53:57.507715 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:57.507715 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:53:57.507715 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:53:57.507715 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:53:57.507715 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:53:57.507715 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:53:57.507715 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:53:57.507715 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 26 10:53:57.507715 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:53:57.507715 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:53:57.507715 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:53:57.507715 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:57.507715 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:57.507715 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:57.507715 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:57.507715 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:57.508904 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:57.508904 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:57.508904 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:57.508904 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:57.508904 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:57.508904 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:57.508904 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:53:57.508904 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:53:57.508904 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:53:57.508904 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:53:57.508904 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:57.508904 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:57.508904 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:57.508904 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:57.508904 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:57.508904 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:57.509890 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:57.509890 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:57.509890 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:57.509890 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:57.509890 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:57.509890 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:57.509890 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:57.509890 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:57.509890 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:57.509890 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:57.509890 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:53:57.509890 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:53:57.509890 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 26 10:53:57.509890 dv-cinder-862679-1-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Oct 26 10:53:57.509890 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 493/981] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Oct 26 10:53:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:57.514971 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145495b1-1875-4b42-996d-db2cdd77f81a None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:57.613177 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145495b1-1875-4b42-996d-db2cdd77f81a None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:57.651859 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ea1bc-5b6f-4e08-bea0-4a09eb585d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:57.675596 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ea1bc-5b6f-4e08-bea0-4a09eb585d20 None admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:57.675596 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ea1bc-5b6f-4e08-bea0-4a09eb585d20 None admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:57.675596 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ea1bc-5b6f-4e08-bea0-4a09eb585d20 None admin] PATH_INFO: `/v3/services` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:57.675596 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ea1bc-5b6f-4e08-bea0-4a09eb585d20 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:57.675596 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ea1bc-5b6f-4e08-bea0-4a09eb585d20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:57.675596 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ea1bc-5b6f-4e08-bea0-4a09eb585d20 None admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:57.676050 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 489/982] 10.222.0.45 () {56 vars in 1116 bytes} [Wed Oct 26 10:53:57 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:57.676163 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a25bee4-2b45-4007-b401-3ffd9836b521 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:57.756687 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:57.775407 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a25bee4-2b45-4007-b401-3ffd9836b521 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:57.810705 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a6adc-4fd0-4de8-a454-f5dfa72775d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:57.811318 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a6adc-4fd0-4de8-a454-f5dfa72775d9 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:57.811601 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a6adc-4fd0-4de8-a454-f5dfa72775d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:57.811875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a6adc-4fd0-4de8-a454-f5dfa72775d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:57.812639 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a6adc-4fd0-4de8-a454-f5dfa72775d9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:57.814068 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a6adc-4fd0-4de8-a454-f5dfa72775d9 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:57.950204 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 494/983] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 10:53:57 2022] POST /identity/v3/endpoints => generated 331 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:54:07.660288 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=69 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:54:07.945361 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:01:38.881454 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecc5a9-5bb4-4f87-9595-fd9e56351f21 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:01:38.882019 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecc5a9-5bb4-4f87-9595-fd9e56351f21 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:01:38.882019 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecc5a9-5bb4-4f87-9595-fd9e56351f21 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:01:38.888904 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed04fa4-6edc-4e2f-ba9f-f9406e935ea3 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:01:38.893873 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed04fa4-6edc-4e2f-ba9f-f9406e935ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:01:38.893873 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed04fa4-6edc-4e2f-ba9f-f9406e935ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:01:38.894055 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 490/984] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 11:01:38 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:01:38.985917 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-fed04fa4-6edc-4e2f-ba9f-f9406e935ea3 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:01:38.987550 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-fed04fa4-6edc-4e2f-ba9f-f9406e935ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:01:39.136759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 495/985] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 11:01:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:01:39.416807 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499b17f-e800-4736-89b5-4c3dbb44f6ec None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:01:39.417136 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499b17f-e800-4736-89b5-4c3dbb44f6ec None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:01:39.417365 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499b17f-e800-4736-89b5-4c3dbb44f6ec None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:01:39.418886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 491/986] 10.222.0.45 () {54 vars in 964 bytes} [Wed Oct 26 11:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:01:39.424603 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c10f4-0baf-404b-b6dc-2cb38175803d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:01:39.425063 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c10f4-0baf-404b-b6dc-2cb38175803d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:01:39.425411 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c10f4-0baf-404b-b6dc-2cb38175803d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:01:39.507487 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-172c10f4-0baf-404b-b6dc-2cb38175803d None None] MFA Rules not processed for user `522b4232cb4d430988d76a1cdb281e72`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:01:39.509055 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-172c10f4-0baf-404b-b6dc-2cb38175803d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:01:39.532262 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:01:39.591507 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 496/987] 10.222.0.45 () {58 vars in 1061 bytes} [Wed Oct 26 11:01:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:01:39.601614 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499b17f-e800-4736-89b5-4c3dbb44f6ec None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:01:39.603381 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-e499b17f-e800-4736-89b5-4c3dbb44f6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:01:39.726970 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499b17f-e800-4736-89b5-4c3dbb44f6ec None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:01:39.813661 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad8587-a683-4eb7-84aa-23e1fe39b31b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:01:39.814307 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad8587-a683-4eb7-84aa-23e1fe39b31b service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:01:39.814585 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad8587-a683-4eb7-84aa-23e1fe39b31b service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:01:39.814855 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad8587-a683-4eb7-84aa-23e1fe39b31b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:01:39.816520 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-1cad8587-a683-4eb7-84aa-23e1fe39b31b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:01:39.877218 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:01:39.937486 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad8587-a683-4eb7-84aa-23e1fe39b31b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:01:39.938941 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad8587-a683-4eb7-84aa-23e1fe39b31b service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:01:39.959523 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 492/988] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:01:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:01:42.398889 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a54b91-bd44-477d-8092-4d9854100c87 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:01:42.399453 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a54b91-bd44-477d-8092-4d9854100c87 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:01:42.399453 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a54b91-bd44-477d-8092-4d9854100c87 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:01:42.401064 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 497/989] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 11:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:01:42.406948 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de69bb-94f0-4bfe-9cb7-c37cb549be48 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:01:42.407507 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de69bb-94f0-4bfe-9cb7-c37cb549be48 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:01:42.407507 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de69bb-94f0-4bfe-9cb7-c37cb549be48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:01:42.480448 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-88de69bb-94f0-4bfe-9cb7-c37cb549be48 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:01:42.481653 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-88de69bb-94f0-4bfe-9cb7-c37cb549be48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:01:42.593676 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 493/990] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 11:01:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:01:42.878204 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a54b91-bd44-477d-8092-4d9854100c87 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:01:42.879742 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-30a54b91-bd44-477d-8092-4d9854100c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:01:42.988329 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a54b91-bd44-477d-8092-4d9854100c87 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:01:43.069697 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:01:43.072174 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e1c7f-6b4b-4160-97da-673b2a2221aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:01:43.072831 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e1c7f-6b4b-4160-97da-673b2a2221aa service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:01:43.073210 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e1c7f-6b4b-4160-97da-673b2a2221aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:01:43.073490 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e1c7f-6b4b-4160-97da-673b2a2221aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:01:43.075188 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-dd3e1c7f-6b4b-4160-97da-673b2a2221aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:01:43.188819 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e1c7f-6b4b-4160-97da-673b2a2221aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:01:43.190165 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e1c7f-6b4b-4160-97da-673b2a2221aa service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:01:43.208703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 498/991] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:01:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:01:45.871255 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfbf02-064b-4da7-807f-5b9c3dfdd93b None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:01:45.871812 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfbf02-064b-4da7-807f-5b9c3dfdd93b None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:01:45.871812 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfbf02-064b-4da7-807f-5b9c3dfdd93b None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:01:45.873189 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 494/992] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 11:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:01:45.879250 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebf504-aadf-4aa3-83f7-728d898b2212 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:01:45.879630 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebf504-aadf-4aa3-83f7-728d898b2212 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:01:45.879813 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebf504-aadf-4aa3-83f7-728d898b2212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:01:45.945381 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-9aebf504-aadf-4aa3-83f7-728d898b2212 None None] MFA Rules not processed for user `dbe8c1627cd14ceeb40d3289822f740c`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:01:45.946586 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9aebf504-aadf-4aa3-83f7-728d898b2212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:01:45.996959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:01:46.044943 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 499/993] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 11:01:45 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:01:46.336623 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfbf02-064b-4da7-807f-5b9c3dfdd93b None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:01:46.338201 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-b8cfbf02-064b-4da7-807f-5b9c3dfdd93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:01:46.348138 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:01:46.440079 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfbf02-064b-4da7-807f-5b9c3dfdd93b None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:01:46.511858 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc3da5-5be0-4090-84f1-fadd9f661eb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:01:46.512487 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc3da5-5be0-4090-84f1-fadd9f661eb5 service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:01:46.512768 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc3da5-5be0-4090-84f1-fadd9f661eb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:01:46.513040 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc3da5-5be0-4090-84f1-fadd9f661eb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:01:46.514626 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-defc3da5-5be0-4090-84f1-fadd9f661eb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:01:46.574974 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:01:46.620124 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc3da5-5be0-4090-84f1-fadd9f661eb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:01:46.621490 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc3da5-5be0-4090-84f1-fadd9f661eb5 service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:01:46.640997 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 495/994] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:01:46 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:01:49.639572 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d402585-f71c-4c39-a836-3a914e500ceb None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:01:49.640098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d402585-f71c-4c39-a836-3a914e500ceb None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:01:49.640098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d402585-f71c-4c39-a836-3a914e500ceb None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:01:49.641456 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 500/995] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 11:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:01:49.646862 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53107905-c7d5-473d-8f3c-efd0c949799a None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:01:49.647278 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53107905-c7d5-473d-8f3c-efd0c949799a None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:01:49.647425 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53107905-c7d5-473d-8f3c-efd0c949799a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:01:49.713636 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-53107905-c7d5-473d-8f3c-efd0c949799a None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:01:49.714839 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-53107905-c7d5-473d-8f3c-efd0c949799a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:01:49.807740 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 496/996] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 11:01:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:01:50.116244 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfb11f-63c7-4bb2-98ff-a1607bfe1e30 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:01:50.116534 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfb11f-63c7-4bb2-98ff-a1607bfe1e30 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:01:50.116817 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfb11f-63c7-4bb2-98ff-a1607bfe1e30 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:01:50.118177 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 501/997] 10.222.0.45 () {54 vars in 964 bytes} [Wed Oct 26 11:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:01:50.124004 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb3af3-7731-404d-a9b1-c313c1558337 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:01:50.124313 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb3af3-7731-404d-a9b1-c313c1558337 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:01:50.124587 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb3af3-7731-404d-a9b1-c313c1558337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:01:50.147050 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:01:50.199891 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-04cb3af3-7731-404d-a9b1-c313c1558337 None None] MFA Rules not processed for user `522b4232cb4d430988d76a1cdb281e72`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:01:50.201125 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-04cb3af3-7731-404d-a9b1-c313c1558337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:01:50.274537 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 497/998] 10.222.0.45 () {58 vars in 1061 bytes} [Wed Oct 26 11:01:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:01:50.283561 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfb11f-63c7-4bb2-98ff-a1607bfe1e30 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:01:50.285117 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-83bfb11f-63c7-4bb2-98ff-a1607bfe1e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:01:50.387390 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfb11f-63c7-4bb2-98ff-a1607bfe1e30 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:01:50.459857 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf62b4-5a86-423f-810a-336cb3c3daa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:01:50.460495 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf62b4-5a86-423f-810a-336cb3c3daa3 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:01:50.460776 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf62b4-5a86-423f-810a-336cb3c3daa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:01:50.461049 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf62b4-5a86-423f-810a-336cb3c3daa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:01:50.462632 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-adbf62b4-5a86-423f-810a-336cb3c3daa3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:01:50.469972 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:01:50.571941 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf62b4-5a86-423f-810a-336cb3c3daa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:01:50.573443 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf62b4-5a86-423f-810a-336cb3c3daa3 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:01:50.591252 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 502/999] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:01:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:01:54.162696 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67849fe-8f0c-4b46-af71-28ec7fad426d None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:01:54.163227 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67849fe-8f0c-4b46-af71-28ec7fad426d None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:01:54.163347 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67849fe-8f0c-4b46-af71-28ec7fad426d None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:01:54.164760 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 498/1000] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 11:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:01:54.170051 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6c9c0-9414-4758-85d1-3866345d48d9 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:01:54.170449 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6c9c0-9414-4758-85d1-3866345d48d9 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:01:54.170630 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6c9c0-9414-4758-85d1-3866345d48d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:01:54.237799 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-afa6c9c0-9414-4758-85d1-3866345d48d9 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:01:54.239010 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-afa6c9c0-9414-4758-85d1-3866345d48d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:01:54.296019 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:01:54.342643 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 503/1001] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 11:01:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:01:54.623020 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67849fe-8f0c-4b46-af71-28ec7fad426d None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:01:54.624621 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-e67849fe-8f0c-4b46-af71-28ec7fad426d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:01:54.728586 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67849fe-8f0c-4b46-af71-28ec7fad426d None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:01:54.743451 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:01:54.806187 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0951759-05d1-4edf-928a-6e9f87ede596 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:01:54.806804 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0951759-05d1-4edf-928a-6e9f87ede596 service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:01:54.807081 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0951759-05d1-4edf-928a-6e9f87ede596 service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:01:54.807354 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0951759-05d1-4edf-928a-6e9f87ede596 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:01:54.808984 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-a0951759-05d1-4edf-928a-6e9f87ede596 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:01:54.918918 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0951759-05d1-4edf-928a-6e9f87ede596 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:01:54.920377 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0951759-05d1-4edf-928a-6e9f87ede596 service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:01:54.938908 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 499/1002] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:01:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:01:57.165672 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ce650-cbc1-4fb3-8279-61c95d6b4588 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:01:57.166272 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ce650-cbc1-4fb3-8279-61c95d6b4588 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:01:57.166272 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ce650-cbc1-4fb3-8279-61c95d6b4588 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:01:57.167625 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 504/1003] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 11:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:01:57.174271 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17774f7-eab4-4b6d-8563-4ea177573020 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:01:57.174821 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17774f7-eab4-4b6d-8563-4ea177573020 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:01:57.174943 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17774f7-eab4-4b6d-8563-4ea177573020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:01:57.224672 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:01:57.243133 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-e17774f7-eab4-4b6d-8563-4ea177573020 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:01:57.244380 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-e17774f7-eab4-4b6d-8563-4ea177573020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:01:57.343384 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 500/1004] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 11:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:01:57.626716 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ce650-cbc1-4fb3-8279-61c95d6b4588 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:01:57.628364 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e54ce650-cbc1-4fb3-8279-61c95d6b4588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:01:57.730394 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ce650-cbc1-4fb3-8279-61c95d6b4588 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:01:57.803429 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8973af5a-7061-4dc5-946d-d8c500593a16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:01:57.804037 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973af5a-7061-4dc5-946d-d8c500593a16 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:01:57.804347 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973af5a-7061-4dc5-946d-d8c500593a16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:01:57.804623 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973af5a-7061-4dc5-946d-d8c500593a16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:01:57.806215 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8973af5a-7061-4dc5-946d-d8c500593a16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:01:57.823628 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:01:57.917355 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8973af5a-7061-4dc5-946d-d8c500593a16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:01:57.918953 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8973af5a-7061-4dc5-946d-d8c500593a16 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:01:57.937522 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 505/1005] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:01:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:02:00.157400 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d8ded-948d-4ea4-9612-f4cb5bcc519e None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:00.157955 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d8ded-948d-4ea4-9612-f4cb5bcc519e None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:00.157955 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d8ded-948d-4ea4-9612-f4cb5bcc519e None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:00.159283 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 501/1006] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 11:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:02:00.164502 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554d3f8-66f2-4145-8f4f-024d717c4816 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:00.164927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554d3f8-66f2-4145-8f4f-024d717c4816 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:00.165056 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554d3f8-66f2-4145-8f4f-024d717c4816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:00.231471 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-4554d3f8-66f2-4145-8f4f-024d717c4816 None None] MFA Rules not processed for user `dbe8c1627cd14ceeb40d3289822f740c`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:02:00.232649 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4554d3f8-66f2-4145-8f4f-024d717c4816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:00.297190 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:02:00.332780 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 506/1007] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 11:02:00 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:02:00.613982 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d8ded-948d-4ea4-9612-f4cb5bcc519e None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:02:00.615622 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-de1d8ded-948d-4ea4-9612-f4cb5bcc519e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:00.731065 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d8ded-948d-4ea4-9612-f4cb5bcc519e None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:02:00.753767 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:02:00.815620 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064f886-0de2-463e-a062-fdb4adf5077a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:02:00.816220 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064f886-0de2-463e-a062-fdb4adf5077a service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:00.816489 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064f886-0de2-463e-a062-fdb4adf5077a service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:00.816780 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064f886-0de2-463e-a062-fdb4adf5077a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:00.818627 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-4064f886-0de2-463e-a062-fdb4adf5077a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:00.947290 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4064f886-0de2-463e-a062-fdb4adf5077a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:02:00.948774 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4064f886-0de2-463e-a062-fdb4adf5077a service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:02:00.967076 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 502/1008] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:02:00 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:02:03.542656 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e6105-418f-41ce-bd49-3ed7a456b6ef None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:03.543200 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e6105-418f-41ce-bd49-3ed7a456b6ef None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:03.543200 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e6105-418f-41ce-bd49-3ed7a456b6ef None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:03.544592 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 507/1009] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 11:02:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:02:03.550376 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c14ca-6c96-4158-8d63-63e92fd97059 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:03.550800 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c14ca-6c96-4158-8d63-63e92fd97059 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:03.550941 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c14ca-6c96-4158-8d63-63e92fd97059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:03.614034 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:02:03.616593 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-530c14ca-6c96-4158-8d63-63e92fd97059 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:02:03.617810 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-530c14ca-6c96-4158-8d63-63e92fd97059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:03.713249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 503/1010] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 11:02:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:02:03.991224 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e6105-418f-41ce-bd49-3ed7a456b6ef None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:02:03.992815 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f11e6105-418f-41ce-bd49-3ed7a456b6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:04.095492 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e6105-418f-41ce-bd49-3ed7a456b6ef None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:02:04.175404 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb4792-f2ab-4796-85ea-dbd5069814fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:02:04.176489 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb4792-f2ab-4796-85ea-dbd5069814fa service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:04.177008 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb4792-f2ab-4796-85ea-dbd5069814fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:04.177499 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb4792-f2ab-4796-85ea-dbd5069814fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:04.179640 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9cbb4792-f2ab-4796-85ea-dbd5069814fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:04.206445 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:02:04.287707 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb4792-f2ab-4796-85ea-dbd5069814fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:02:04.289176 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb4792-f2ab-4796-85ea-dbd5069814fa service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:02:04.307478 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 508/1011] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:02:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:02:06.545629 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd656cc-0bac-4f38-8f5e-c2ffba21db7f None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:06.546070 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd656cc-0bac-4f38-8f5e-c2ffba21db7f None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:06.546161 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd656cc-0bac-4f38-8f5e-c2ffba21db7f None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:06.547571 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 504/1012] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 11:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:02:06.552852 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ffb43-9476-480e-89fd-5b41fea1c659 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:06.553244 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ffb43-9476-480e-89fd-5b41fea1c659 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:06.553408 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ffb43-9476-480e-89fd-5b41fea1c659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:06.618768 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-7f8ffb43-9476-480e-89fd-5b41fea1c659 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:02:06.619913 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7f8ffb43-9476-480e-89fd-5b41fea1c659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:06.693527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:02:06.715547 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 509/1013] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 11:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:02:06.996296 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd656cc-0bac-4f38-8f5e-c2ffba21db7f None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:02:06.997861 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-fdd656cc-0bac-4f38-8f5e-c2ffba21db7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:07.101255 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd656cc-0bac-4f38-8f5e-c2ffba21db7f None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:02:07.129451 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:02:07.175112 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53979fb3-db3c-4eb3-90d4-50c2f847daef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:02:07.175723 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53979fb3-db3c-4eb3-90d4-50c2f847daef service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:07.176002 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53979fb3-db3c-4eb3-90d4-50c2f847daef service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:07.176307 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53979fb3-db3c-4eb3-90d4-50c2f847daef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:07.177911 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-53979fb3-db3c-4eb3-90d4-50c2f847daef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:07.285707 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53979fb3-db3c-4eb3-90d4-50c2f847daef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:02:07.287144 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53979fb3-db3c-4eb3-90d4-50c2f847daef service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:02:07.304928 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 505/1014] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:02:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:02:10.037735 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38988b40-0807-44d6-af85-b72e1d1d8047 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:10.038399 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38988b40-0807-44d6-af85-b72e1d1d8047 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:10.038399 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38988b40-0807-44d6-af85-b72e1d1d8047 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:10.039678 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 510/1015] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 11:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:02:10.044820 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc9aa2-c947-4b50-be5e-275baef5dfa4 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:10.045249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc9aa2-c947-4b50-be5e-275baef5dfa4 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:10.045375 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc9aa2-c947-4b50-be5e-275baef5dfa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:10.111012 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-b8dc9aa2-c947-4b50-be5e-275baef5dfa4 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:02:10.112257 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-b8dc9aa2-c947-4b50-be5e-275baef5dfa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:10.120445 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:02:10.208775 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 506/1016] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 11:02:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:02:10.489785 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38988b40-0807-44d6-af85-b72e1d1d8047 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:02:10.491361 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-38988b40-0807-44d6-af85-b72e1d1d8047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:10.597893 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38988b40-0807-44d6-af85-b72e1d1d8047 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:02:10.674578 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d940c49-fa8c-4504-9db0-49c28f337037 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:02:10.675191 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d940c49-fa8c-4504-9db0-49c28f337037 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:10.675466 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d940c49-fa8c-4504-9db0-49c28f337037 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:10.675732 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d940c49-fa8c-4504-9db0-49c28f337037 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:10.677349 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6d940c49-fa8c-4504-9db0-49c28f337037 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:10.712134 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:02:10.786668 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d940c49-fa8c-4504-9db0-49c28f337037 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:02:10.788132 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d940c49-fa8c-4504-9db0-49c28f337037 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:02:10.806897 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 511/1017] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:02:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:02:15.274853 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d443b7-b661-4aa3-bc85-5147b131b442 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:15.275385 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d443b7-b661-4aa3-bc85-5147b131b442 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:15.275385 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d443b7-b661-4aa3-bc85-5147b131b442 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:15.276923 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 507/1018] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 11:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:02:15.283274 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a455da9-15e2-44b5-9e1b-2205e5175e19 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:15.283688 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a455da9-15e2-44b5-9e1b-2205e5175e19 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:15.284181 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a455da9-15e2-44b5-9e1b-2205e5175e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:15.353430 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-9a455da9-15e2-44b5-9e1b-2205e5175e19 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:02:15.354638 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9a455da9-15e2-44b5-9e1b-2205e5175e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:15.439254 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:02:15.453282 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 512/1019] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 11:02:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:02:15.733844 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d443b7-b661-4aa3-bc85-5147b131b442 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:02:15.736016 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-30d443b7-b661-4aa3-bc85-5147b131b442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:15.839289 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d443b7-b661-4aa3-bc85-5147b131b442 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:02:15.877777 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:02:15.914935 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89547a-eb46-4119-a42c-ef0bb957de1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:02:15.915553 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89547a-eb46-4119-a42c-ef0bb957de1a service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:15.915835 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89547a-eb46-4119-a42c-ef0bb957de1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:15.916137 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89547a-eb46-4119-a42c-ef0bb957de1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:15.917811 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-bd89547a-eb46-4119-a42c-ef0bb957de1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:16.027017 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd89547a-eb46-4119-a42c-ef0bb957de1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:02:16.028180 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd89547a-eb46-4119-a42c-ef0bb957de1a service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:02:16.048708 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 508/1020] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:02:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:02:19.111194 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5483e-9e3a-48a4-9780-26acffc82f91 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:19.111764 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5483e-9e3a-48a4-9780-26acffc82f91 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:19.111764 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5483e-9e3a-48a4-9780-26acffc82f91 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:19.113130 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 513/1021] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 11:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:02:19.118455 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5558434-7ab2-48c1-9695-a08d068b2b76 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:19.118905 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5558434-7ab2-48c1-9695-a08d068b2b76 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:19.119044 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5558434-7ab2-48c1-9695-a08d068b2b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:19.188463 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-d5558434-7ab2-48c1-9695-a08d068b2b76 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:02:19.189719 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-d5558434-7ab2-48c1-9695-a08d068b2b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:19.210492 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:02:19.288368 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 509/1022] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 11:02:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:02:19.571750 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5483e-9e3a-48a4-9780-26acffc82f91 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:02:19.573406 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-03a5483e-9e3a-48a4-9780-26acffc82f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:19.677410 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5483e-9e3a-48a4-9780-26acffc82f91 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:02:19.753242 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575b7b2-7a1e-43d0-bc80-778a71c30f52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:02:19.753855 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575b7b2-7a1e-43d0-bc80-778a71c30f52 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:19.754136 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575b7b2-7a1e-43d0-bc80-778a71c30f52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:19.754406 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575b7b2-7a1e-43d0-bc80-778a71c30f52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:19.756006 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5575b7b2-7a1e-43d0-bc80-778a71c30f52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:19.799820 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:02:19.870448 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5575b7b2-7a1e-43d0-bc80-778a71c30f52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:02:19.876153 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5575b7b2-7a1e-43d0-bc80-778a71c30f52 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:02:19.899352 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 514/1023] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:02:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:02:24.148577 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36805f6b-72bd-4827-a04c-66fc302c8ada None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:24.149080 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36805f6b-72bd-4827-a04c-66fc302c8ada None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:24.149080 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36805f6b-72bd-4827-a04c-66fc302c8ada None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:24.150442 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 510/1024] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 11:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:02:24.156546 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4b32f-d76b-4b9c-bc63-f9c2d8e5a7ec None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:24.157325 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4b32f-d76b-4b9c-bc63-f9c2d8e5a7ec None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:24.157630 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4b32f-d76b-4b9c-bc63-f9c2d8e5a7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:24.228745 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-1cc4b32f-d76b-4b9c-bc63-f9c2d8e5a7ec None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:02:24.229981 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1cc4b32f-d76b-4b9c-bc63-f9c2d8e5a7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:24.335228 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:02:24.338445 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 515/1025] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 11:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:02:24.618497 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36805f6b-72bd-4827-a04c-66fc302c8ada None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:02:24.620127 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-36805f6b-72bd-4827-a04c-66fc302c8ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:24.725446 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36805f6b-72bd-4827-a04c-66fc302c8ada None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:02:24.779216 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:02:24.804591 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d30da67-421e-4ef7-a124-9c291c99a624 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:02:24.805239 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30da67-421e-4ef7-a124-9c291c99a624 service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:24.805581 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30da67-421e-4ef7-a124-9c291c99a624 service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:24.805854 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30da67-421e-4ef7-a124-9c291c99a624 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:24.807446 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-2d30da67-421e-4ef7-a124-9c291c99a624 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:24.918447 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d30da67-421e-4ef7-a124-9c291c99a624 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:02:24.919921 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d30da67-421e-4ef7-a124-9c291c99a624 service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:02:24.938575 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 511/1026] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:02:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:02:29.924692 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90a70a-d3af-4f51-a08e-0871859928dc None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:29.925161 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90a70a-d3af-4f51-a08e-0871859928dc None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:29.925457 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90a70a-d3af-4f51-a08e-0871859928dc None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:29.927160 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 516/1027] 10.222.0.45 () {54 vars in 921 bytes} [Wed Oct 26 11:02:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:02:29.932464 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfea2f-4ca4-43ba-8e37-a48098556326 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:29.933716 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfea2f-4ca4-43ba-8e37-a48098556326 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:29.934713 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfea2f-4ca4-43ba-8e37-a48098556326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:30.100350 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-f5cfea2f-4ca4-43ba-8e37-a48098556326 None None] MFA Rules not processed for user `b4f9a2bba0e748b6a98fa7dea2482ddf`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:02:30.101590 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-f5cfea2f-4ca4-43ba-8e37-a48098556326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:30.134078 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:02:30.231481 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 512/1028] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Oct 26 11:02:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:02:34.329724 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0860cf-532f-4183-bd5b-bca39eb1739e None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:34.331008 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0860cf-532f-4183-bd5b-bca39eb1739e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:34.331743 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0860cf-532f-4183-bd5b-bca39eb1739e None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:34.333613 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 517/1029] 10.222.0.45 () {54 vars in 921 bytes} [Wed Oct 26 11:02:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:02:34.340905 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399face1-4249-402f-a6be-f9f70d36835a None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:34.341374 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399face1-4249-402f-a6be-f9f70d36835a None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:34.341459 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399face1-4249-402f-a6be-f9f70d36835a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:34.425728 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-399face1-4249-402f-a6be-f9f70d36835a None None] MFA Rules not processed for user `b4f9a2bba0e748b6a98fa7dea2482ddf`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:02:34.428402 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-399face1-4249-402f-a6be-f9f70d36835a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:34.506317 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:02:34.548830 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 513/1030] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Oct 26 11:02:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:02:35.849194 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff9d91-bb13-4274-954f-638790187de7 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:35.850201 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff9d91-bb13-4274-954f-638790187de7 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:35.850641 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff9d91-bb13-4274-954f-638790187de7 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:35.852100 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 518/1031] 10.222.0.45 () {54 vars in 921 bytes} [Wed Oct 26 11:02:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:02:35.857497 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b9062-347c-47c1-9b83-26b9a7c550dd None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:35.857976 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b9062-347c-47c1-9b83-26b9a7c550dd None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:35.858062 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b9062-347c-47c1-9b83-26b9a7c550dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:35.938716 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-973b9062-347c-47c1-9b83-26b9a7c550dd None None] MFA Rules not processed for user `b4f9a2bba0e748b6a98fa7dea2482ddf`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:02:35.939930 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-973b9062-347c-47c1-9b83-26b9a7c550dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:36.047504 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 514/1032] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Oct 26 11:02:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:02:39.560141 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3beb79-481d-4200-8f08-85e2e95dd206 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:39.560732 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3beb79-481d-4200-8f08-85e2e95dd206 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:39.560732 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3beb79-481d-4200-8f08-85e2e95dd206 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:39.562035 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 519/1033] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 11:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:02:39.568158 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441557b1-c995-407d-9c33-0df9be55bb9f None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:39.568850 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441557b1-c995-407d-9c33-0df9be55bb9f None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:39.569024 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441557b1-c995-407d-9c33-0df9be55bb9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:39.607972 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:02:39.642270 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-441557b1-c995-407d-9c33-0df9be55bb9f None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:02:39.643488 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-441557b1-c995-407d-9c33-0df9be55bb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:39.748108 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 515/1034] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 11:02:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:02:40.044503 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805cec5-e64b-467e-b450-3044779790a9 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:40.045736 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805cec5-e64b-467e-b450-3044779790a9 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:40.047889 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805cec5-e64b-467e-b450-3044779790a9 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:40.051412 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 520/1035] 10.222.0.45 () {54 vars in 961 bytes} [Wed Oct 26 11:02:40 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:02:40.058435 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7af28e-a712-4e2b-b03c-2c7f8ac2aa5b None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:40.059059 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7af28e-a712-4e2b-b03c-2c7f8ac2aa5b None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:40.059529 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7af28e-a712-4e2b-b03c-2c7f8ac2aa5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:40.142859 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-ff7af28e-a712-4e2b-b03c-2c7f8ac2aa5b None None] MFA Rules not processed for user `a852a777cb6a4863bebdb949cc71ea65`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:02:40.145899 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-ff7af28e-a712-4e2b-b03c-2c7f8ac2aa5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:40.226263 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:02:40.441055 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 516/1036] 10.222.0.45 () {58 vars in 1058 bytes} [Wed Oct 26 11:02:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:02:40.441171 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805cec5-e64b-467e-b450-3044779790a9 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:02:40.441171 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b805cec5-e64b-467e-b450-3044779790a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:40.457838 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805cec5-e64b-467e-b450-3044779790a9 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:02:40.554098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:02:40.597341 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca62505-3745-42ba-9dc5-5792640ddd24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:02:40.598078 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca62505-3745-42ba-9dc5-5792640ddd24 service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:40.598457 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca62505-3745-42ba-9dc5-5792640ddd24 service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:40.598852 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca62505-3745-42ba-9dc5-5792640ddd24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:40.600562 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9ca62505-3745-42ba-9dc5-5792640ddd24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:40.692491 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca62505-3745-42ba-9dc5-5792640ddd24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:02:40.694419 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca62505-3745-42ba-9dc5-5792640ddd24 service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:02:40.712594 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 521/1037] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:02:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:02:43.063172 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7beaf-548c-4b53-b124-a16fcfcd593c None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:43.063172 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7beaf-548c-4b53-b124-a16fcfcd593c None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:43.063172 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7beaf-548c-4b53-b124-a16fcfcd593c None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:43.072526 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 517/1038] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 11:02:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:02:43.072725 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2adc91-70f5-4535-8a3f-fd3b45b38f86 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:43.072725 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2adc91-70f5-4535-8a3f-fd3b45b38f86 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:43.072725 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2adc91-70f5-4535-8a3f-fd3b45b38f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:43.150591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-cb2adc91-70f5-4535-8a3f-fd3b45b38f86 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:02:43.151964 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-cb2adc91-70f5-4535-8a3f-fd3b45b38f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:43.193259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:02:43.289090 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 522/1039] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 11:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:02:43.593345 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed7beaf-548c-4b53-b124-a16fcfcd593c None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:02:43.595483 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-9ed7beaf-548c-4b53-b124-a16fcfcd593c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:43.775271 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed7beaf-548c-4b53-b124-a16fcfcd593c None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:02:43.786836 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:02:43.939613 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf1ad8-4b21-48ba-afa5-716b63b7849e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:02:43.939613 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf1ad8-4b21-48ba-afa5-716b63b7849e service nova] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:43.939613 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf1ad8-4b21-48ba-afa5-716b63b7849e service nova] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:43.939613 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf1ad8-4b21-48ba-afa5-716b63b7849e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:43.940343 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-38bf1ad8-4b21-48ba-afa5-716b63b7849e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:44.042659 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf1ad8-4b21-48ba-afa5-716b63b7849e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:02:44.044297 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf1ad8-4b21-48ba-afa5-716b63b7849e service nova] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:02:44.062769 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 518/1040] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:02:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:02:46.659928 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b67f7-90cc-4b45-bba4-de86db134b64 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:46.660543 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b67f7-90cc-4b45-bba4-de86db134b64 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:46.660543 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b67f7-90cc-4b45-bba4-de86db134b64 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:46.661842 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 523/1041] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 11:02:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:02:46.667212 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14119b-750b-4cf7-8d51-f023caba2ff5 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:46.667598 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14119b-750b-4cf7-8d51-f023caba2ff5 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:46.667774 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14119b-750b-4cf7-8d51-f023caba2ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:46.683244 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:02:46.737254 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-ee14119b-750b-4cf7-8d51-f023caba2ff5 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:02:46.738455 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-ee14119b-750b-4cf7-8d51-f023caba2ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:46.848463 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 519/1042] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 11:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:02:47.136159 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e833d3c-e2cb-4616-a837-5aced5b5f3a2 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:47.136576 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e833d3c-e2cb-4616-a837-5aced5b5f3a2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:47.136960 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e833d3c-e2cb-4616-a837-5aced5b5f3a2 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:47.138552 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 524/1043] 10.222.0.45 () {54 vars in 961 bytes} [Wed Oct 26 11:02:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:02:47.144405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfb782-5c30-4de1-9ebc-9a05f33e32a2 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:47.144697 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfb782-5c30-4de1-9ebc-9a05f33e32a2 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:47.145086 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfb782-5c30-4de1-9ebc-9a05f33e32a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:47.225319 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-5abfb782-5c30-4de1-9ebc-9a05f33e32a2 None None] MFA Rules not processed for user `a852a777cb6a4863bebdb949cc71ea65`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:02:47.226518 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-5abfb782-5c30-4de1-9ebc-9a05f33e32a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:47.263158 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:02:47.352022 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 520/1044] 10.222.0.45 () {58 vars in 1058 bytes} [Wed Oct 26 11:02:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:02:47.360692 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e833d3c-e2cb-4616-a837-5aced5b5f3a2 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:02:47.362403 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1e833d3c-e2cb-4616-a837-5aced5b5f3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:47.519615 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e833d3c-e2cb-4616-a837-5aced5b5f3a2 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:02:47.541067 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:02:47.644088 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d417f4a-5146-4016-a7da-9fd13cc8e6df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:02:47.644702 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d417f4a-5146-4016-a7da-9fd13cc8e6df service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:47.644979 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d417f4a-5146-4016-a7da-9fd13cc8e6df service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:47.645247 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d417f4a-5146-4016-a7da-9fd13cc8e6df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:47.646849 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7d417f4a-5146-4016-a7da-9fd13cc8e6df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:47.747986 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d417f4a-5146-4016-a7da-9fd13cc8e6df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:02:47.750282 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d417f4a-5146-4016-a7da-9fd13cc8e6df service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:02:47.769430 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 525/1045] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:02:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:02:47.825199 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce15fa-b9b9-43f8-96a9-c2194165c34d None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:47.825745 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce15fa-b9b9-43f8-96a9-c2194165c34d None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:47.825745 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce15fa-b9b9-43f8-96a9-c2194165c34d None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:47.827307 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 521/1046] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 11:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:02:47.832505 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7832cd6-c217-42f8-aa48-d755313ab5cf None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:47.838085 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7832cd6-c217-42f8-aa48-d755313ab5cf None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:47.838085 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7832cd6-c217-42f8-aa48-d755313ab5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:47.865037 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:02:47.903027 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-c7832cd6-c217-42f8-aa48-d755313ab5cf None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:02:47.903256 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c7832cd6-c217-42f8-aa48-d755313ab5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:48.017911 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 526/1047] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 11:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:02:48.364522 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe455c6e-4d37-4064-8315-b8a154dad504 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:48.364931 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe455c6e-4d37-4064-8315-b8a154dad504 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:48.365313 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe455c6e-4d37-4064-8315-b8a154dad504 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:48.366893 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 522/1048] 10.222.0.45 () {54 vars in 963 bytes} [Wed Oct 26 11:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:02:48.372244 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598a617-2f95-49f4-9e5c-169d39cac322 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:48.372543 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598a617-2f95-49f4-9e5c-169d39cac322 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:48.372825 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598a617-2f95-49f4-9e5c-169d39cac322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:48.453812 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-b598a617-2f95-49f4-9e5c-169d39cac322 None None] MFA Rules not processed for user `c06f827607194b6dbd196a8fbf717b05`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:02:48.455156 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b598a617-2f95-49f4-9e5c-169d39cac322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:48.504741 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:02:48.536383 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 527/1049] 10.222.0.45 () {58 vars in 1060 bytes} [Wed Oct 26 11:02:48 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:02:48.544453 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe455c6e-4d37-4064-8315-b8a154dad504 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:02:48.548124 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-fe455c6e-4d37-4064-8315-b8a154dad504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:48.664250 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe455c6e-4d37-4064-8315-b8a154dad504 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:02:48.706896 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:02:48.745922 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404d696-5a91-4a9f-b6c7-03d5a1f2ba53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:02:48.746647 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404d696-5a91-4a9f-b6c7-03d5a1f2ba53 service cinder] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:48.747051 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404d696-5a91-4a9f-b6c7-03d5a1f2ba53 service cinder] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:48.747467 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404d696-5a91-4a9f-b6c7-03d5a1f2ba53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:48.749310 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-f404d696-5a91-4a9f-b6c7-03d5a1f2ba53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:48.866103 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404d696-5a91-4a9f-b6c7-03d5a1f2ba53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:02:48.867652 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404d696-5a91-4a9f-b6c7-03d5a1f2ba53 service cinder] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:02:48.893235 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 523/1050] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:02:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:02:50.199046 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3630f1-b39a-4fd3-94a3-4d28e4a8c818 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:50.199588 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3630f1-b39a-4fd3-94a3-4d28e4a8c818 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:50.199588 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3630f1-b39a-4fd3-94a3-4d28e4a8c818 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:50.200979 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 528/1051] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 11:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:02:50.206757 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3c12e-1764-4ab6-9a14-5b73e441c077 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:50.211269 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3c12e-1764-4ab6-9a14-5b73e441c077 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:50.211269 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3c12e-1764-4ab6-9a14-5b73e441c077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:50.275661 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-f3c3c12e-1764-4ab6-9a14-5b73e441c077 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:02:50.276903 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-f3c3c12e-1764-4ab6-9a14-5b73e441c077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:50.298614 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:02:50.378631 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 524/1052] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 11:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:02:50.673124 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3630f1-b39a-4fd3-94a3-4d28e4a8c818 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:02:50.674694 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4e3630f1-b39a-4fd3-94a3-4d28e4a8c818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:50.826327 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3630f1-b39a-4fd3-94a3-4d28e4a8c818 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:02:50.881270 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:02:50.945683 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246ec17-eb0f-4a9c-a695-72b1edb04623 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:02:50.946306 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246ec17-eb0f-4a9c-a695-72b1edb04623 service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:50.946733 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246ec17-eb0f-4a9c-a695-72b1edb04623 service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:50.947154 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246ec17-eb0f-4a9c-a695-72b1edb04623 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:50.949503 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e246ec17-eb0f-4a9c-a695-72b1edb04623 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:51.045127 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246ec17-eb0f-4a9c-a695-72b1edb04623 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:02:51.047273 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246ec17-eb0f-4a9c-a695-72b1edb04623 service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:02:51.066312 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 529/1053] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:02:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:02:53.430862 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433b383-eb8c-4392-935c-1e4e907f1dba None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:53.431427 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433b383-eb8c-4392-935c-1e4e907f1dba None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:53.431427 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433b383-eb8c-4392-935c-1e4e907f1dba None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:53.432954 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 525/1054] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 11:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:02:53.438129 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa94efc-9863-42ca-9c7e-58426fd58bb6 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:53.438521 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa94efc-9863-42ca-9c7e-58426fd58bb6 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:53.438695 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa94efc-9863-42ca-9c7e-58426fd58bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:53.506500 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-1aa94efc-9863-42ca-9c7e-58426fd58bb6 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:02:53.507716 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1aa94efc-9863-42ca-9c7e-58426fd58bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:53.515104 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:02:53.609969 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 530/1055] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 11:02:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:02:53.898626 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433b383-eb8c-4392-935c-1e4e907f1dba None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:02:53.901396 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-5433b383-eb8c-4392-935c-1e4e907f1dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:54.059840 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433b383-eb8c-4392-935c-1e4e907f1dba None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:02:54.064152 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:02:54.182507 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65528b30-5ed7-4646-98bc-4cf9b5465e13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:02:54.183088 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65528b30-5ed7-4646-98bc-4cf9b5465e13 service nova] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:54.183378 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65528b30-5ed7-4646-98bc-4cf9b5465e13 service nova] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:54.183767 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65528b30-5ed7-4646-98bc-4cf9b5465e13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:54.185405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-65528b30-5ed7-4646-98bc-4cf9b5465e13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:54.283848 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65528b30-5ed7-4646-98bc-4cf9b5465e13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:02:54.285648 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65528b30-5ed7-4646-98bc-4cf9b5465e13 service nova] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:02:54.304393 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 526/1056] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:02:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:02:56.653014 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18b489-05aa-4340-88de-8807be8977ba None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:56.653581 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18b489-05aa-4340-88de-8807be8977ba None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:56.653581 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18b489-05aa-4340-88de-8807be8977ba None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:56.654967 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 531/1057] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 11:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:02:56.660509 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0d1a5-b25e-4ae9-b9aa-b204c821fb21 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:56.660942 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0d1a5-b25e-4ae9-b9aa-b204c821fb21 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:56.661063 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0d1a5-b25e-4ae9-b9aa-b204c821fb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:56.673345 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:02:56.734679 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-e2b0d1a5-b25e-4ae9-b9aa-b204c821fb21 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:02:56.735925 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-e2b0d1a5-b25e-4ae9-b9aa-b204c821fb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:56.847933 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 527/1058] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 11:02:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:02:57.142464 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed18b489-05aa-4340-88de-8807be8977ba None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:02:57.144017 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ed18b489-05aa-4340-88de-8807be8977ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:57.297767 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:02:57.307952 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed18b489-05aa-4340-88de-8807be8977ba None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:02:57.429340 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f5988e-1e46-4c20-84da-e28e8413c10e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:02:57.429876 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5988e-1e46-4c20-84da-e28e8413c10e service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:57.430158 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5988e-1e46-4c20-84da-e28e8413c10e service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:57.430433 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5988e-1e46-4c20-84da-e28e8413c10e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:57.432072 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d8f5988e-1e46-4c20-84da-e28e8413c10e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:57.521374 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f5988e-1e46-4c20-84da-e28e8413c10e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:02:57.522987 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f5988e-1e46-4c20-84da-e28e8413c10e service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:02:57.532972 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:02:57.541845 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 532/1059] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:02:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:03:00.294135 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef837031-5cd7-425d-bf28-ba1854789318 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:00.294702 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef837031-5cd7-425d-bf28-ba1854789318 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:00.294820 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef837031-5cd7-425d-bf28-ba1854789318 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:00.296202 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 528/1060] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 11:03:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:03:00.301619 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e04434-0af3-4263-979d-114b25897fd7 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:00.302049 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e04434-0af3-4263-979d-114b25897fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:00.302174 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e04434-0af3-4263-979d-114b25897fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:00.372391 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-c1e04434-0af3-4263-979d-114b25897fd7 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:03:00.373607 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c1e04434-0af3-4263-979d-114b25897fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:00.470687 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 533/1061] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 11:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:03:00.764498 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef837031-5cd7-425d-bf28-ba1854789318 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:03:00.766766 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-ef837031-5cd7-425d-bf28-ba1854789318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:00.858593 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:00.922255 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef837031-5cd7-425d-bf28-ba1854789318 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:03:01.044165 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f0485-4662-4e40-8f7d-3d6ddc2c3ece service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:03:01.044875 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f0485-4662-4e40-8f7d-3d6ddc2c3ece service nova] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:01.045187 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f0485-4662-4e40-8f7d-3d6ddc2c3ece service nova] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:01.045465 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f0485-4662-4e40-8f7d-3d6ddc2c3ece service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:01.048313 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-4d9f0485-4662-4e40-8f7d-3d6ddc2c3ece service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:01.106151 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:01.151737 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9f0485-4662-4e40-8f7d-3d6ddc2c3ece service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:03:01.154041 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9f0485-4662-4e40-8f7d-3d6ddc2c3ece service nova] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:03:01.176498 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 529/1062] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:03:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:03:03.313200 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a08a3-cc08-40f2-94f5-73fbac34fbc1 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:03.313744 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a08a3-cc08-40f2-94f5-73fbac34fbc1 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:03.313744 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a08a3-cc08-40f2-94f5-73fbac34fbc1 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:03.315100 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 534/1063] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 11:03:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 11:03:03.320890 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529750e7-f4bc-488a-9406-f540ec8e2185 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:03.321363 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529750e7-f4bc-488a-9406-f540ec8e2185 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:03.321461 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529750e7-f4bc-488a-9406-f540ec8e2185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:03.391708 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-529750e7-f4bc-488a-9406-f540ec8e2185 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:03:03.392939 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-529750e7-f4bc-488a-9406-f540ec8e2185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:03.488789 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 530/1064] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 11:03:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:03:03.777116 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a08a3-cc08-40f2-94f5-73fbac34fbc1 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:03:03.778618 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-535a08a3-cc08-40f2-94f5-73fbac34fbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:03.858416 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:03.936033 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a08a3-cc08-40f2-94f5-73fbac34fbc1 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:03:04.059949 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a2a7b-8de8-470a-9ce7-f9cc94430f51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:03:04.060593 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a2a7b-8de8-470a-9ce7-f9cc94430f51 service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:04.060877 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a2a7b-8de8-470a-9ce7-f9cc94430f51 service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:04.061155 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a2a7b-8de8-470a-9ce7-f9cc94430f51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:04.063322 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f35a2a7b-8de8-470a-9ce7-f9cc94430f51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:04.103352 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:04.156808 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a2a7b-8de8-470a-9ce7-f9cc94430f51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:03:04.158471 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a2a7b-8de8-470a-9ce7-f9cc94430f51 service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:03:04.176881 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 535/1065] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:03:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:03:06.605472 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bf2be-3f7f-427e-9b0a-3c3d1edffed8 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:06.606786 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bf2be-3f7f-427e-9b0a-3c3d1edffed8 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:06.606786 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bf2be-3f7f-427e-9b0a-3c3d1edffed8 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:06.607563 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 531/1066] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 11:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:03:06.614054 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb8470-391c-4d0c-ad06-6863eb97d4b5 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:06.614537 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb8470-391c-4d0c-ad06-6863eb97d4b5 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:06.614802 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb8470-391c-4d0c-ad06-6863eb97d4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:06.698995 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-34eb8470-391c-4d0c-ad06-6863eb97d4b5 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:03:06.700394 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-34eb8470-391c-4d0c-ad06-6863eb97d4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:06.824909 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 536/1067] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 11:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:03:07.146547 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5bf2be-3f7f-427e-9b0a-3c3d1edffed8 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:03:07.148350 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-6d5bf2be-3f7f-427e-9b0a-3c3d1edffed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:07.187061 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:07.321981 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5bf2be-3f7f-427e-9b0a-3c3d1edffed8 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:03:07.433732 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:07.445105 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d89f49-d8a9-431c-b720-37b069dec777 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:03:07.445750 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d89f49-d8a9-431c-b720-37b069dec777 service nova] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:07.447164 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d89f49-d8a9-431c-b720-37b069dec777 service nova] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:07.447164 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d89f49-d8a9-431c-b720-37b069dec777 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:07.448227 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-38d89f49-d8a9-431c-b720-37b069dec777 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:07.543673 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d89f49-d8a9-431c-b720-37b069dec777 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:03:07.545303 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d89f49-d8a9-431c-b720-37b069dec777 service nova] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:03:07.563818 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 532/1068] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:03:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:03:08.795838 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bf3bd-1d0d-44eb-b339-15162f07987a None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:08.796430 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bf3bd-1d0d-44eb-b339-15162f07987a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:08.796537 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bf3bd-1d0d-44eb-b339-15162f07987a None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:08.799113 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 537/1069] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 11:03:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:03:08.806716 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5540310-0f8f-40f3-8f74-89ec2359a6fd None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:08.807355 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5540310-0f8f-40f3-8f74-89ec2359a6fd None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:08.807355 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5540310-0f8f-40f3-8f74-89ec2359a6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:08.885111 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-d5540310-0f8f-40f3-8f74-89ec2359a6fd None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:03:08.886471 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-d5540310-0f8f-40f3-8f74-89ec2359a6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:08.953618 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:08.995263 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 533/1070] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 11:03:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:03:09.342153 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a602c3-a170-4517-bcbd-b81397b5882e None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:09.342472 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a602c3-a170-4517-bcbd-b81397b5882e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:09.342854 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a602c3-a170-4517-bcbd-b81397b5882e None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:09.345004 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 538/1071] 10.222.0.45 () {54 vars in 962 bytes} [Wed Oct 26 11:03:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:03:09.350679 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd069d30-7997-48b0-943d-662ee9f6ddc0 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:09.350970 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd069d30-7997-48b0-943d-662ee9f6ddc0 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:09.351245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd069d30-7997-48b0-943d-662ee9f6ddc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:09.429442 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-cd069d30-7997-48b0-943d-662ee9f6ddc0 None None] MFA Rules not processed for user `29d0e8cc074b4e36acc2162aebeac169`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:03:09.430701 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-cd069d30-7997-48b0-943d-662ee9f6ddc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:09.507964 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 534/1072] 10.222.0.45 () {58 vars in 1059 bytes} [Wed Oct 26 11:03:09 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:03:09.516679 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a602c3-a170-4517-bcbd-b81397b5882e None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:03:09.518231 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b7a602c3-a170-4517-bcbd-b81397b5882e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:09.532854 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:09.624176 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a602c3-a170-4517-bcbd-b81397b5882e None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:03:09.700552 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3f400-95f6-4747-ac49-9ae40ba8d380 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d0e8cc074b4e36acc2162aebeac169', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:03:09.701168 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3f400-95f6-4747-ac49-9ae40ba8d380 service glance] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:09.701463 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3f400-95f6-4747-ac49-9ae40ba8d380 service glance] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:09.701726 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3f400-95f6-4747-ac49-9ae40ba8d380 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:09.703337 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-dba3f400-95f6-4747-ac49-9ae40ba8d380 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:09.778508 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:09.819860 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3f400-95f6-4747-ac49-9ae40ba8d380 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:03:09.821339 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3f400-95f6-4747-ac49-9ae40ba8d380 service glance] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:03:09.840581 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 539/1073] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:03:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:03:09.967916 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282c03d-effe-4b54-b4ae-70e3b3aeda50 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:09.968539 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282c03d-effe-4b54-b4ae-70e3b3aeda50 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:09.968623 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282c03d-effe-4b54-b4ae-70e3b3aeda50 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:09.970021 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 535/1074] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 11:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:03:09.975557 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9b615-3c9d-4ffa-a113-01c2fc5ac96f None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:09.975880 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9b615-3c9d-4ffa-a113-01c2fc5ac96f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:09.976221 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9b615-3c9d-4ffa-a113-01c2fc5ac96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:10.055816 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-99b9b615-3c9d-4ffa-a113-01c2fc5ac96f None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:03:10.057199 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-99b9b615-3c9d-4ffa-a113-01c2fc5ac96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:10.166317 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 540/1075] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 11:03:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:03:10.462591 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282c03d-effe-4b54-b4ae-70e3b3aeda50 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:03:10.464176 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-7282c03d-effe-4b54-b4ae-70e3b3aeda50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:10.548563 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:10.640145 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282c03d-effe-4b54-b4ae-70e3b3aeda50 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:03:10.761317 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75987d62-4a06-476e-a152-bff349d0996d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:10.761691 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75987d62-4a06-476e-a152-bff349d0996d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:10.762042 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75987d62-4a06-476e-a152-bff349d0996d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:10.766590 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e24ab1-064a-48f8-8720-43cc17edc73d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:03:10.767207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e24ab1-064a-48f8-8720-43cc17edc73d service nova] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:10.767483 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e24ab1-064a-48f8-8720-43cc17edc73d service nova] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:10.767752 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e24ab1-064a-48f8-8720-43cc17edc73d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:10.769683 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-90e24ab1-064a-48f8-8720-43cc17edc73d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:10.795036 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:10.796408 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:10.846659 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-75987d62-4a06-476e-a152-bff349d0996d None None] MFA Rules not processed for user `3c90765757a34c6291c9980a7d5d5c79`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:03:10.848094 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-75987d62-4a06-476e-a152-bff349d0996d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:10.873285 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e24ab1-064a-48f8-8720-43cc17edc73d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:03:10.875418 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e24ab1-064a-48f8-8720-43cc17edc73d service nova] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:03:10.894132 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 536/1076] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:03:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:03:10.938355 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 541/1077] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Oct 26 11:03:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:03:10.987757 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e15ea-4f78-4a68-9629-10c9a30e6407 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:10.987757 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e15ea-4f78-4a68-9629-10c9a30e6407 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:10.987757 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e15ea-4f78-4a68-9629-10c9a30e6407 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:10.990404 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 537/1078] 10.222.0.45 () {54 vars in 943 bytes} [Wed Oct 26 11:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:03:10.996224 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f831fe9-b779-406b-8565-5643bdae558d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:10.996914 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f831fe9-b779-406b-8565-5643bdae558d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:10.997541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f831fe9-b779-406b-8565-5643bdae558d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:11.088354 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-0f831fe9-b779-406b-8565-5643bdae558d None None] MFA Rules not processed for user `d21b84cc38a848de8d19a41e1eb04a58`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:03:11.129912 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0f831fe9-b779-406b-8565-5643bdae558d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:11.151262 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:11.209202 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 542/1079] 10.222.0.45 () {58 vars in 1040 bytes} [Wed Oct 26 11:03:10 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:03:11.218814 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e15ea-4f78-4a68-9629-10c9a30e6407 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:03:11.220449 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-b12e15ea-4f78-4a68-9629-10c9a30e6407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:11.373179 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e15ea-4f78-4a68-9629-10c9a30e6407 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:03:11.388673 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:11.496022 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1428a-5d12-49ca-a5ad-ff72aea8e692 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21b84cc38a848de8d19a41e1eb04a58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:03:11.496662 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1428a-5d12-49ca-a5ad-ff72aea8e692 service swift] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:11.496938 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1428a-5d12-49ca-a5ad-ff72aea8e692 service swift] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:11.497207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1428a-5d12-49ca-a5ad-ff72aea8e692 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:11.498865 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-00c1428a-5d12-49ca-a5ad-ff72aea8e692 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:11.595788 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1428a-5d12-49ca-a5ad-ff72aea8e692 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:03:11.597438 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1428a-5d12-49ca-a5ad-ff72aea8e692 service swift] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:03:11.607008 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 538/1080] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Oct 26 11:03:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 26 11:03:13.621045 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67e025-e16e-4ec8-b7de-29f2f03fe514 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:13.621574 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67e025-e16e-4ec8-b7de-29f2f03fe514 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:13.621574 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67e025-e16e-4ec8-b7de-29f2f03fe514 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:13.622864 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 543/1081] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 11:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:03:13.628146 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2712f-a64d-4832-9db4-a334cb250a58 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:13.628539 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2712f-a64d-4832-9db4-a334cb250a58 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:13.628709 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2712f-a64d-4832-9db4-a334cb250a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:13.684350 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:13.699333 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-81b2712f-a64d-4832-9db4-a334cb250a58 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:03:13.700580 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-81b2712f-a64d-4832-9db4-a334cb250a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:13.810104 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 539/1082] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 11:03:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:03:14.126644 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d67e025-e16e-4ec8-b7de-29f2f03fe514 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:03:14.128196 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3d67e025-e16e-4ec8-b7de-29f2f03fe514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:14.316785 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d67e025-e16e-4ec8-b7de-29f2f03fe514 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:03:14.359648 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:14.478423 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc3ee3a-b266-462f-aada-14f8174d8b8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:03:14.479045 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3ee3a-b266-462f-aada-14f8174d8b8f service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:14.479329 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3ee3a-b266-462f-aada-14f8174d8b8f service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:14.479614 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3ee3a-b266-462f-aada-14f8174d8b8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:14.481266 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3cc3ee3a-b266-462f-aada-14f8174d8b8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:14.580829 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc3ee3a-b266-462f-aada-14f8174d8b8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:03:14.582452 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc3ee3a-b266-462f-aada-14f8174d8b8f service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:03:14.614673 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 544/1083] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:03:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:03:17.488080 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677b5c2-4d06-4a0d-8d0c-a8fe860133b1 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:17.488756 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677b5c2-4d06-4a0d-8d0c-a8fe860133b1 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:17.488937 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677b5c2-4d06-4a0d-8d0c-a8fe860133b1 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:17.490371 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 540/1084] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 11:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:03:17.495918 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc3fa7-fc6b-420a-aa32-bb6ba7eece54 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:17.496730 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc3fa7-fc6b-420a-aa32-bb6ba7eece54 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:17.497010 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc3fa7-fc6b-420a-aa32-bb6ba7eece54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:17.540832 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:17.570060 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-a2bc3fa7-fc6b-420a-aa32-bb6ba7eece54 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:03:17.572206 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a2bc3fa7-fc6b-420a-aa32-bb6ba7eece54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:17.681932 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 545/1085] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 11:03:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:03:17.972283 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677b5c2-4d06-4a0d-8d0c-a8fe860133b1 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:03:17.973957 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-e677b5c2-4d06-4a0d-8d0c-a8fe860133b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:18.107885 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:18.138517 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677b5c2-4d06-4a0d-8d0c-a8fe860133b1 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:03:18.267973 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317aa71f-40d0-4c54-ad41-c9480ab31db9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:03:18.268523 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317aa71f-40d0-4c54-ad41-c9480ab31db9 service nova] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:18.268804 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317aa71f-40d0-4c54-ad41-c9480ab31db9 service nova] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:18.269083 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317aa71f-40d0-4c54-ad41-c9480ab31db9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:18.270692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-317aa71f-40d0-4c54-ad41-c9480ab31db9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:18.364839 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:18.375490 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317aa71f-40d0-4c54-ad41-c9480ab31db9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:03:18.380096 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317aa71f-40d0-4c54-ad41-c9480ab31db9 service nova] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:03:18.398397 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 541/1086] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:03:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:03:27.680276 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=51 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:28.399882 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=8 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:36.345646 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcf98f-a38b-4511-bf2b-bbc0b19820a8 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:36.346122 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcf98f-a38b-4511-bf2b-bbc0b19820a8 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:36.346217 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcf98f-a38b-4511-bf2b-bbc0b19820a8 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:36.347567 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 546/1087] 10.222.0.45 () {54 vars in 918 bytes} [Wed Oct 26 11:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:03:36.352760 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd3e24-9cbf-4e0d-8698-b389bb83ead0 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:36.353268 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd3e24-9cbf-4e0d-8698-b389bb83ead0 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:36.353366 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd3e24-9cbf-4e0d-8698-b389bb83ead0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:36.428462 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-9cdd3e24-9cbf-4e0d-8698-b389bb83ead0 None None] MFA Rules not processed for user `b4f9a2bba0e748b6a98fa7dea2482ddf`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:03:36.429674 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-9cdd3e24-9cbf-4e0d-8698-b389bb83ead0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:36.534336 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 542/1088] 10.222.0.45 () {58 vars in 1015 bytes} [Wed Oct 26 11:03:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:03:36.548930 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f0a56-438e-4c58-a15f-966b383dd08b None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:36.549216 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f0a56-438e-4c58-a15f-966b383dd08b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:36.549491 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f0a56-438e-4c58-a15f-966b383dd08b None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:36.550821 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 547/1089] 10.222.0.45 () {54 vars in 918 bytes} [Wed Oct 26 11:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:03:36.555147 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090ccc6-4501-4bff-b592-cdb11a0ce3a2 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:36.555431 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090ccc6-4501-4bff-b592-cdb11a0ce3a2 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:36.555704 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090ccc6-4501-4bff-b592-cdb11a0ce3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:36.628154 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:36.630546 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-2090ccc6-4501-4bff-b592-cdb11a0ce3a2 None None] MFA Rules not processed for user `a852a777cb6a4863bebdb949cc71ea65`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:03:36.631744 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-2090ccc6-4501-4bff-b592-cdb11a0ce3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:36.746276 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 543/1090] 10.222.0.45 () {58 vars in 1015 bytes} [Wed Oct 26 11:03:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:03:39.324641 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606d9eb-6417-4242-9aa2-5771748d1b59 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:39.325160 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606d9eb-6417-4242-9aa2-5771748d1b59 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:39.325268 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606d9eb-6417-4242-9aa2-5771748d1b59 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:39.326587 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 548/1091] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 26 11:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 11:03:39.332016 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf38a9b-ea15-4cf7-9b8e-581fd8edc627 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:39.332551 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf38a9b-ea15-4cf7-9b8e-581fd8edc627 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:39.332675 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf38a9b-ea15-4cf7-9b8e-581fd8edc627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:39.398563 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-fcf38a9b-ea15-4cf7-9b8e-581fd8edc627 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:03:39.399764 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-fcf38a9b-ea15-4cf7-9b8e-581fd8edc627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:39.453345 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:39.494801 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 544/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 26 11:03:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:03:39.785154 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606d9eb-6417-4242-9aa2-5771748d1b59 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:03:39.786675 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a606d9eb-6417-4242-9aa2-5771748d1b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:39.932212 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606d9eb-6417-4242-9aa2-5771748d1b59 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:03:40.004880 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:40.043670 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85d955-af8d-4211-a30e-4de2ff233c85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:03:40.044308 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85d955-af8d-4211-a30e-4de2ff233c85 service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:40.044584 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85d955-af8d-4211-a30e-4de2ff233c85 service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:40.044852 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85d955-af8d-4211-a30e-4de2ff233c85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:40.046999 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4a85d955-af8d-4211-a30e-4de2ff233c85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:40.133260 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a85d955-af8d-4211-a30e-4de2ff233c85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:03:40.134853 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a85d955-af8d-4211-a30e-4de2ff233c85 service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:03:40.152339 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 549/1093] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:03:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:03:41.295387 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6a8ba-0b84-4fb7-a467-973ad280957f None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:41.295923 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6a8ba-0b84-4fb7-a467-973ad280957f None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:41.295923 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6a8ba-0b84-4fb7-a467-973ad280957f None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:41.297859 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 545/1094] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 26 11:03:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:03:41.302775 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7db9bb-c606-4519-a19e-748d85404760 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:41.303174 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7db9bb-c606-4519-a19e-748d85404760 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:41.303358 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7db9bb-c606-4519-a19e-748d85404760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:41.379287 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-5d7db9bb-c606-4519-a19e-748d85404760 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:03:41.380525 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5d7db9bb-c606-4519-a19e-748d85404760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:41.407254 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:41.477286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 550/1095] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 26 11:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:03:41.644938 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6a8ba-0b84-4fb7-a467-973ad280957f None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:03:41.646430 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-fae6a8ba-0b84-4fb7-a467-973ad280957f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:41.790139 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6a8ba-0b84-4fb7-a467-973ad280957f None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:03:41.830665 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:41.902279 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5baa7fd-4eea-4768-8951-3c3aa1f1dbe3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:03:41.902822 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5baa7fd-4eea-4768-8951-3c3aa1f1dbe3 service nova] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:41.903101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5baa7fd-4eea-4768-8951-3c3aa1f1dbe3 service nova] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:41.903375 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5baa7fd-4eea-4768-8951-3c3aa1f1dbe3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:41.905038 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-e5baa7fd-4eea-4768-8951-3c3aa1f1dbe3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:41.994396 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5baa7fd-4eea-4768-8951-3c3aa1f1dbe3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:03:41.995980 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5baa7fd-4eea-4768-8951-3c3aa1f1dbe3 service nova] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:03:42.013554 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 546/1096] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:03:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:03:43.139421 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163fcea-cf20-40a0-8f4e-26695d0b21a2 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:43.140050 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163fcea-cf20-40a0-8f4e-26695d0b21a2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:43.140050 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163fcea-cf20-40a0-8f4e-26695d0b21a2 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:43.141395 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 551/1097] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 26 11:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:03:43.146370 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a0eab-335a-4a1f-930f-a739873e133d None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:43.146786 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a0eab-335a-4a1f-930f-a739873e133d None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:43.146920 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a0eab-335a-4a1f-930f-a739873e133d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:43.200859 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:43.222541 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-0f0a0eab-335a-4a1f-930f-a739873e133d None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:03:43.223763 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-0f0a0eab-335a-4a1f-930f-a739873e133d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:43.319378 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 547/1098] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 26 11:03:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:03:43.468993 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8163fcea-cf20-40a0-8f4e-26695d0b21a2 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:03:43.470437 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8163fcea-cf20-40a0-8f4e-26695d0b21a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:43.615314 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8163fcea-cf20-40a0-8f4e-26695d0b21a2 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:03:43.627601 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:43.727867 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f19b5c-190b-4bff-b40b-952ff2b3b1b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:03:43.728428 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f19b5c-190b-4bff-b40b-952ff2b3b1b7 service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:43.728712 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f19b5c-190b-4bff-b40b-952ff2b3b1b7 service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:43.728990 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f19b5c-190b-4bff-b40b-952ff2b3b1b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:43.730598 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c3f19b5c-190b-4bff-b40b-952ff2b3b1b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:43.819150 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f19b5c-190b-4bff-b40b-952ff2b3b1b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:03:43.821016 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f19b5c-190b-4bff-b40b-952ff2b3b1b7 service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:03:43.838431 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 552/1099] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:03:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:03:44.920203 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f807dcd-5907-44cd-9800-3cc3e64fead3 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:44.920765 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f807dcd-5907-44cd-9800-3cc3e64fead3 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:44.920765 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f807dcd-5907-44cd-9800-3cc3e64fead3 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:44.922603 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 548/1100] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 26 11:03:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:03:44.927484 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e183b-172c-4b2f-8244-3bd572193479 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:44.927886 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e183b-172c-4b2f-8244-3bd572193479 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:44.928032 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e183b-172c-4b2f-8244-3bd572193479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:44.948409 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:45.003977 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-a57e183b-172c-4b2f-8244-3bd572193479 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:03:45.005231 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a57e183b-172c-4b2f-8244-3bd572193479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:45.100443 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 553/1101] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 26 11:03:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:03:45.252710 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f807dcd-5907-44cd-9800-3cc3e64fead3 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:03:45.254178 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-4f807dcd-5907-44cd-9800-3cc3e64fead3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:45.362026 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:45.397844 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f807dcd-5907-44cd-9800-3cc3e64fead3 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:03:45.507464 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f1cee-8a6d-47f3-ace8-95e8ae573266 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:03:45.508002 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f1cee-8a6d-47f3-ace8-95e8ae573266 service nova] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:45.508312 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f1cee-8a6d-47f3-ace8-95e8ae573266 service nova] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:45.508583 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f1cee-8a6d-47f3-ace8-95e8ae573266 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:45.510184 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-5a6f1cee-8a6d-47f3-ace8-95e8ae573266 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:45.586033 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:45.599008 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6f1cee-8a6d-47f3-ace8-95e8ae573266 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:03:45.601701 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6f1cee-8a6d-47f3-ace8-95e8ae573266 service nova] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:03:45.618413 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 549/1102] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:03:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:03:46.705306 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972ccf2-f608-442e-9c44-cdb76f45f36a None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:46.705864 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972ccf2-f608-442e-9c44-cdb76f45f36a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:46.705976 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972ccf2-f608-442e-9c44-cdb76f45f36a None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:46.707362 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 554/1103] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 26 11:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:03:46.712290 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a884008-dcbe-4760-8283-e67a0fd6644d None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:46.712676 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a884008-dcbe-4760-8283-e67a0fd6644d None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:46.712845 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a884008-dcbe-4760-8283-e67a0fd6644d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:46.787231 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-9a884008-dcbe-4760-8283-e67a0fd6644d None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:03:46.788479 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-9a884008-dcbe-4760-8283-e67a0fd6644d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:46.882892 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 550/1104] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 26 11:03:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:03:47.032807 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6972ccf2-f608-442e-9c44-cdb76f45f36a None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:03:47.034325 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6972ccf2-f608-442e-9c44-cdb76f45f36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:47.122771 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:47.184570 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6972ccf2-f608-442e-9c44-cdb76f45f36a None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:03:47.294788 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a1d53-768e-4eff-a002-8eda1f4c4c01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:03:47.295401 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a1d53-768e-4eff-a002-8eda1f4c4c01 service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:47.295683 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a1d53-768e-4eff-a002-8eda1f4c4c01 service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:47.295956 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a1d53-768e-4eff-a002-8eda1f4c4c01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:47.298110 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6a4a1d53-768e-4eff-a002-8eda1f4c4c01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:47.346334 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:47.386616 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a1d53-768e-4eff-a002-8eda1f4c4c01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:03:47.388343 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a1d53-768e-4eff-a002-8eda1f4c4c01 service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:03:47.406233 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 555/1105] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:03:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:03:48.529048 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3662b86-7b29-4a1b-b0d9-3f6da5ab3a13 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:48.529613 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3662b86-7b29-4a1b-b0d9-3f6da5ab3a13 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:48.529613 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3662b86-7b29-4a1b-b0d9-3f6da5ab3a13 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:48.530974 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 551/1106] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 26 11:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:03:48.535750 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a561b6-0af1-4653-88c3-0ce48b65a575 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:48.536185 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a561b6-0af1-4653-88c3-0ce48b65a575 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:48.536347 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a561b6-0af1-4653-88c3-0ce48b65a575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:48.612590 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-d3a561b6-0af1-4653-88c3-0ce48b65a575 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:03:48.613804 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d3a561b6-0af1-4653-88c3-0ce48b65a575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:48.711123 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 556/1107] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 26 11:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:03:48.860128 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3662b86-7b29-4a1b-b0d9-3f6da5ab3a13 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:03:48.861592 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-a3662b86-7b29-4a1b-b0d9-3f6da5ab3a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:48.910629 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:49.006023 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3662b86-7b29-4a1b-b0d9-3f6da5ab3a13 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:03:49.116459 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d389cda-aab8-4337-8ec3-d3d25a683038 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:03:49.116999 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d389cda-aab8-4337-8ec3-d3d25a683038 service nova] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:49.117280 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d389cda-aab8-4337-8ec3-d3d25a683038 service nova] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:49.117554 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d389cda-aab8-4337-8ec3-d3d25a683038 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:49.119156 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-0d389cda-aab8-4337-8ec3-d3d25a683038 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:49.126496 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:49.215881 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d389cda-aab8-4337-8ec3-d3d25a683038 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:03:49.217562 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d389cda-aab8-4337-8ec3-d3d25a683038 service nova] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:03:49.235394 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 552/1108] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:03:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:03:50.328299 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c6f21-aaae-4958-876c-55432062b893 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:50.328830 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c6f21-aaae-4958-876c-55432062b893 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:50.328830 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c6f21-aaae-4958-876c-55432062b893 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:50.330202 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 557/1109] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 26 11:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:03:50.335278 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7923a62-d830-4c08-9343-7c6995c017d1 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:50.335728 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7923a62-d830-4c08-9343-7c6995c017d1 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:50.335966 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7923a62-d830-4c08-9343-7c6995c017d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:50.411696 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-b7923a62-d830-4c08-9343-7c6995c017d1 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:03:50.412869 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-b7923a62-d830-4c08-9343-7c6995c017d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:50.479912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:50.508528 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 553/1110] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 26 11:03:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:03:50.657799 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c6f21-aaae-4958-876c-55432062b893 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:03:50.659371 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2f5c6f21-aaae-4958-876c-55432062b893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:50.677696 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:50.805637 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c6f21-aaae-4958-876c-55432062b893 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:03:50.893079 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:50.917851 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13a303-e2fd-4b63-bfc4-cba5f3e0c2eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:03:50.918471 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13a303-e2fd-4b63-bfc4-cba5f3e0c2eb service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:50.918761 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13a303-e2fd-4b63-bfc4-cba5f3e0c2eb service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:50.919040 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13a303-e2fd-4b63-bfc4-cba5f3e0c2eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:50.920711 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ef13a303-e2fd-4b63-bfc4-cba5f3e0c2eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:51.009631 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13a303-e2fd-4b63-bfc4-cba5f3e0c2eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:03:51.011305 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13a303-e2fd-4b63-bfc4-cba5f3e0c2eb service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:03:51.029088 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 558/1111] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:03:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:03:52.148016 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee326ac4-9112-46a4-a442-d4f163a2e6b2 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:52.148600 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee326ac4-9112-46a4-a442-d4f163a2e6b2 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:52.148600 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee326ac4-9112-46a4-a442-d4f163a2e6b2 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:52.150003 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 554/1112] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 26 11:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:03:52.154925 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892e90d-2424-44c3-98a3-c717a0c96772 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:52.155366 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892e90d-2424-44c3-98a3-c717a0c96772 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:52.155510 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892e90d-2424-44c3-98a3-c717a0c96772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:52.231283 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-0892e90d-2424-44c3-98a3-c717a0c96772 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:03:52.232527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0892e90d-2424-44c3-98a3-c717a0c96772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:52.275019 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:52.329298 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 559/1113] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 26 11:03:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:03:52.478683 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee326ac4-9112-46a4-a442-d4f163a2e6b2 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:03:52.480166 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-ee326ac4-9112-46a4-a442-d4f163a2e6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:52.623817 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee326ac4-9112-46a4-a442-d4f163a2e6b2 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:03:52.678255 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:52.737636 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89383a-61a5-41b8-9990-765a961f32f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:03:52.738174 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89383a-61a5-41b8-9990-765a961f32f2 service nova] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:52.738452 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89383a-61a5-41b8-9990-765a961f32f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:52.738720 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89383a-61a5-41b8-9990-765a961f32f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:52.740361 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-0d89383a-61a5-41b8-9990-765a961f32f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:52.827839 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89383a-61a5-41b8-9990-765a961f32f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:03:52.829461 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89383a-61a5-41b8-9990-765a961f32f2 service nova] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:03:52.847399 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 555/1114] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:03:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:03:53.963063 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64f640-24f3-431b-b167-25ccd30539ff None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:53.963608 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64f640-24f3-431b-b167-25ccd30539ff None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:53.963608 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64f640-24f3-431b-b167-25ccd30539ff None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:53.964997 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 560/1115] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 26 11:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:03:53.970401 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b7306-d81c-40a7-853f-c4bc00d4d5b2 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:53.970812 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b7306-d81c-40a7-853f-c4bc00d4d5b2 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:53.970953 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b7306-d81c-40a7-853f-c4bc00d4d5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:54.047203 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-a85b7306-d81c-40a7-853f-c4bc00d4d5b2 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:03:54.048437 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-a85b7306-d81c-40a7-853f-c4bc00d4d5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:54.050421 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:54.143901 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 556/1116] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 26 11:03:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:03:54.291793 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64f640-24f3-431b-b167-25ccd30539ff None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:03:54.293342 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-dc64f640-24f3-431b-b167-25ccd30539ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:54.437560 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64f640-24f3-431b-b167-25ccd30539ff None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:03:54.463769 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:54.549531 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392409a-fd27-420e-90a2-18c52e141366 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:03:54.550075 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392409a-fd27-420e-90a2-18c52e141366 service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:54.550352 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392409a-fd27-420e-90a2-18c52e141366 service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:54.550625 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392409a-fd27-420e-90a2-18c52e141366 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:54.552243 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2392409a-fd27-420e-90a2-18c52e141366 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:54.640042 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2392409a-fd27-420e-90a2-18c52e141366 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:03:54.641680 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2392409a-fd27-420e-90a2-18c52e141366 service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:03:54.659250 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 561/1117] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:03:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:03:56.713387 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5748c-a47c-47f7-9202-3484cc36dc46 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:56.713981 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5748c-a47c-47f7-9202-3484cc36dc46 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:56.713981 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5748c-a47c-47f7-9202-3484cc36dc46 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:56.715294 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 557/1118] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 26 11:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:03:56.720664 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015367a5-a316-44ff-815e-fe978c8e201b None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:56.721068 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015367a5-a316-44ff-815e-fe978c8e201b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:56.721214 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015367a5-a316-44ff-815e-fe978c8e201b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:56.761918 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:56.786745 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-015367a5-a316-44ff-815e-fe978c8e201b None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:03:56.788655 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-015367a5-a316-44ff-815e-fe978c8e201b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:56.885733 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 562/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 26 11:03:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:03:57.170477 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5748c-a47c-47f7-9202-3484cc36dc46 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:03:57.172033 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-66d5748c-a47c-47f7-9202-3484cc36dc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:57.276179 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5748c-a47c-47f7-9202-3484cc36dc46 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:03:57.307414 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:57.350094 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29674cd0-3ea0-45e1-92d8-ecd25f492941 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:03:57.350703 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29674cd0-3ea0-45e1-92d8-ecd25f492941 service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:57.350981 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29674cd0-3ea0-45e1-92d8-ecd25f492941 service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:57.351256 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29674cd0-3ea0-45e1-92d8-ecd25f492941 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:57.352879 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-29674cd0-3ea0-45e1-92d8-ecd25f492941 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:57.460744 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29674cd0-3ea0-45e1-92d8-ecd25f492941 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:03:57.462104 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29674cd0-3ea0-45e1-92d8-ecd25f492941 service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:03:57.479529 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 558/1120] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:03:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:03:59.757725 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d081d-c8f2-4c40-a9a8-758725cc2ee8 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:59.758267 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d081d-c8f2-4c40-a9a8-758725cc2ee8 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:59.758267 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d081d-c8f2-4c40-a9a8-758725cc2ee8 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:59.759623 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 563/1121] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 26 11:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:03:59.764767 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2c328-4835-44b4-93a0-a39f4ec58c5f None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:59.765651 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2c328-4835-44b4-93a0-a39f4ec58c5f None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:59.765837 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2c328-4835-44b4-93a0-a39f4ec58c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:59.831462 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-c6c2c328-4835-44b4-93a0-a39f4ec58c5f None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:03:59.832694 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-c6c2c328-4835-44b4-93a0-a39f4ec58c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:59.845917 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:59.928335 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 559/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 26 11:03:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:04:00.213122 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d081d-c8f2-4c40-a9a8-758725cc2ee8 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:00.215786 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7c5d081d-c8f2-4c40-a9a8-758725cc2ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:00.318175 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d081d-c8f2-4c40-a9a8-758725cc2ee8 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:00.331280 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:00.392397 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115517a-2964-492c-be16-5075b9a313f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:00.393009 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115517a-2964-492c-be16-5075b9a313f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:00.393321 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115517a-2964-492c-be16-5075b9a313f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:00.393600 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115517a-2964-492c-be16-5075b9a313f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:00.395203 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4115517a-2964-492c-be16-5075b9a313f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:00.502935 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4115517a-2964-492c-be16-5075b9a313f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:00.504330 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4115517a-2964-492c-be16-5075b9a313f5 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:00.522491 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 564/1123] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:04:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:04:03.048854 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7fc1e1-e8f6-4e18-83b9-e2efd9e332c4 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:03.049380 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7fc1e1-e8f6-4e18-83b9-e2efd9e332c4 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:03.049511 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7fc1e1-e8f6-4e18-83b9-e2efd9e332c4 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:03.050763 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 560/1124] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 26 11:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:04:03.055976 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b877e74-69b0-4656-ab81-9d00a5af2924 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:03.056400 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b877e74-69b0-4656-ab81-9d00a5af2924 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:03.056633 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b877e74-69b0-4656-ab81-9d00a5af2924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:03.104958 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:03.122637 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-4b877e74-69b0-4656-ab81-9d00a5af2924 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:03.123854 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4b877e74-69b0-4656-ab81-9d00a5af2924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:03.221426 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 565/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 26 11:04:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:04:03.511148 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7fc1e1-e8f6-4e18-83b9-e2efd9e332c4 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:03.512733 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-4c7fc1e1-e8f6-4e18-83b9-e2efd9e332c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:03.621392 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7fc1e1-e8f6-4e18-83b9-e2efd9e332c4 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:03.661153 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:03.694589 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba369d2-e950-4a05-8f1c-deab653b7fcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:03.695195 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba369d2-e950-4a05-8f1c-deab653b7fcc service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:03.695478 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba369d2-e950-4a05-8f1c-deab653b7fcc service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:03.695752 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba369d2-e950-4a05-8f1c-deab653b7fcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:03.697662 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-1ba369d2-e950-4a05-8f1c-deab653b7fcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:03.805948 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba369d2-e950-4a05-8f1c-deab653b7fcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:03.807385 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba369d2-e950-4a05-8f1c-deab653b7fcc service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:03.825766 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 561/1126] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:04:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:04:06.096522 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6724d-292a-408c-b519-81d91c30dfbc None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:06.097076 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6724d-292a-408c-b519-81d91c30dfbc None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:06.097076 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6724d-292a-408c-b519-81d91c30dfbc None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:06.098414 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 566/1127] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 26 11:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:04:06.103593 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c7e23-0dca-4102-afdc-415789ee09df None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:06.104024 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c7e23-0dca-4102-afdc-415789ee09df None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:06.104195 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c7e23-0dca-4102-afdc-415789ee09df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:06.171803 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-636c7e23-0dca-4102-afdc-415789ee09df None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:06.173079 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-636c7e23-0dca-4102-afdc-415789ee09df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:06.193821 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:06.269420 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 562/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 26 11:04:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:04:06.550004 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6724d-292a-408c-b519-81d91c30dfbc None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:06.551527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-bed6724d-292a-408c-b519-81d91c30dfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:06.654850 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6724d-292a-408c-b519-81d91c30dfbc None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:06.675707 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:06.730958 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d7702-44d4-4d16-9d52-ea519197cd1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:06.731572 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d7702-44d4-4d16-9d52-ea519197cd1c service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:06.731854 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d7702-44d4-4d16-9d52-ea519197cd1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:06.732161 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d7702-44d4-4d16-9d52-ea519197cd1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:06.734260 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9c7d7702-44d4-4d16-9d52-ea519197cd1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:06.847192 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d7702-44d4-4d16-9d52-ea519197cd1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:06.848582 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d7702-44d4-4d16-9d52-ea519197cd1c service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:06.867228 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 567/1129] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:04:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:04:09.096173 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89305fc5-3ead-447d-92ae-5b2c1398f89d None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:09.096729 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89305fc5-3ead-447d-92ae-5b2c1398f89d None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:09.096729 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89305fc5-3ead-447d-92ae-5b2c1398f89d None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:09.098111 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 563/1130] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 26 11:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:04:09.103431 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d9e69-451f-4696-938a-243bbb9ba285 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:09.103843 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d9e69-451f-4696-938a-243bbb9ba285 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:09.104005 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d9e69-451f-4696-938a-243bbb9ba285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:09.167868 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:09.170752 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-aa9d9e69-451f-4696-938a-243bbb9ba285 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:09.171967 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-aa9d9e69-451f-4696-938a-243bbb9ba285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:09.274479 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 568/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 26 11:04:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:04:09.554274 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89305fc5-3ead-447d-92ae-5b2c1398f89d None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:09.555834 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-89305fc5-3ead-447d-92ae-5b2c1398f89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:09.658742 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89305fc5-3ead-447d-92ae-5b2c1398f89d None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:09.707850 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:09.731598 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7119cf4-453e-41d3-b112-6326878d557b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:09.732242 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7119cf4-453e-41d3-b112-6326878d557b service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:09.732527 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7119cf4-453e-41d3-b112-6326878d557b service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:09.732799 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7119cf4-453e-41d3-b112-6326878d557b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:09.734426 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-b7119cf4-453e-41d3-b112-6326878d557b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:09.841423 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7119cf4-453e-41d3-b112-6326878d557b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:09.842764 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7119cf4-453e-41d3-b112-6326878d557b service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:09.861434 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 564/1132] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:04:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:04:12.080986 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc0547-5994-4eaf-a1d0-7d80cf01bf66 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:12.081535 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc0547-5994-4eaf-a1d0-7d80cf01bf66 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:12.081634 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc0547-5994-4eaf-a1d0-7d80cf01bf66 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:12.082931 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 569/1133] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 26 11:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:04:12.088333 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0dfb7f-0c37-48c5-9e6d-6679a3d5e412 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:12.088786 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0dfb7f-0c37-48c5-9e6d-6679a3d5e412 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:12.088885 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0dfb7f-0c37-48c5-9e6d-6679a3d5e412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:12.154904 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-9c0dfb7f-0c37-48c5-9e6d-6679a3d5e412 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:12.156152 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-9c0dfb7f-0c37-48c5-9e6d-6679a3d5e412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:12.185385 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:12.253038 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 565/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 26 11:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:04:12.538507 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc0547-5994-4eaf-a1d0-7d80cf01bf66 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:12.540100 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-64cc0547-5994-4eaf-a1d0-7d80cf01bf66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:12.642460 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc0547-5994-4eaf-a1d0-7d80cf01bf66 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:12.670287 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:12.715809 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58c6a2-bf9c-432f-9f8b-cd60ba1c5066 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:12.716456 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58c6a2-bf9c-432f-9f8b-cd60ba1c5066 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:12.716774 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58c6a2-bf9c-432f-9f8b-cd60ba1c5066 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:12.717062 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58c6a2-bf9c-432f-9f8b-cd60ba1c5066 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:12.718677 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7f58c6a2-bf9c-432f-9f8b-cd60ba1c5066 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:12.827083 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58c6a2-bf9c-432f-9f8b-cd60ba1c5066 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:12.828584 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58c6a2-bf9c-432f-9f8b-cd60ba1c5066 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:12.846274 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 570/1135] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:04:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:04:15.009975 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0859f7-ff43-43fc-bf83-d92fe7e5ea7e None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:15.010482 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0859f7-ff43-43fc-bf83-d92fe7e5ea7e None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:15.010482 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0859f7-ff43-43fc-bf83-d92fe7e5ea7e None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:15.011846 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 566/1136] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 26 11:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:04:15.017707 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b91784-bc19-4043-85d8-9df89042e4d9 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:15.018129 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b91784-bc19-4043-85d8-9df89042e4d9 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:15.018267 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b91784-bc19-4043-85d8-9df89042e4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:15.083652 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-a9b91784-bc19-4043-85d8-9df89042e4d9 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:15.084888 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a9b91784-bc19-4043-85d8-9df89042e4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:15.093091 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:15.182447 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 571/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 26 11:04:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:04:15.463158 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0859f7-ff43-43fc-bf83-d92fe7e5ea7e None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:15.464739 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-7b0859f7-ff43-43fc-bf83-d92fe7e5ea7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:15.567578 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0859f7-ff43-43fc-bf83-d92fe7e5ea7e None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:15.622123 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:15.639927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b07aa-2023-4b64-970f-2979485b9f72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:15.641081 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b07aa-2023-4b64-970f-2979485b9f72 service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:15.641365 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b07aa-2023-4b64-970f-2979485b9f72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:15.641640 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b07aa-2023-4b64-970f-2979485b9f72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:15.643246 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-779b07aa-2023-4b64-970f-2979485b9f72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:15.751589 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b07aa-2023-4b64-970f-2979485b9f72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:15.753034 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b07aa-2023-4b64-970f-2979485b9f72 service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:15.771740 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 567/1138] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:04:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:04:18.001049 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f860d-8efc-4ff6-b329-486a7c7bc0b0 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:18.001627 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f860d-8efc-4ff6-b329-486a7c7bc0b0 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:18.001627 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f860d-8efc-4ff6-b329-486a7c7bc0b0 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:18.002955 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 572/1139] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 26 11:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:04:18.008427 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5597957-d400-4b3a-8310-c16aa9704db8 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:18.008830 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5597957-d400-4b3a-8310-c16aa9704db8 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:18.008975 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5597957-d400-4b3a-8310-c16aa9704db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:18.074621 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-c5597957-d400-4b3a-8310-c16aa9704db8 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:18.075833 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-c5597957-d400-4b3a-8310-c16aa9704db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:18.114373 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:18.171743 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 568/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 26 11:04:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:04:18.465145 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f860d-8efc-4ff6-b329-486a7c7bc0b0 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:18.466758 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ca7f860d-8efc-4ff6-b329-486a7c7bc0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:18.568804 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f860d-8efc-4ff6-b329-486a7c7bc0b0 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:18.606458 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:18.642079 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8324e41-1498-408e-b83c-46daa2356502 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:18.642696 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8324e41-1498-408e-b83c-46daa2356502 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:18.642976 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8324e41-1498-408e-b83c-46daa2356502 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:18.643252 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8324e41-1498-408e-b83c-46daa2356502 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:18.644883 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a8324e41-1498-408e-b83c-46daa2356502 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:18.752358 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8324e41-1498-408e-b83c-46daa2356502 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:18.753806 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8324e41-1498-408e-b83c-46daa2356502 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:18.772533 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 573/1141] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:04:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:04:20.967447 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c397027-9514-4188-aae1-c653edf8d01d None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:20.967991 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c397027-9514-4188-aae1-c653edf8d01d None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:20.967991 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c397027-9514-4188-aae1-c653edf8d01d None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:20.969885 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 569/1142] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 26 11:04:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:04:20.975386 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd6426-494f-4942-87ac-324bac0c5981 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:20.975822 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd6426-494f-4942-87ac-324bac0c5981 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:20.975934 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd6426-494f-4942-87ac-324bac0c5981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:21.042193 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-08bd6426-494f-4942-87ac-324bac0c5981 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:21.043429 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-08bd6426-494f-4942-87ac-324bac0c5981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:21.061258 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:21.139116 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 574/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 26 11:04:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:04:21.420605 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c397027-9514-4188-aae1-c653edf8d01d None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:21.422167 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-2c397027-9514-4188-aae1-c653edf8d01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:21.527697 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c397027-9514-4188-aae1-c653edf8d01d None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:21.595327 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:21.601738 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264d160-ae41-4592-9a9b-69d524ada03f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:21.602347 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264d160-ae41-4592-9a9b-69d524ada03f service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:21.602628 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264d160-ae41-4592-9a9b-69d524ada03f service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:21.602902 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264d160-ae41-4592-9a9b-69d524ada03f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:21.604540 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-2264d160-ae41-4592-9a9b-69d524ada03f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:21.712351 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2264d160-ae41-4592-9a9b-69d524ada03f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:21.713771 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2264d160-ae41-4592-9a9b-69d524ada03f service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:21.731628 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 570/1144] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:04:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:04:23.881296 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2a59e-abf4-44a5-9ff1-9125da9753ca None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:23.881886 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2a59e-abf4-44a5-9ff1-9125da9753ca None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:23.881886 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2a59e-abf4-44a5-9ff1-9125da9753ca None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:23.883325 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 575/1145] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 26 11:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:04:23.888663 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a9aec-8fcc-47c5-a1c9-5fb0ecbf0320 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:23.889068 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a9aec-8fcc-47c5-a1c9-5fb0ecbf0320 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:23.889212 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a9aec-8fcc-47c5-a1c9-5fb0ecbf0320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:23.955928 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-bf3a9aec-8fcc-47c5-a1c9-5fb0ecbf0320 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:23.957203 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-bf3a9aec-8fcc-47c5-a1c9-5fb0ecbf0320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:24.004531 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:24.052495 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 571/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 26 11:04:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:04:24.331793 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2a59e-abf4-44a5-9ff1-9125da9753ca None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:24.333366 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2ec2a59e-abf4-44a5-9ff1-9125da9753ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:24.435003 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2a59e-abf4-44a5-9ff1-9125da9753ca None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:24.481886 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:24.507874 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f654943-4c4b-44ce-b5dd-a4ef7a65bf38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:24.508505 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f654943-4c4b-44ce-b5dd-a4ef7a65bf38 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:24.508781 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f654943-4c4b-44ce-b5dd-a4ef7a65bf38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:24.509049 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f654943-4c4b-44ce-b5dd-a4ef7a65bf38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:24.510621 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4f654943-4c4b-44ce-b5dd-a4ef7a65bf38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:24.616695 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f654943-4c4b-44ce-b5dd-a4ef7a65bf38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:24.618049 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f654943-4c4b-44ce-b5dd-a4ef7a65bf38 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:24.637229 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 576/1147] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:04:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:04:34.050937 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=22 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:34.634823 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=66 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:44.491774 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f25b9-41eb-478a-8b84-ead0fcb30299 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:44.492353 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f25b9-41eb-478a-8b84-ead0fcb30299 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:44.492353 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f25b9-41eb-478a-8b84-ead0fcb30299 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:44.493691 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 572/1148] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 11:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:04:44.498861 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e850008-9cdd-464f-b737-b539552339fa None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:44.499266 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e850008-9cdd-464f-b737-b539552339fa None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:44.499406 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e850008-9cdd-464f-b737-b539552339fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:44.564312 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-8e850008-9cdd-464f-b737-b539552339fa None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:44.565522 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8e850008-9cdd-464f-b737-b539552339fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:44.661231 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 577/1149] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 11:04:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:04:44.958332 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74a916-d683-424a-99e3-b390f8ab9118 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:44.958622 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74a916-d683-424a-99e3-b390f8ab9118 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:44.958899 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74a916-d683-424a-99e3-b390f8ab9118 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:44.960346 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 573/1150] 10.222.0.45 () {54 vars in 962 bytes} [Wed Oct 26 11:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:04:44.965157 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4df72-e1b8-4362-a37b-26378fbc4b50 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:44.965453 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4df72-e1b8-4362-a37b-26378fbc4b50 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:44.965736 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4df72-e1b8-4362-a37b-26378fbc4b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:45.042363 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-bfc4df72-e1b8-4362-a37b-26378fbc4b50 None None] MFA Rules not processed for user `29d0e8cc074b4e36acc2162aebeac169`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:45.043584 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-bfc4df72-e1b8-4362-a37b-26378fbc4b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:45.063676 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:45.119429 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 578/1151] 10.222.0.45 () {58 vars in 1059 bytes} [Wed Oct 26 11:04:44 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:04:45.127597 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc74a916-d683-424a-99e3-b390f8ab9118 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:45.129191 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-fc74a916-d683-424a-99e3-b390f8ab9118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:45.230334 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc74a916-d683-424a-99e3-b390f8ab9118 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:45.301514 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c221e439-16d0-4ef9-bf9e-594b51e2b3d9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d0e8cc074b4e36acc2162aebeac169', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:45.302107 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221e439-16d0-4ef9-bf9e-594b51e2b3d9 service glance] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:45.302379 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221e439-16d0-4ef9-bf9e-594b51e2b3d9 service glance] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:45.302646 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221e439-16d0-4ef9-bf9e-594b51e2b3d9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:45.304249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-c221e439-16d0-4ef9-bf9e-594b51e2b3d9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:45.357779 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:45.412740 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c221e439-16d0-4ef9-bf9e-594b51e2b3d9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:45.414213 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c221e439-16d0-4ef9-bf9e-594b51e2b3d9 service glance] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:45.432983 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 574/1152] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:04:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:04:47.677701 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b3428-bbe1-425f-aca1-d985b87a2dec None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:47.677701 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b3428-bbe1-425f-aca1-d985b87a2dec None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:47.677701 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b3428-bbe1-425f-aca1-d985b87a2dec None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:47.678386 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 579/1153] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 11:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:04:47.683660 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ee635-3956-4e55-9e54-73337667b24a None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:47.684115 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ee635-3956-4e55-9e54-73337667b24a None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:47.684250 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ee635-3956-4e55-9e54-73337667b24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:47.749824 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-869ee635-3956-4e55-9e54-73337667b24a None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:47.751583 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-869ee635-3956-4e55-9e54-73337667b24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:47.844919 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 575/1154] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 11:04:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:04:48.117833 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b3428-bbe1-425f-aca1-d985b87a2dec None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:48.119410 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-fd3b3428-bbe1-425f-aca1-d985b87a2dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:48.243916 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b3428-bbe1-425f-aca1-d985b87a2dec None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:48.292682 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:48.337708 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1d690-58b4-48a6-a1f4-bb1fe4b91698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:48.338320 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1d690-58b4-48a6-a1f4-bb1fe4b91698 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:48.338599 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1d690-58b4-48a6-a1f4-bb1fe4b91698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:48.338871 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1d690-58b4-48a6-a1f4-bb1fe4b91698 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:48.339504 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1d690-58b4-48a6-a1f4-bb1fe4b91698 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:48.340658 dv-cinder-862679-1-smb devstack@keystone.service[81623]: WARNING py.warnings [None req-37b1d690-58b4-48a6-a1f4-bb1fe4b91698 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 26 11:04:48.340658 dv-cinder-862679-1-smb devstack@keystone.service[81623]: warnings.warn(msg) Oct 26 11:04:48.340658 dv-cinder-862679-1-smb devstack@keystone.service[81623]: Oct 26 11:04:48.341869 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1d690-58b4-48a6-a1f4-bb1fe4b91698 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:48.360622 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 580/1155] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 26 11:04:48 2022] GET /identity/v3/projects => generated 2553 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:04:50.498284 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678e918-16a7-4070-8041-c740b74c12c6 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:50.498812 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678e918-16a7-4070-8041-c740b74c12c6 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:50.498812 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678e918-16a7-4070-8041-c740b74c12c6 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:50.500157 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 576/1156] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 11:04:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:04:50.505860 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956701cf-9d45-44e4-b943-8ed14cd6668d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:50.506254 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956701cf-9d45-44e4-b943-8ed14cd6668d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:50.506412 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956701cf-9d45-44e4-b943-8ed14cd6668d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:50.571933 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-956701cf-9d45-44e4-b943-8ed14cd6668d None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:50.573416 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-956701cf-9d45-44e4-b943-8ed14cd6668d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:50.666827 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 581/1157] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 11:04:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:04:50.958369 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678e918-16a7-4070-8041-c740b74c12c6 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:50.959941 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-a678e918-16a7-4070-8041-c740b74c12c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:50.969762 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:51.105983 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678e918-16a7-4070-8041-c740b74c12c6 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:51.185134 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:51.217896 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3567182-cbb3-4259-bdaf-e2365baa2e09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:51.218501 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3567182-cbb3-4259-bdaf-e2365baa2e09 service nova] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:51.218779 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3567182-cbb3-4259-bdaf-e2365baa2e09 service nova] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:51.219050 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3567182-cbb3-4259-bdaf-e2365baa2e09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:51.220663 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-f3567182-cbb3-4259-bdaf-e2365baa2e09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:51.308803 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3567182-cbb3-4259-bdaf-e2365baa2e09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:51.310372 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3567182-cbb3-4259-bdaf-e2365baa2e09 service nova] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:51.329207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 577/1158] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:04:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:04:53.649134 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782d73e-be3a-4c58-a171-acf7d71a71d6 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:53.649664 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782d73e-be3a-4c58-a171-acf7d71a71d6 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:53.649664 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782d73e-be3a-4c58-a171-acf7d71a71d6 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:53.650941 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 582/1159] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 11:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:04:53.656351 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd63fd-8ba8-4c02-87d3-92b5e6079a7e None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:53.656762 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd63fd-8ba8-4c02-87d3-92b5e6079a7e None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:53.656910 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd63fd-8ba8-4c02-87d3-92b5e6079a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:53.723766 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-a0cd63fd-8ba8-4c02-87d3-92b5e6079a7e None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:53.725016 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-a0cd63fd-8ba8-4c02-87d3-92b5e6079a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:53.771293 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:53.820910 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 578/1160] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 11:04:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:04:54.109259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782d73e-be3a-4c58-a171-acf7d71a71d6 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:54.110839 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4782d73e-be3a-4c58-a171-acf7d71a71d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:54.134492 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:54.213365 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782d73e-be3a-4c58-a171-acf7d71a71d6 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:54.285336 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a7da73-d0b6-4fb5-b862-ff80dc2bbd4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:54.285950 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7da73-d0b6-4fb5-b862-ff80dc2bbd4d service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:54.286232 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7da73-d0b6-4fb5-b862-ff80dc2bbd4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:54.286506 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7da73-d0b6-4fb5-b862-ff80dc2bbd4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:54.288189 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-82a7da73-d0b6-4fb5-b862-ff80dc2bbd4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:54.362672 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:54.396912 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a7da73-d0b6-4fb5-b862-ff80dc2bbd4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:54.398373 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a7da73-d0b6-4fb5-b862-ff80dc2bbd4d service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:54.417165 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 583/1161] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:04:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:04:56.578645 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534f84c-e665-434b-9084-088e037120f1 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:56.579196 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534f84c-e665-434b-9084-088e037120f1 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:56.579196 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534f84c-e665-434b-9084-088e037120f1 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:56.580599 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 579/1162] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 11:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:04:56.585739 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520465c-7da7-4b6f-8521-6a8e1b51de70 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:56.586162 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520465c-7da7-4b6f-8521-6a8e1b51de70 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:56.586295 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520465c-7da7-4b6f-8521-6a8e1b51de70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:56.652107 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-b520465c-7da7-4b6f-8521-6a8e1b51de70 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:56.653329 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b520465c-7da7-4b6f-8521-6a8e1b51de70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:56.749572 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 584/1163] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 11:04:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:04:57.034864 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534f84c-e665-434b-9084-088e037120f1 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:57.036433 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-2534f84c-e665-434b-9084-088e037120f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:57.143952 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534f84c-e665-434b-9084-088e037120f1 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:57.218044 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:57.219617 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15215d84-0db3-45d1-8aff-475b43e9c198 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:57.220257 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15215d84-0db3-45d1-8aff-475b43e9c198 service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:57.220535 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15215d84-0db3-45d1-8aff-475b43e9c198 service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:57.220803 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15215d84-0db3-45d1-8aff-475b43e9c198 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:57.222630 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-15215d84-0db3-45d1-8aff-475b43e9c198 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:57.331051 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15215d84-0db3-45d1-8aff-475b43e9c198 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:57.332514 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15215d84-0db3-45d1-8aff-475b43e9c198 service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:57.350792 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 580/1164] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:04:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:04:59.631863 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2eb0b9-4e03-48a1-a52c-4e2d626835dc None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:59.632488 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2eb0b9-4e03-48a1-a52c-4e2d626835dc None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:59.632488 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2eb0b9-4e03-48a1-a52c-4e2d626835dc None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:59.633740 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 585/1165] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 11:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:04:59.639042 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327e1a6-3372-4a1e-8622-0c6d8a12807b None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:59.639436 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327e1a6-3372-4a1e-8622-0c6d8a12807b None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:59.639596 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327e1a6-3372-4a1e-8622-0c6d8a12807b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:59.709866 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-c327e1a6-3372-4a1e-8622-0c6d8a12807b None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:59.711085 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-c327e1a6-3372-4a1e-8622-0c6d8a12807b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:59.762835 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:59.812621 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 581/1166] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 11:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:00.103061 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2eb0b9-4e03-48a1-a52c-4e2d626835dc None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:00.104635 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6a2eb0b9-4e03-48a1-a52c-4e2d626835dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:00.140147 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:00.208613 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2eb0b9-4e03-48a1-a52c-4e2d626835dc None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:00.282443 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188d90a-f881-41fe-be72-255e0f60bbc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:00.283055 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188d90a-f881-41fe-be72-255e0f60bbc6 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:00.283333 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188d90a-f881-41fe-be72-255e0f60bbc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:00.283615 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188d90a-f881-41fe-be72-255e0f60bbc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:00.285231 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2188d90a-f881-41fe-be72-255e0f60bbc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:00.365537 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:00.393584 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188d90a-f881-41fe-be72-255e0f60bbc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:00.395029 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188d90a-f881-41fe-be72-255e0f60bbc6 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:00.413344 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 586/1167] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:02.921471 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4c58c-269c-46b8-9834-2918e4c87c7c None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:02.922005 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4c58c-269c-46b8-9834-2918e4c87c7c None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:02.922005 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4c58c-269c-46b8-9834-2918e4c87c7c None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:02.923875 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 582/1168] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 26 11:05:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:05:02.929191 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e15fcb-9bcd-46c7-b7df-b5f13be0074e None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:02.929614 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e15fcb-9bcd-46c7-b7df-b5f13be0074e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:02.929739 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e15fcb-9bcd-46c7-b7df-b5f13be0074e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:02.995605 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-c5e15fcb-9bcd-46c7-b7df-b5f13be0074e None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:02.996880 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c5e15fcb-9bcd-46c7-b7df-b5f13be0074e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:03.092632 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 587/1169] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 26 11:05:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:03.377091 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4c58c-269c-46b8-9834-2918e4c87c7c None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:03.378936 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-d0c4c58c-269c-46b8-9834-2918e4c87c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:03.480460 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4c58c-269c-46b8-9834-2918e4c87c7c None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:03.552435 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8cf2a-962c-439c-93fa-5198a1061e48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:03.553038 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8cf2a-962c-439c-93fa-5198a1061e48 service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:03.553317 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8cf2a-962c-439c-93fa-5198a1061e48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:03.553589 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8cf2a-962c-439c-93fa-5198a1061e48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:03.555161 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-c8e8cf2a-962c-439c-93fa-5198a1061e48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:03.563582 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:03.664819 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e8cf2a-962c-439c-93fa-5198a1061e48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:03.666174 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e8cf2a-962c-439c-93fa-5198a1061e48 service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:03.687721 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 583/1170] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:13.091115 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=82 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:13.684971 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=50 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:58.338638 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d0cc6-3751-446d-b5ba-b02ca9e65385 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:58.339225 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d0cc6-3751-446d-b5ba-b02ca9e65385 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:58.339225 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d0cc6-3751-446d-b5ba-b02ca9e65385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:58.419434 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-a21d0cc6-3751-446d-b5ba-b02ca9e65385 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:58.420702 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a21d0cc6-3751-446d-b5ba-b02ca9e65385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:58.522270 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 588/1171] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:06:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:58.530833 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e4b29-6028-4176-9132-76af9feb1a48 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:58.531335 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e4b29-6028-4176-9132-76af9feb1a48 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:58.531442 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e4b29-6028-4176-9132-76af9feb1a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:58.552085 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-ee1e4b29-6028-4176-9132-76af9feb1a48 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:58.553279 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-ee1e4b29-6028-4176-9132-76af9feb1a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:58.561720 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 584/1172] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:06:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:58.566153 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d0cc6-3751-446d-b5ba-b02ca9e65385 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:58.576112 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d0cc6-3751-446d-b5ba-b02ca9e65385 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:58.580925 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba5e72-9989-4a29-995b-cdad138c7fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:58.581519 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba5e72-9989-4a29-995b-cdad138c7fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:58.581983 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba5e72-9989-4a29-995b-cdad138c7fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:58.582262 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba5e72-9989-4a29-995b-cdad138c7fa8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:58.582903 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba5e72-9989-4a29-995b-cdad138c7fa8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:06:58.583207 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba5e72-9989-4a29-995b-cdad138c7fa8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:58.584332 dv-cinder-862679-1-smb devstack@keystone.service[81623]: WARNING py.warnings [None req-6cba5e72-9989-4a29-995b-cdad138c7fa8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 26 11:06:58.584332 dv-cinder-862679-1-smb devstack@keystone.service[81623]: warnings.warn(msg) Oct 26 11:06:58.584332 dv-cinder-862679-1-smb devstack@keystone.service[81623]: Oct 26 11:06:58.585211 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba5e72-9989-4a29-995b-cdad138c7fa8 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:58.597076 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 589/1173] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:06:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:06:58.606374 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e4b29-6028-4176-9132-76af9feb1a48 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:58.615361 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e4b29-6028-4176-9132-76af9feb1a48 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:58.619928 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f712e-64cc-4017-8806-442b1bd55b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:58.620581 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f712e-64cc-4017-8806-442b1bd55b39 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:58.620862 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f712e-64cc-4017-8806-442b1bd55b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:58.621135 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f712e-64cc-4017-8806-442b1bd55b39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:58.621761 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f712e-64cc-4017-8806-442b1bd55b39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:58.622857 dv-cinder-862679-1-smb devstack@keystone.service[81622]: WARNING py.warnings [None req-515f712e-64cc-4017-8806-442b1bd55b39 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 26 11:06:58.622857 dv-cinder-862679-1-smb devstack@keystone.service[81622]: warnings.warn(msg) Oct 26 11:06:58.622857 dv-cinder-862679-1-smb devstack@keystone.service[81622]: Oct 26 11:06:58.624040 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f712e-64cc-4017-8806-442b1bd55b39 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:58.767585 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 585/1174] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:06:58 2022] POST /identity/v3/projects => generated 377 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:06:58.771786 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba5e72-9989-4a29-995b-cdad138c7fa8 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:58.782274 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba5e72-9989-4a29-995b-cdad138c7fa8 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:58.831301 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:58.838755 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546bf5a-3b8c-4b51-b939-e48fda064c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:58.844753 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546bf5a-3b8c-4b51-b939-e48fda064c6b admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:58.844753 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546bf5a-3b8c-4b51-b939-e48fda064c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:58.844753 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546bf5a-3b8c-4b51-b939-e48fda064c6b admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:58.844753 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4546bf5a-3b8c-4b51-b939-e48fda064c6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:58.844753 dv-cinder-862679-1-smb devstack@keystone.service[81623]: WARNING py.warnings [None req-4546bf5a-3b8c-4b51-b939-e48fda064c6b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 26 11:06:58.844753 dv-cinder-862679-1-smb devstack@keystone.service[81623]: warnings.warn(msg) Oct 26 11:06:58.844753 dv-cinder-862679-1-smb devstack@keystone.service[81623]: Oct 26 11:06:58.845362 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4546bf5a-3b8c-4b51-b939-e48fda064c6b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:58.943049 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 590/1175] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:06:58 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:06:58.947697 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f712e-64cc-4017-8806-442b1bd55b39 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:58.958093 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f712e-64cc-4017-8806-442b1bd55b39 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:58.962781 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1e2c8-813a-4437-a19b-1b882b8e0174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:58.963375 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1e2c8-813a-4437-a19b-1b882b8e0174 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:58.963655 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1e2c8-813a-4437-a19b-1b882b8e0174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:58.963928 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1e2c8-813a-4437-a19b-1b882b8e0174 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:58.964606 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab1e2c8-813a-4437-a19b-1b882b8e0174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:58.966239 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab1e2c8-813a-4437-a19b-1b882b8e0174 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:58.978842 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 586/1176] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:06:58.982817 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546bf5a-3b8c-4b51-b939-e48fda064c6b admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:58.993224 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546bf5a-3b8c-4b51-b939-e48fda064c6b admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:58.997879 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27b60b-fb90-4839-917f-cb7acf3d008a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:58.998483 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27b60b-fb90-4839-917f-cb7acf3d008a admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:58.998771 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27b60b-fb90-4839-917f-cb7acf3d008a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:58.999052 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27b60b-fb90-4839-917f-cb7acf3d008a admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:58.999699 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed27b60b-fb90-4839-917f-cb7acf3d008a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:59.001341 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed27b60b-fb90-4839-917f-cb7acf3d008a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:59.015106 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 591/1177] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:06:59.019195 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1e2c8-813a-4437-a19b-1b882b8e0174 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:59.029122 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1e2c8-813a-4437-a19b-1b882b8e0174 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:59.033715 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d30145-4993-4245-830e-e8a36ed97b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:59.034360 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d30145-4993-4245-830e-e8a36ed97b92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:59.034640 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d30145-4993-4245-830e-e8a36ed97b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:59.034912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d30145-4993-4245-830e-e8a36ed97b92 admin admin] PATH_INFO: `/v3/projects/e78a7bf48d3e4fe68b9c43bc36cdb9b0/users/623336f1cf104d5ab982182ecbc21683/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:59.049235 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d30145-4993-4245-830e-e8a36ed97b92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e78a7bf48d3e4fe68b9c43bc36cdb9b0, user_id=623336f1cf104d5ab982182ecbc21683, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:59.051869 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d30145-4993-4245-830e-e8a36ed97b92 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:59.152209 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 587/1178] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:06:59 2022] PUT /identity/v3/projects/e78a7bf48d3e4fe68b9c43bc36cdb9b0/users/623336f1cf104d5ab982182ecbc21683/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:59.163188 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c00dbd-63bc-4610-b892-58f5ae69f16a None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:59.163477 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c00dbd-63bc-4610-b892-58f5ae69f16a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:59.163756 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c00dbd-63bc-4610-b892-58f5ae69f16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:59.191320 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-77c00dbd-63bc-4610-b892-58f5ae69f16a None None] MFA Rules not processed for user `623336f1cf104d5ab982182ecbc21683`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:59.192597 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-77c00dbd-63bc-4610-b892-58f5ae69f16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:59.256868 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 592/1179] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:06:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:59.269718 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f3d95-7a7e-4db1-bb13-22cc7d48519e None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:59.270009 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f3d95-7a7e-4db1-bb13-22cc7d48519e None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:59.270288 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f3d95-7a7e-4db1-bb13-22cc7d48519e None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:59.271683 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 588/1180] 10.222.0.45 () {54 vars in 963 bytes} [Wed Oct 26 11:06:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:06:59.276338 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d48d4-4801-431b-9b41-a5d9741c39d1 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:59.276634 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d48d4-4801-431b-9b41-a5d9741c39d1 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:59.276914 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d48d4-4801-431b-9b41-a5d9741c39d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:59.336714 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-906d48d4-4801-431b-9b41-a5d9741c39d1 None None] MFA Rules not processed for user `c06f827607194b6dbd196a8fbf717b05`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:59.337936 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-906d48d4-4801-431b-9b41-a5d9741c39d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:59.412743 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 593/1181] 10.222.0.45 () {58 vars in 1060 bytes} [Wed Oct 26 11:06:59 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:59.421111 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f3d95-7a7e-4db1-bb13-22cc7d48519e None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:59.432391 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f3d95-7a7e-4db1-bb13-22cc7d48519e None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:59.435854 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0115ce-8cf9-4c19-a186-3064fb3cc661 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:59.436482 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0115ce-8cf9-4c19-a186-3064fb3cc661 service cinder] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:59.436763 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0115ce-8cf9-4c19-a186-3064fb3cc661 service cinder] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:59.437037 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0115ce-8cf9-4c19-a186-3064fb3cc661 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:59.445170 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0115ce-8cf9-4c19-a186-3064fb3cc661 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:59.446583 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0115ce-8cf9-4c19-a186-3064fb3cc661 service cinder] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:59.455435 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 589/1182] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:06:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:06:59.500905 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a58ab-c21b-41fb-aaaf-c1c65b5f2841 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:59.501205 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a58ab-c21b-41fb-aaaf-c1c65b5f2841 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:59.501490 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a58ab-c21b-41fb-aaaf-c1c65b5f2841 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:59.502755 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 594/1183] 10.222.0.45 () {52 vars in 830 bytes} [Wed Oct 26 11:06:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:06:59.507025 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0115ce-8cf9-4c19-a186-3064fb3cc661 service cinder] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:59.567155 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0115ce-8cf9-4c19-a186-3064fb3cc661 service cinder] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:59.571662 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e615a6a-a289-4a2a-811d-d4ed1b629737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:59.572306 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e615a6a-a289-4a2a-811d-d4ed1b629737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:59.572587 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e615a6a-a289-4a2a-811d-d4ed1b629737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:59.572856 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e615a6a-a289-4a2a-811d-d4ed1b629737 admin admin] PATH_INFO: `/v3/users/623336f1cf104d5ab982182ecbc21683` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:59.573953 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e615a6a-a289-4a2a-811d-d4ed1b629737 admin admin] RBAC: Authorizing `identity:delete_user(user_id=623336f1cf104d5ab982182ecbc21683)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:59.574977 dv-cinder-862679-1-smb devstack@keystone.service[81622]: WARNING py.warnings [None req-4e615a6a-a289-4a2a-811d-d4ed1b629737 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 26 11:06:59.574977 dv-cinder-862679-1-smb devstack@keystone.service[81622]: warnings.warn(msg) Oct 26 11:06:59.574977 dv-cinder-862679-1-smb devstack@keystone.service[81622]: Oct 26 11:06:59.576208 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e615a6a-a289-4a2a-811d-d4ed1b629737 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:59.786796 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-4e615a6a-a289-4a2a-811d-d4ed1b629737 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '623336f1cf104d5ab982182ecbc21683'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:59.863338 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-4e615a6a-a289-4a2a-811d-d4ed1b629737 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '623336f1cf104d5ab982182ecbc21683'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:59.886916 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-4e615a6a-a289-4a2a-811d-d4ed1b629737 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '623336f1cf104d5ab982182ecbc21683'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:59.887571 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-4e615a6a-a289-4a2a-811d-d4ed1b629737 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '623336f1cf104d5ab982182ecbc21683'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:59.897910 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:59.902356 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-4e615a6a-a289-4a2a-811d-d4ed1b629737 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '623336f1cf104d5ab982182ecbc21683'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:59.908494 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 590/1184] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:06:59 2022] DELETE /identity/v3/users/623336f1cf104d5ab982182ecbc21683 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:59.912897 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410491b-c22e-4550-a478-eb2c436af384 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:59.913188 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410491b-c22e-4550-a478-eb2c436af384 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:59.921059 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410491b-c22e-4550-a478-eb2c436af384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:59.933679 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-f410491b-c22e-4550-a478-eb2c436af384 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:59.934883 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f410491b-c22e-4550-a478-eb2c436af384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:59.943919 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:59.993681 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 595/1185] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:06:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:07:00.003491 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e615a6a-a289-4a2a-811d-d4ed1b629737 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:00.004931 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-4e615a6a-a289-4a2a-811d-d4ed1b629737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:00.082554 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e615a6a-a289-4a2a-811d-d4ed1b629737 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:00.086716 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2945b-216b-4e22-a922-2cf8b77381df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:00.087323 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2945b-216b-4e22-a922-2cf8b77381df service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:00.087632 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2945b-216b-4e22-a922-2cf8b77381df service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:00.087905 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2945b-216b-4e22-a922-2cf8b77381df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:00.096703 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2945b-216b-4e22-a922-2cf8b77381df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:00.098131 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2945b-216b-4e22-a922-2cf8b77381df service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:00.107252 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 591/1186] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:07:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:07:00.582032 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410491b-c22e-4550-a478-eb2c436af384 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:00.582032 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f410491b-c22e-4550-a478-eb2c436af384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:00.593639 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410491b-c22e-4550-a478-eb2c436af384 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:00.599306 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3edf77c-f90b-49ab-8da8-c3b30760a003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:00.600156 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edf77c-f90b-49ab-8da8-c3b30760a003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:00.600439 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edf77c-f90b-49ab-8da8-c3b30760a003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:00.600770 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edf77c-f90b-49ab-8da8-c3b30760a003 admin admin] PATH_INFO: `/v3/projects/e78a7bf48d3e4fe68b9c43bc36cdb9b0` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:00.602095 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3edf77c-f90b-49ab-8da8-c3b30760a003 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e78a7bf48d3e4fe68b9c43bc36cdb9b0)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:00.603131 dv-cinder-862679-1-smb devstack@keystone.service[81623]: WARNING py.warnings [None req-c3edf77c-f90b-49ab-8da8-c3b30760a003 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 26 11:07:00.603131 dv-cinder-862679-1-smb devstack@keystone.service[81623]: warnings.warn(msg) Oct 26 11:07:00.603131 dv-cinder-862679-1-smb devstack@keystone.service[81623]: Oct 26 11:07:00.605151 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3edf77c-f90b-49ab-8da8-c3b30760a003 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:00.727286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c3edf77c-f90b-49ab-8da8-c3b30760a003 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e78a7bf48d3e4fe68b9c43bc36cdb9b0', 'request_id': 'req-c3edf77c-f90b-49ab-8da8-c3b30760a003'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:00.740686 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c3edf77c-f90b-49ab-8da8-c3b30760a003 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e78a7bf48d3e4fe68b9c43bc36cdb9b0', 'request_id': 'req-c3edf77c-f90b-49ab-8da8-c3b30760a003'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:00.811408 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c3edf77c-f90b-49ab-8da8-c3b30760a003 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e78a7bf48d3e4fe68b9c43bc36cdb9b0', 'request_id': 'req-c3edf77c-f90b-49ab-8da8-c3b30760a003'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:00.822891 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c3edf77c-f90b-49ab-8da8-c3b30760a003 admin admin] The token cache is being invalidate because project e78a7bf48d3e4fe68b9c43bc36cdb9b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:07:00.823183 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c3edf77c-f90b-49ab-8da8-c3b30760a003 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:00.823914 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c3edf77c-f90b-49ab-8da8-c3b30760a003 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:00.825460 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 596/1187] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:07:00 2022] DELETE /identity/v3/projects/e78a7bf48d3e4fe68b9c43bc36cdb9b0 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:07:10.103202 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=38 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:07:10.819709 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:08:35.313071 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ead50-6039-4924-ab3d-e3a9a951f4e1 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:35.313671 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ead50-6039-4924-ab3d-e3a9a951f4e1 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:35.313671 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ead50-6039-4924-ab3d-e3a9a951f4e1 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:35.315076 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 592/1188] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 26 11:08:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:08:35.319757 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238cb34-1802-4c86-b5d5-09b6ee11506e None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:35.320211 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238cb34-1802-4c86-b5d5-09b6ee11506e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:35.320346 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238cb34-1802-4c86-b5d5-09b6ee11506e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:35.340911 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-e238cb34-1802-4c86-b5d5-09b6ee11506e None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:08:35.342167 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e238cb34-1802-4c86-b5d5-09b6ee11506e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:08:35.399572 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 597/1189] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 26 11:08:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:08:35.552499 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ead50-6039-4924-ab3d-e3a9a951f4e1 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:08:35.554246 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-736ead50-6039-4924-ab3d-e3a9a951f4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:08:35.660539 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ead50-6039-4924-ab3d-e3a9a951f4e1 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:08:35.666164 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ba90e-506c-488e-82d0-df82eb345711 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:08:35.666798 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ba90e-506c-488e-82d0-df82eb345711 service nova] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:35.667082 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ba90e-506c-488e-82d0-df82eb345711 service nova] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:35.667360 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ba90e-506c-488e-82d0-df82eb345711 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:35.676098 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ba90e-506c-488e-82d0-df82eb345711 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:08:35.677698 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ba90e-506c-488e-82d0-df82eb345711 service nova] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:08:35.687417 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 593/1190] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:08:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:08:36.757651 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96809565-d388-44bd-8295-4b64aea28e5c None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:36.758235 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96809565-d388-44bd-8295-4b64aea28e5c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:36.758235 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96809565-d388-44bd-8295-4b64aea28e5c None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:36.759558 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 598/1191] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 26 11:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:08:36.764945 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196d313-9132-4631-88d4-d7c02050a6c0 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:36.765375 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196d313-9132-4631-88d4-d7c02050a6c0 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:36.765522 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196d313-9132-4631-88d4-d7c02050a6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:36.785454 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-0196d313-9132-4631-88d4-d7c02050a6c0 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:08:36.786655 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-0196d313-9132-4631-88d4-d7c02050a6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:08:36.794526 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 594/1192] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 26 11:08:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:08:36.947111 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96809565-d388-44bd-8295-4b64aea28e5c None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:08:36.963503 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96809565-d388-44bd-8295-4b64aea28e5c None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:08:36.969586 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615378de-1f84-4480-b097-98026817a8e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:08:36.970386 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615378de-1f84-4480-b097-98026817a8e6 service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:36.970687 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615378de-1f84-4480-b097-98026817a8e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:36.970971 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615378de-1f84-4480-b097-98026817a8e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:36.979937 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615378de-1f84-4480-b097-98026817a8e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:08:36.981603 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615378de-1f84-4480-b097-98026817a8e6 service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:08:36.992041 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 599/1193] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:08:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:08:37.335651 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff43d2-bfe7-4795-8a0c-780baad26fbb None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:37.335966 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff43d2-bfe7-4795-8a0c-780baad26fbb None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:37.336284 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff43d2-bfe7-4795-8a0c-780baad26fbb None None] PATH_INFO: `/v3` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:37.337581 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 595/1194] 10.222.0.46 () {54 vars in 925 bytes} [Wed Oct 26 11:08:37 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:08:37.344205 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29172e-ea7e-43c7-886b-ea2b412637d1 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:37.344499 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29172e-ea7e-43c7-886b-ea2b412637d1 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:37.344782 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29172e-ea7e-43c7-886b-ea2b412637d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:37.394211 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-fc29172e-ea7e-43c7-886b-ea2b412637d1 None None] MFA Rules not processed for user `b4f9a2bba0e748b6a98fa7dea2482ddf`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:08:37.395420 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-fc29172e-ea7e-43c7-886b-ea2b412637d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:08:37.465091 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 600/1195] 10.222.0.46 () {58 vars in 1015 bytes} [Wed Oct 26 11:08:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:08:41.252514 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2ad4a-a756-40ac-b69d-85b6e9e80ed7 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:41.252964 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2ad4a-a756-40ac-b69d-85b6e9e80ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:41.253343 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2ad4a-a756-40ac-b69d-85b6e9e80ed7 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:41.254794 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 596/1196] 10.222.0.45 () {54 vars in 961 bytes} [Wed Oct 26 11:08:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:08:41.259921 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ce6c9-425b-4b84-8e56-08a5dae2681a None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:41.260409 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ce6c9-425b-4b84-8e56-08a5dae2681a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:41.260514 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ce6c9-425b-4b84-8e56-08a5dae2681a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:41.283358 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-074ce6c9-425b-4b84-8e56-08a5dae2681a None None] MFA Rules not processed for user `b4f9a2bba0e748b6a98fa7dea2482ddf`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:08:41.284765 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-074ce6c9-425b-4b84-8e56-08a5dae2681a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:08:41.293350 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 601/1197] 10.222.0.45 () {58 vars in 1058 bytes} [Wed Oct 26 11:08:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:08:41.301018 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2ad4a-a756-40ac-b69d-85b6e9e80ed7 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:08:41.314104 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2ad4a-a756-40ac-b69d-85b6e9e80ed7 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:08:41.318990 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b8417-ceb7-439d-b961-b02e157fc615 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4f9a2bba0e748b6a98fa7dea2482ddf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:08:41.319584 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b8417-ceb7-439d-b961-b02e157fc615 service placement] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:41.319878 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b8417-ceb7-439d-b961-b02e157fc615 service placement] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:41.320210 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b8417-ceb7-439d-b961-b02e157fc615 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:41.328812 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448b8417-ceb7-439d-b961-b02e157fc615 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:08:41.330412 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448b8417-ceb7-439d-b961-b02e157fc615 service placement] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:08:41.340731 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 597/1198] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:08:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:08:48.445076 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb9019-f112-4a95-b329-d32d9f2f83e7 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:48.445610 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb9019-f112-4a95-b329-d32d9f2f83e7 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:48.445610 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb9019-f112-4a95-b329-d32d9f2f83e7 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:48.446958 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 602/1199] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 26 11:08:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:08:48.452347 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80480bb2-50a7-4489-92df-5f54641b43cb None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:48.452750 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80480bb2-50a7-4489-92df-5f54641b43cb None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:48.452895 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80480bb2-50a7-4489-92df-5f54641b43cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:48.475917 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-80480bb2-50a7-4489-92df-5f54641b43cb None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:08:48.477161 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-80480bb2-50a7-4489-92df-5f54641b43cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:08:48.485030 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 598/1200] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 26 11:08:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:08:48.639360 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb9019-f112-4a95-b329-d32d9f2f83e7 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:08:48.653829 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb9019-f112-4a95-b329-d32d9f2f83e7 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:08:48.659388 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9dee52-6c5e-4bf6-8743-4237e1e05b94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:08:48.660162 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9dee52-6c5e-4bf6-8743-4237e1e05b94 service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:48.660444 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9dee52-6c5e-4bf6-8743-4237e1e05b94 service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:48.660715 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9dee52-6c5e-4bf6-8743-4237e1e05b94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:48.668668 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9dee52-6c5e-4bf6-8743-4237e1e05b94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:08:48.670266 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9dee52-6c5e-4bf6-8743-4237e1e05b94 service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:08:48.679719 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 603/1201] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:08:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:08:49.732935 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4722bbe-3190-4894-8223-5c538cbb7c35 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:49.733457 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4722bbe-3190-4894-8223-5c538cbb7c35 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:49.733457 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4722bbe-3190-4894-8223-5c538cbb7c35 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:49.734737 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 599/1202] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 26 11:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:08:49.739434 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827520e7-4b5e-4e6b-97d3-523771f4d5e3 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:49.739882 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827520e7-4b5e-4e6b-97d3-523771f4d5e3 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:49.739982 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827520e7-4b5e-4e6b-97d3-523771f4d5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:49.759246 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-827520e7-4b5e-4e6b-97d3-523771f4d5e3 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:08:49.760497 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-827520e7-4b5e-4e6b-97d3-523771f4d5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:08:49.768800 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 604/1203] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 26 11:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:08:49.921527 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4722bbe-3190-4894-8223-5c538cbb7c35 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:08:49.936224 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4722bbe-3190-4894-8223-5c538cbb7c35 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:08:49.941722 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4dda01-c678-4aaf-8943-27170ce0f012 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:08:49.942317 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4dda01-c678-4aaf-8943-27170ce0f012 service nova] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:49.942596 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4dda01-c678-4aaf-8943-27170ce0f012 service nova] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:49.942871 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4dda01-c678-4aaf-8943-27170ce0f012 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:49.951793 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4dda01-c678-4aaf-8943-27170ce0f012 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:08:49.953423 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4dda01-c678-4aaf-8943-27170ce0f012 service nova] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:08:49.963037 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 600/1204] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:08:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:08:54.021032 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5287a88-517e-4d42-bb05-25fe655ecb27 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:54.021612 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5287a88-517e-4d42-bb05-25fe655ecb27 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:54.021612 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5287a88-517e-4d42-bb05-25fe655ecb27 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:54.022925 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 605/1205] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 26 11:08:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:08:54.028275 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7372ad-cca0-404d-b7b3-d3efde3a5045 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:54.028671 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7372ad-cca0-404d-b7b3-d3efde3a5045 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:54.028836 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7372ad-cca0-404d-b7b3-d3efde3a5045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:54.048577 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-3e7372ad-cca0-404d-b7b3-d3efde3a5045 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:08:54.049762 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-3e7372ad-cca0-404d-b7b3-d3efde3a5045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:08:54.057435 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 601/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 26 11:08:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:08:54.343601 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5287a88-517e-4d42-bb05-25fe655ecb27 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:08:54.345344 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e5287a88-517e-4d42-bb05-25fe655ecb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:08:54.373459 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:08:54.401929 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5287a88-517e-4d42-bb05-25fe655ecb27 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:08:54.406040 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2962269c-e985-4436-981e-818eb7677a7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:08:54.406645 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962269c-e985-4436-981e-818eb7677a7f service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:54.406930 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962269c-e985-4436-981e-818eb7677a7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:54.407207 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962269c-e985-4436-981e-818eb7677a7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:54.416349 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2962269c-e985-4436-981e-818eb7677a7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:08:54.417779 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2962269c-e985-4436-981e-818eb7677a7f service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:08:54.427134 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 606/1207] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:08:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:08:56.557606 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e2c9d-c4d6-496f-9c5b-74b83b57d5ab None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:56.558169 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e2c9d-c4d6-496f-9c5b-74b83b57d5ab None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:56.558169 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e2c9d-c4d6-496f-9c5b-74b83b57d5ab None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:56.559503 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 602/1208] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 26 11:08:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:08:56.565273 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca89645-3c86-4117-b33d-34fb523c7940 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:56.565695 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca89645-3c86-4117-b33d-34fb523c7940 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:56.565830 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca89645-3c86-4117-b33d-34fb523c7940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:56.585400 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-6ca89645-3c86-4117-b33d-34fb523c7940 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:08:56.586596 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6ca89645-3c86-4117-b33d-34fb523c7940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:08:56.594983 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 607/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 26 11:08:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:08:56.883891 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e2c9d-c4d6-496f-9c5b-74b83b57d5ab None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:08:56.895237 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e2c9d-c4d6-496f-9c5b-74b83b57d5ab None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:08:56.898728 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0800127-352f-447c-9c7a-a26af08c3299 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:08:56.899322 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0800127-352f-447c-9c7a-a26af08c3299 service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:56.899599 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0800127-352f-447c-9c7a-a26af08c3299 service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:56.899871 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0800127-352f-447c-9c7a-a26af08c3299 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:56.908601 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0800127-352f-447c-9c7a-a26af08c3299 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:08:56.910022 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0800127-352f-447c-9c7a-a26af08c3299 service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:08:56.919223 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 603/1210] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:08:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:09:00.503151 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c4996-c4fb-48df-ab91-d77d3c81caf0 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:09:00.503699 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c4996-c4fb-48df-ab91-d77d3c81caf0 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:09:00.503699 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c4996-c4fb-48df-ab91-d77d3c81caf0 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:09:00.505079 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 608/1211] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 26 11:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:09:00.510406 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecfe7e-e02e-4030-aa51-a8809346dc4f None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:09:00.510802 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecfe7e-e02e-4030-aa51-a8809346dc4f None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:09:00.510968 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecfe7e-e02e-4030-aa51-a8809346dc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:09:00.518571 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=74 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:09:00.530542 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-a1ecfe7e-e02e-4030-aa51-a8809346dc4f None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:09:00.532389 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-a1ecfe7e-e02e-4030-aa51-a8809346dc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:09:00.540535 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 604/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 26 11:09:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:09:00.860616 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c4996-c4fb-48df-ab91-d77d3c81caf0 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:09:00.862303 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e74c4996-c4fb-48df-ab91-d77d3c81caf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:09:00.919759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c4996-c4fb-48df-ab91-d77d3c81caf0 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:09:00.923307 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e35391-efc2-493e-aae8-07263c4cd283 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:09:00.923914 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e35391-efc2-493e-aae8-07263c4cd283 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:09:00.924226 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e35391-efc2-493e-aae8-07263c4cd283 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:09:00.924500 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e35391-efc2-493e-aae8-07263c4cd283 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:09:00.933198 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e35391-efc2-493e-aae8-07263c4cd283 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:09:00.934623 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e35391-efc2-493e-aae8-07263c4cd283 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:09:00.943845 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 609/1213] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:09:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:09:03.063862 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc17b89-f586-4fcb-b9fe-b54ac50c55e5 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:09:03.064434 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc17b89-f586-4fcb-b9fe-b54ac50c55e5 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:09:03.064434 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc17b89-f586-4fcb-b9fe-b54ac50c55e5 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:09:03.065733 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 605/1214] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 26 11:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:09:03.070969 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41f459-ae99-4c56-9663-99aaaad6089c None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:09:03.071397 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41f459-ae99-4c56-9663-99aaaad6089c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:09:03.071507 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41f459-ae99-4c56-9663-99aaaad6089c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:09:03.091318 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-5a41f459-ae99-4c56-9663-99aaaad6089c None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:09:03.092540 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5a41f459-ae99-4c56-9663-99aaaad6089c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:09:03.100760 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 610/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 26 11:09:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:09:03.406943 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc17b89-f586-4fcb-b9fe-b54ac50c55e5 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:09:03.408628 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-8bc17b89-f586-4fcb-b9fe-b54ac50c55e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:09:03.421323 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc17b89-f586-4fcb-b9fe-b54ac50c55e5 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:09:03.424793 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e365e88-692a-4c21-b198-ee10cc6fa4ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:09:03.425380 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e365e88-692a-4c21-b198-ee10cc6fa4ac service cinder] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:09:03.425655 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e365e88-692a-4c21-b198-ee10cc6fa4ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:09:03.425923 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e365e88-692a-4c21-b198-ee10cc6fa4ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:09:03.434538 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e365e88-692a-4c21-b198-ee10cc6fa4ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:09:03.435939 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e365e88-692a-4c21-b198-ee10cc6fa4ac service cinder] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:09:03.445506 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 606/1216] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:09:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:09:13.086687 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=47 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:09:13.441469 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=8 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:33.402336 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffc394-4f1e-48d9-b5ec-d0a2893371ac None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:33.402985 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffc394-4f1e-48d9-b5ec-d0a2893371ac None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:33.402985 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffc394-4f1e-48d9-b5ec-d0a2893371ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:33.431861 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-69ffc394-4f1e-48d9-b5ec-d0a2893371ac None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:33.433512 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-69ffc394-4f1e-48d9-b5ec-d0a2893371ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:33.448035 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 611/1217] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:33.459242 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9721771-de9b-4252-b0bf-67d870e5a18c None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:33.459862 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9721771-de9b-4252-b0bf-67d870e5a18c None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:33.459862 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9721771-de9b-4252-b0bf-67d870e5a18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:33.493191 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-f9721771-de9b-4252-b0bf-67d870e5a18c None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:33.494619 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-f9721771-de9b-4252-b0bf-67d870e5a18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:33.504433 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 607/1218] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:33.509537 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ffc394-4f1e-48d9-b5ec-d0a2893371ac None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:33.524245 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ffc394-4f1e-48d9-b5ec-d0a2893371ac None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:33.536299 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd382da-efd9-4386-9e62-4ac72ba960d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:33.536552 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec79ec8-9604-4764-a8f7-4ad0dc39a447 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:33.536786 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec79ec8-9604-4764-a8f7-4ad0dc39a447 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:33.536992 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec79ec8-9604-4764-a8f7-4ad0dc39a447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:33.537819 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd382da-efd9-4386-9e62-4ac72ba960d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:33.538326 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd382da-efd9-4386-9e62-4ac72ba960d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:33.538812 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd382da-efd9-4386-9e62-4ac72ba960d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:33.539784 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd382da-efd9-4386-9e62-4ac72ba960d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:10:33.540338 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd382da-efd9-4386-9e62-4ac72ba960d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:33.542296 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd382da-efd9-4386-9e62-4ac72ba960d6 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:33.565789 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 612/1219] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:10:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:10:33.577127 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-9ec79ec8-9604-4764-a8f7-4ad0dc39a447 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:33.577613 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd382da-efd9-4386-9e62-4ac72ba960d6 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:33.578838 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-9ec79ec8-9604-4764-a8f7-4ad0dc39a447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:33.592894 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd382da-efd9-4386-9e62-4ac72ba960d6 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:33.600081 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 608/1220] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:10:33.600081 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d992fbd-0f5b-4b69-8470-5a7b3bb0d51f None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:33.600081 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d992fbd-0f5b-4b69-8470-5a7b3bb0d51f None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:33.600081 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d992fbd-0f5b-4b69-8470-5a7b3bb0d51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:33.605180 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c64e5e-ab12-4e20-9f0d-46e022618e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:33.606084 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c64e5e-ab12-4e20-9f0d-46e022618e8d admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:33.606586 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c64e5e-ab12-4e20-9f0d-46e022618e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:33.607083 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c64e5e-ab12-4e20-9f0d-46e022618e8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:33.607940 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c64e5e-ab12-4e20-9f0d-46e022618e8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:33.612321 dv-cinder-862679-1-smb devstack@keystone.service[81623]: WARNING py.warnings [None req-81c64e5e-ab12-4e20-9f0d-46e022618e8d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 26 11:10:33.612321 dv-cinder-862679-1-smb devstack@keystone.service[81623]: warnings.warn(msg) Oct 26 11:10:33.612321 dv-cinder-862679-1-smb devstack@keystone.service[81623]: Oct 26 11:10:33.613607 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c64e5e-ab12-4e20-9f0d-46e022618e8d admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:33.638775 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-3d992fbd-0f5b-4b69-8470-5a7b3bb0d51f None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:33.641717 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-3d992fbd-0f5b-4b69-8470-5a7b3bb0d51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:33.654376 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 609/1221] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:33.655627 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f009b50-c3c8-4204-828b-727318f228d3 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:33.655915 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f009b50-c3c8-4204-828b-727318f228d3 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:33.656289 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f009b50-c3c8-4204-828b-727318f228d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:33.676700 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-4f009b50-c3c8-4204-828b-727318f228d3 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:33.678296 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-4f009b50-c3c8-4204-828b-727318f228d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:33.686628 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 610/1222] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:33.687760 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15e323-0391-4e60-9768-87f96c0a404b None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:33.688577 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15e323-0391-4e60-9768-87f96c0a404b None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:33.688577 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15e323-0391-4e60-9768-87f96c0a404b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:33.708898 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-6c15e323-0391-4e60-9768-87f96c0a404b None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:33.710150 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-6c15e323-0391-4e60-9768-87f96c0a404b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:33.722380 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 611/1223] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:33.723461 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0385271-0962-4e71-bfe7-49a966e78d30 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:33.723809 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0385271-0962-4e71-bfe7-49a966e78d30 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:33.724820 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0385271-0962-4e71-bfe7-49a966e78d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:33.744988 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-a0385271-0962-4e71-bfe7-49a966e78d30 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:33.746200 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-a0385271-0962-4e71-bfe7-49a966e78d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:33.755209 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 612/1224] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:33.756512 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7386276-894b-4405-9169-0116ba90c139 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:33.756842 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7386276-894b-4405-9169-0116ba90c139 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:33.757116 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7386276-894b-4405-9169-0116ba90c139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:33.761942 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 613/1225] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:10:33 2022] POST /identity/v3/projects => generated 377 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:10:33.766352 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c3b2c-d631-4374-b2b8-b323801e3867 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:33.766352 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c3b2c-d631-4374-b2b8-b323801e3867 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:33.766352 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c3b2c-d631-4374-b2b8-b323801e3867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:33.777772 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-d7386276-894b-4405-9169-0116ba90c139 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:33.779047 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-d7386276-894b-4405-9169-0116ba90c139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:33.782429 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-9a7c3b2c-d631-4374-b2b8-b323801e3867 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:33.783595 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9a7c3b2c-d631-4374-b2b8-b323801e3867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:33.839960 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 613/1226] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:33.841367 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611f37d-b96e-4514-9bb9-be723478c664 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:33.841654 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611f37d-b96e-4514-9bb9-be723478c664 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:33.841931 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611f37d-b96e-4514-9bb9-be723478c664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:33.848364 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 614/1227] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:33.849612 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa6dbc-2d55-4e40-bc0c-e8c39e71fe7e None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:33.849903 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa6dbc-2d55-4e40-bc0c-e8c39e71fe7e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:33.850179 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa6dbc-2d55-4e40-bc0c-e8c39e71fe7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:33.864746 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-2611f37d-b96e-4514-9bb9-be723478c664 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:33.865935 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-2611f37d-b96e-4514-9bb9-be723478c664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:33.871168 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-f8aa6dbc-2d55-4e40-bc0c-e8c39e71fe7e None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:33.872371 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f8aa6dbc-2d55-4e40-bc0c-e8c39e71fe7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:33.873753 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 614/1228] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:33.874941 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed5707-8a71-4a4b-8e98-82665487d565 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:33.875190 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed5707-8a71-4a4b-8e98-82665487d565 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:33.875462 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed5707-8a71-4a4b-8e98-82665487d565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:33.880565 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 615/1229] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:33.881747 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa1d46-a889-42a7-965a-fd0d03a23896 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:33.882032 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa1d46-a889-42a7-965a-fd0d03a23896 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:33.882309 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa1d46-a889-42a7-965a-fd0d03a23896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:33.899768 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-67ed5707-8a71-4a4b-8e98-82665487d565 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:33.901002 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-67ed5707-8a71-4a4b-8e98-82665487d565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:33.907335 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-71fa1d46-a889-42a7-965a-fd0d03a23896 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:33.908544 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-71fa1d46-a889-42a7-965a-fd0d03a23896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:33.908848 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 615/1230] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:33.909618 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed5707-8a71-4a4b-8e98-82665487d565 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:33.917018 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 616/1231] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:33.917845 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fa1d46-a889-42a7-965a-fd0d03a23896 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:33.918923 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed5707-8a71-4a4b-8e98-82665487d565 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:33.924169 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d80ce-2305-48dc-a8ca-d1aea9141063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:33.924893 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d80ce-2305-48dc-a8ca-d1aea9141063 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:33.925345 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d80ce-2305-48dc-a8ca-d1aea9141063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:33.926236 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d80ce-2305-48dc-a8ca-d1aea9141063 admin admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:33.926961 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d80ce-2305-48dc-a8ca-d1aea9141063 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:10:33.927266 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d80ce-2305-48dc-a8ca-d1aea9141063 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:33.928148 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fa1d46-a889-42a7-965a-fd0d03a23896 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:33.928311 dv-cinder-862679-1-smb devstack@keystone.service[81622]: WARNING py.warnings [None req-701d80ce-2305-48dc-a8ca-d1aea9141063 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 26 11:10:33.928311 dv-cinder-862679-1-smb devstack@keystone.service[81622]: warnings.warn(msg) Oct 26 11:10:33.928311 dv-cinder-862679-1-smb devstack@keystone.service[81622]: Oct 26 11:10:33.929164 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d80ce-2305-48dc-a8ca-d1aea9141063 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:33.933178 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50612d0-20ae-4ac7-8286-4c2cc6b33766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:33.933780 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50612d0-20ae-4ac7-8286-4c2cc6b33766 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:33.934066 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50612d0-20ae-4ac7-8286-4c2cc6b33766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:33.934342 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50612d0-20ae-4ac7-8286-4c2cc6b33766 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:33.934973 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50612d0-20ae-4ac7-8286-4c2cc6b33766 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:33.936910 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50612d0-20ae-4ac7-8286-4c2cc6b33766 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:33.941093 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 616/1232] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:10:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:10:33.941786 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d80ce-2305-48dc-a8ca-d1aea9141063 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:33.953019 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d80ce-2305-48dc-a8ca-d1aea9141063 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:33.958429 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8dc240-6f5d-4e38-af58-40a964abf30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:33.959025 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8dc240-6f5d-4e38-af58-40a964abf30a admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:33.959305 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8dc240-6f5d-4e38-af58-40a964abf30a admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:33.959578 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8dc240-6f5d-4e38-af58-40a964abf30a admin admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:33.960283 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8dc240-6f5d-4e38-af58-40a964abf30a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:10:33.960584 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8dc240-6f5d-4e38-af58-40a964abf30a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:33.962164 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8dc240-6f5d-4e38-af58-40a964abf30a admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:33.975906 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 617/1233] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:10:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:10:33.977287 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f8fd8-3aef-4868-b803-89f7d6d28547 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:33.977576 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f8fd8-3aef-4868-b803-89f7d6d28547 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:33.977878 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f8fd8-3aef-4868-b803-89f7d6d28547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:33.996708 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-1d9f8fd8-3aef-4868-b803-89f7d6d28547 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:33.997907 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-1d9f8fd8-3aef-4868-b803-89f7d6d28547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:34.006198 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 618/1234] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:34.009013 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f8fd8-3aef-4868-b803-89f7d6d28547 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:34.012227 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 617/1235] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:10:33 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:10:34.013576 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54d188-6de6-4ed2-81e8-1268a462ef20 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:34.013695 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54d188-6de6-4ed2-81e8-1268a462ef20 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:34.013943 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54d188-6de6-4ed2-81e8-1268a462ef20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:34.017714 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f8fd8-3aef-4868-b803-89f7d6d28547 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:34.023127 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8264f-553c-47c1-89bb-3241c43f0110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:34.023127 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8264f-553c-47c1-89bb-3241c43f0110 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:34.023402 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8264f-553c-47c1-89bb-3241c43f0110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:34.023512 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8264f-553c-47c1-89bb-3241c43f0110 admin admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:34.024123 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d8264f-553c-47c1-89bb-3241c43f0110 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:10:34.024425 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d8264f-553c-47c1-89bb-3241c43f0110 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:34.026037 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d8264f-553c-47c1-89bb-3241c43f0110 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:34.034564 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-fc54d188-6de6-4ed2-81e8-1268a462ef20 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:34.037735 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-fc54d188-6de6-4ed2-81e8-1268a462ef20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:34.048831 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 619/1236] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:10:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:10:34.048831 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8264f-553c-47c1-89bb-3241c43f0110 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:34.049106 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 618/1237] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:10:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:34.049106 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40234955-4372-4f67-9ceb-073ff5cd10db None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:34.049106 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40234955-4372-4f67-9ceb-073ff5cd10db None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:34.049106 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40234955-4372-4f67-9ceb-073ff5cd10db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:34.049388 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8264f-553c-47c1-89bb-3241c43f0110 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:34.054324 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193381fc-dc36-4375-80a7-994362cb332b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:34.054918 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193381fc-dc36-4375-80a7-994362cb332b admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:34.055197 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193381fc-dc36-4375-80a7-994362cb332b admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:34.056339 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193381fc-dc36-4375-80a7-994362cb332b admin admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:34.056339 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193381fc-dc36-4375-80a7-994362cb332b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:10:34.056570 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193381fc-dc36-4375-80a7-994362cb332b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:34.058017 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193381fc-dc36-4375-80a7-994362cb332b admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:34.066480 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-40234955-4372-4f67-9ceb-073ff5cd10db None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:34.067684 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-40234955-4372-4f67-9ceb-073ff5cd10db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:34.069975 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 620/1238] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:10:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:10:34.070737 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193381fc-dc36-4375-80a7-994362cb332b admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:34.080899 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 619/1239] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:10:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:34.081668 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40234955-4372-4f67-9ceb-073ff5cd10db None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:34.084805 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193381fc-dc36-4375-80a7-994362cb332b admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:34.089815 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff112ed-530f-4b6f-85ce-0aa2c2a5bd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:34.090417 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff112ed-530f-4b6f-85ce-0aa2c2a5bd03 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:34.090693 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff112ed-530f-4b6f-85ce-0aa2c2a5bd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:34.090958 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff112ed-530f-4b6f-85ce-0aa2c2a5bd03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:34.091078 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40234955-4372-4f67-9ceb-073ff5cd10db None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:34.091579 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff112ed-530f-4b6f-85ce-0aa2c2a5bd03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:34.093474 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff112ed-530f-4b6f-85ce-0aa2c2a5bd03 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:34.095558 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a044d-b30d-4395-959e-6076b5302969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:34.097349 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a044d-b30d-4395-959e-6076b5302969 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:34.097349 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a044d-b30d-4395-959e-6076b5302969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:34.097349 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a044d-b30d-4395-959e-6076b5302969 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:34.098843 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a044d-b30d-4395-959e-6076b5302969 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:34.100725 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a044d-b30d-4395-959e-6076b5302969 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:34.194888 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 621/1240] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:10:34 2022] POST /identity/v3/projects => generated 379 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:10:34.195749 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff112ed-530f-4b6f-85ce-0aa2c2a5bd03 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:34.218182 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 620/1241] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:10:34 2022] POST /identity/v3/projects => generated 391 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:10:34.219395 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a044d-b30d-4395-959e-6076b5302969 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:34.226480 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:34.259453 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff112ed-530f-4b6f-85ce-0aa2c2a5bd03 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:34.273748 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:34.283640 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a044d-b30d-4395-959e-6076b5302969 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:34.288514 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb75bb4-5208-411a-b1a2-e3efe2b733d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:34.289130 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb75bb4-5208-411a-b1a2-e3efe2b733d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:34.289408 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb75bb4-5208-411a-b1a2-e3efe2b733d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:34.289685 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb75bb4-5208-411a-b1a2-e3efe2b733d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:34.290326 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb75bb4-5208-411a-b1a2-e3efe2b733d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:34.291927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb75bb4-5208-411a-b1a2-e3efe2b733d5 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:34.301783 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 621/1242] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:10:34.302595 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb75bb4-5208-411a-b1a2-e3efe2b733d5 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:34.312084 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb75bb4-5208-411a-b1a2-e3efe2b733d5 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:34.318493 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ac063-886f-4175-a7f6-b03ea8926031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:34.318493 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ac063-886f-4175-a7f6-b03ea8926031 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:34.318493 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ac063-886f-4175-a7f6-b03ea8926031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:34.318493 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ac063-886f-4175-a7f6-b03ea8926031 admin admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:34.318902 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ac063-886f-4175-a7f6-b03ea8926031 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:10:34.318981 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2c4f7-b6bb-49c1-9ddf-557d5a969d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:34.319067 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ac063-886f-4175-a7f6-b03ea8926031 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:34.319150 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2c4f7-b6bb-49c1-9ddf-557d5a969d80 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:34.319150 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2c4f7-b6bb-49c1-9ddf-557d5a969d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:34.319150 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2c4f7-b6bb-49c1-9ddf-557d5a969d80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:34.319150 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a2c4f7-b6bb-49c1-9ddf-557d5a969d80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:34.319463 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ac063-886f-4175-a7f6-b03ea8926031 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:34.320769 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a2c4f7-b6bb-49c1-9ddf-557d5a969d80 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:34.333328 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 622/1243] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:10:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:10:34.334154 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ac063-886f-4175-a7f6-b03ea8926031 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:34.344765 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ac063-886f-4175-a7f6-b03ea8926031 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:34.353091 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f3dbb-4059-4e12-be0f-b9cc9f5cb5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:34.353091 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f3dbb-4059-4e12-be0f-b9cc9f5cb5d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:34.353091 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f3dbb-4059-4e12-be0f-b9cc9f5cb5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:34.353091 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f3dbb-4059-4e12-be0f-b9cc9f5cb5d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:34.353486 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f3dbb-4059-4e12-be0f-b9cc9f5cb5d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:10:34.353486 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f3dbb-4059-4e12-be0f-b9cc9f5cb5d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:34.354101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f3dbb-4059-4e12-be0f-b9cc9f5cb5d6 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:34.365974 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 623/1244] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:10:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:10:34.366723 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f3dbb-4059-4e12-be0f-b9cc9f5cb5d6 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:34.375728 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f3dbb-4059-4e12-be0f-b9cc9f5cb5d6 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:34.381989 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ad664-7dfd-4fee-bc21-ad1a3af73a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:34.382579 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ad664-7dfd-4fee-bc21-ad1a3af73a94 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:34.383443 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ad664-7dfd-4fee-bc21-ad1a3af73a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:34.383730 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ad664-7dfd-4fee-bc21-ad1a3af73a94 admin admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:34.384399 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2ad664-7dfd-4fee-bc21-ad1a3af73a94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:34.386283 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2ad664-7dfd-4fee-bc21-ad1a3af73a94 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:34.509503 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 622/1245] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:10:34 2022] POST /identity/v3/projects => generated 371 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:10:34.510941 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2c4f7-b6bb-49c1-9ddf-557d5a969d80 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:34.532094 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 624/1246] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:10:34 2022] POST /identity/v3/projects => generated 357 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:10:34.532973 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ad664-7dfd-4fee-bc21-ad1a3af73a94 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:34.575178 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2c4f7-b6bb-49c1-9ddf-557d5a969d80 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:34.594966 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ad664-7dfd-4fee-bc21-ad1a3af73a94 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:34.605553 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c15128-00f8-4d06-90f5-fb5d6b61f621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:34.605553 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c15128-00f8-4d06-90f5-fb5d6b61f621 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:34.605553 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c15128-00f8-4d06-90f5-fb5d6b61f621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:34.605553 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c15128-00f8-4d06-90f5-fb5d6b61f621 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:34.605959 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c15128-00f8-4d06-90f5-fb5d6b61f621 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:34.605959 dv-cinder-862679-1-smb devstack@keystone.service[81622]: WARNING py.warnings [None req-f9c15128-00f8-4d06-90f5-fb5d6b61f621 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 26 11:10:34.605959 dv-cinder-862679-1-smb devstack@keystone.service[81622]: warnings.warn(msg) Oct 26 11:10:34.605959 dv-cinder-862679-1-smb devstack@keystone.service[81622]: Oct 26 11:10:34.605959 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c15128-00f8-4d06-90f5-fb5d6b61f621 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:34.632960 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29745f48-26ff-4747-a465-d01dc11dfeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:34.633572 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29745f48-26ff-4747-a465-d01dc11dfeb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:34.633850 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29745f48-26ff-4747-a465-d01dc11dfeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:34.634121 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29745f48-26ff-4747-a465-d01dc11dfeb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:34.634762 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29745f48-26ff-4747-a465-d01dc11dfeb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:10:34.635065 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29745f48-26ff-4747-a465-d01dc11dfeb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:34.636740 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29745f48-26ff-4747-a465-d01dc11dfeb0 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:34.648698 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 623/1247] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:10:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:10:34.649505 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29745f48-26ff-4747-a465-d01dc11dfeb0 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:34.658720 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29745f48-26ff-4747-a465-d01dc11dfeb0 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:34.663835 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d62db-4a68-4b27-a2ea-b02d3d205145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:34.664433 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d62db-4a68-4b27-a2ea-b02d3d205145 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:34.664714 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d62db-4a68-4b27-a2ea-b02d3d205145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:34.664987 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d62db-4a68-4b27-a2ea-b02d3d205145 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:34.665592 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d62db-4a68-4b27-a2ea-b02d3d205145 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:34.667463 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d62db-4a68-4b27-a2ea-b02d3d205145 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:34.861199 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 624/1248] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:10:34 2022] POST /identity/v3/users => generated 296 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:10:34.862115 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d62db-4a68-4b27-a2ea-b02d3d205145 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:34.871540 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d62db-4a68-4b27-a2ea-b02d3d205145 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:34.876526 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb05b1-4cf7-4331-997b-e1cb658d4e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:34.882096 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb05b1-4cf7-4331-997b-e1cb658d4e30 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:34.882096 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb05b1-4cf7-4331-997b-e1cb658d4e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:34.882096 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb05b1-4cf7-4331-997b-e1cb658d4e30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:34.882096 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb05b1-4cf7-4331-997b-e1cb658d4e30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:34.882472 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 625/1249] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:10:34 2022] POST /identity/v3/users => generated 290 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:10:34.882472 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c15128-00f8-4d06-90f5-fb5d6b61f621 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:34.882656 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb05b1-4cf7-4331-997b-e1cb658d4e30 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:34.895282 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 625/1250] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:10:34.895448 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c15128-00f8-4d06-90f5-fb5d6b61f621 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:34.895550 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb05b1-4cf7-4331-997b-e1cb658d4e30 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:34.897685 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2398bb-e1e5-46c7-ba55-c3a4babcf4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:34.898296 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2398bb-e1e5-46c7-ba55-c3a4babcf4b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:34.898581 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2398bb-e1e5-46c7-ba55-c3a4babcf4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:34.898857 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2398bb-e1e5-46c7-ba55-c3a4babcf4b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:34.899495 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2398bb-e1e5-46c7-ba55-c3a4babcf4b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:34.901439 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2398bb-e1e5-46c7-ba55-c3a4babcf4b9 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:34.902860 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb05b1-4cf7-4331-997b-e1cb658d4e30 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:34.908667 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed183e5b-1a18-4bcf-a981-04608d6dcb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:34.909262 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed183e5b-1a18-4bcf-a981-04608d6dcb37 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:34.909541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed183e5b-1a18-4bcf-a981-04608d6dcb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:34.909812 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed183e5b-1a18-4bcf-a981-04608d6dcb37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:34.910439 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed183e5b-1a18-4bcf-a981-04608d6dcb37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:34.912392 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed183e5b-1a18-4bcf-a981-04608d6dcb37 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:35.039480 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:35.045978 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 626/1251] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:10:34 2022] POST /identity/v3/projects => generated 377 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:10:35.046571 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2398bb-e1e5-46c7-ba55-c3a4babcf4b9 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:35.069488 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 626/1252] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:10:34 2022] POST /identity/v3/projects => generated 385 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:10:35.072179 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed183e5b-1a18-4bcf-a981-04608d6dcb37 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:35.092648 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:35.107879 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2398bb-e1e5-46c7-ba55-c3a4babcf4b9 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:35.134792 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed183e5b-1a18-4bcf-a981-04608d6dcb37 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:35.139356 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaac8a0-9c23-4a51-9b2a-f577cac263c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:35.139962 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaac8a0-9c23-4a51-9b2a-f577cac263c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:35.140320 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaac8a0-9c23-4a51-9b2a-f577cac263c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:35.140778 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaac8a0-9c23-4a51-9b2a-f577cac263c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:35.141410 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaac8a0-9c23-4a51-9b2a-f577cac263c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:35.143332 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaac8a0-9c23-4a51-9b2a-f577cac263c2 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:35.163509 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aef883-6690-44b8-b9dd-e829b3a5d100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:35.169345 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aef883-6690-44b8-b9dd-e829b3a5d100 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:35.169345 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aef883-6690-44b8-b9dd-e829b3a5d100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:35.169345 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aef883-6690-44b8-b9dd-e829b3a5d100 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:35.169345 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aef883-6690-44b8-b9dd-e829b3a5d100 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:35.169345 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aef883-6690-44b8-b9dd-e829b3a5d100 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:35.273783 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 627/1253] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:10:35 2022] POST /identity/v3/users => generated 279 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:10:35.274591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaac8a0-9c23-4a51-9b2a-f577cac263c2 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:35.284385 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaac8a0-9c23-4a51-9b2a-f577cac263c2 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:35.288917 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c145afd-901b-40e5-b716-d311a6c57046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:35.289474 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c145afd-901b-40e5-b716-d311a6c57046 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:35.289753 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c145afd-901b-40e5-b716-d311a6c57046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:35.290027 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c145afd-901b-40e5-b716-d311a6c57046 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:35.290643 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c145afd-901b-40e5-b716-d311a6c57046 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:35.292548 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c145afd-901b-40e5-b716-d311a6c57046 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:35.342620 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 627/1254] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:10:35 2022] POST /identity/v3/users => generated 286 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:10:35.343661 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aef883-6690-44b8-b9dd-e829b3a5d100 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:35.353194 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aef883-6690-44b8-b9dd-e829b3a5d100 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:35.357738 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a38d9b-b983-4d26-88a7-0c511b93c162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:35.358314 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a38d9b-b983-4d26-88a7-0c511b93c162 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:35.358597 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a38d9b-b983-4d26-88a7-0c511b93c162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:35.358872 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a38d9b-b983-4d26-88a7-0c511b93c162 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:35.359527 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a38d9b-b983-4d26-88a7-0c511b93c162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:35.361156 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a38d9b-b983-4d26-88a7-0c511b93c162 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:35.372783 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 628/1255] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:10:35.372783 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a38d9b-b983-4d26-88a7-0c511b93c162 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:35.386483 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a38d9b-b983-4d26-88a7-0c511b93c162 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:35.391070 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abf565-c3d8-4edf-a042-948fc0a07b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:35.391665 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abf565-c3d8-4edf-a042-948fc0a07b4e admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:35.391943 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abf565-c3d8-4edf-a042-948fc0a07b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:35.392252 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abf565-c3d8-4edf-a042-948fc0a07b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:35.392878 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5abf565-c3d8-4edf-a042-948fc0a07b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:35.394645 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5abf565-c3d8-4edf-a042-948fc0a07b4e admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:35.404118 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 628/1256] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:10:35 2022] POST /identity/v3/projects => generated 371 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:10:35.404118 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c145afd-901b-40e5-b716-d311a6c57046 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:35.407122 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 629/1257] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:10:35.407942 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abf565-c3d8-4edf-a042-948fc0a07b4e admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:35.418455 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abf565-c3d8-4edf-a042-948fc0a07b4e admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:35.468955 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c145afd-901b-40e5-b716-d311a6c57046 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:35.473680 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7374a-fc89-437b-be07-8c9cd36aed73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:35.474347 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7374a-fc89-437b-be07-8c9cd36aed73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:35.474632 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7374a-fc89-437b-be07-8c9cd36aed73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:35.474911 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7374a-fc89-437b-be07-8c9cd36aed73 admin admin] PATH_INFO: `/v3/projects/9d67a0201cd2416897b5066936e073c8/users/82b945fd48524bbc8604d388472dcdc2/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:35.477330 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e9401-050e-4e96-b3d5-bae1d2a5c1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:35.477951 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e9401-050e-4e96-b3d5-bae1d2a5c1f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:35.478230 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e9401-050e-4e96-b3d5-bae1d2a5c1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:35.478504 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e9401-050e-4e96-b3d5-bae1d2a5c1f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:35.479166 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702e9401-050e-4e96-b3d5-bae1d2a5c1f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:35.481188 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702e9401-050e-4e96-b3d5-bae1d2a5c1f5 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:35.491364 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7374a-fc89-437b-be07-8c9cd36aed73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d67a0201cd2416897b5066936e073c8, user_id=82b945fd48524bbc8604d388472dcdc2, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:35.494138 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7374a-fc89-437b-be07-8c9cd36aed73 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:35.616741 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 630/1258] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:10:35 2022] POST /identity/v3/users => generated 289 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:10:35.617786 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e9401-050e-4e96-b3d5-bae1d2a5c1f5 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:35.623687 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:35.627369 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e9401-050e-4e96-b3d5-bae1d2a5c1f5 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:35.632415 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a8b73b-c14f-4e2a-9442-4a2b402fb11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:35.632992 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a8b73b-c14f-4e2a-9442-4a2b402fb11c admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:35.633272 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a8b73b-c14f-4e2a-9442-4a2b402fb11c admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:35.633545 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a8b73b-c14f-4e2a-9442-4a2b402fb11c admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:35.634175 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a8b73b-c14f-4e2a-9442-4a2b402fb11c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:35.636042 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a8b73b-c14f-4e2a-9442-4a2b402fb11c admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:35.673857 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 629/1259] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:10:35 2022] PUT /identity/v3/projects/9d67a0201cd2416897b5066936e073c8/users/82b945fd48524bbc8604d388472dcdc2/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:10:35.674616 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7374a-fc89-437b-be07-8c9cd36aed73 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:35.734706 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 631/1260] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:10:35 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:10:35.734706 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a8b73b-c14f-4e2a-9442-4a2b402fb11c admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:35.739875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7374a-fc89-437b-be07-8c9cd36aed73 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:35.743200 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a8b73b-c14f-4e2a-9442-4a2b402fb11c admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:35.744591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3974ec1-8ab3-4984-a966-fb4de5446abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:35.745206 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3974ec1-8ab3-4984-a966-fb4de5446abd admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:35.745486 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3974ec1-8ab3-4984-a966-fb4de5446abd admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:35.745802 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3974ec1-8ab3-4984-a966-fb4de5446abd admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:35.746450 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3974ec1-8ab3-4984-a966-fb4de5446abd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:35.747921 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053de259-9fa3-45ad-9292-269963c7deae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:35.748038 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3974ec1-8ab3-4984-a966-fb4de5446abd admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:35.748549 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053de259-9fa3-45ad-9292-269963c7deae admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:35.748829 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053de259-9fa3-45ad-9292-269963c7deae admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:35.749325 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053de259-9fa3-45ad-9292-269963c7deae admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:35.750275 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053de259-9fa3-45ad-9292-269963c7deae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:35.751532 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053de259-9fa3-45ad-9292-269963c7deae admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:35.757907 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 630/1261] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:10:35.758712 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3974ec1-8ab3-4984-a966-fb4de5446abd admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:35.762694 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 632/1262] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:10:35.763490 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053de259-9fa3-45ad-9292-269963c7deae admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:35.767183 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:35.770911 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3974ec1-8ab3-4984-a966-fb4de5446abd admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:35.774507 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053de259-9fa3-45ad-9292-269963c7deae admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:35.776297 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb7513d-92dd-4c4f-a49a-bb74a038aac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:35.776297 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7513d-92dd-4c4f-a49a-bb74a038aac1 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:35.776534 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7513d-92dd-4c4f-a49a-bb74a038aac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:35.776711 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7513d-92dd-4c4f-a49a-bb74a038aac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:35.777331 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb7513d-92dd-4c4f-a49a-bb74a038aac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:35.778905 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb7513d-92dd-4c4f-a49a-bb74a038aac1 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:35.779207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19790ef3-65aa-4fb5-a565-db76ad142bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:35.779819 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19790ef3-65aa-4fb5-a565-db76ad142bc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:35.780177 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19790ef3-65aa-4fb5-a565-db76ad142bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:35.780546 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19790ef3-65aa-4fb5-a565-db76ad142bc2 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:35.781164 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19790ef3-65aa-4fb5-a565-db76ad142bc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:35.783140 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19790ef3-65aa-4fb5-a565-db76ad142bc2 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:35.789257 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 631/1263] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:10:35.790068 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb7513d-92dd-4c4f-a49a-bb74a038aac1 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:35.800204 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb7513d-92dd-4c4f-a49a-bb74a038aac1 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:35.805368 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb93c0-dd4f-424c-8c5c-08dcc5cdd380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:35.805960 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb93c0-dd4f-424c-8c5c-08dcc5cdd380 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:35.806242 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb93c0-dd4f-424c-8c5c-08dcc5cdd380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:35.806516 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb93c0-dd4f-424c-8c5c-08dcc5cdd380 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:35.807139 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb93c0-dd4f-424c-8c5c-08dcc5cdd380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:35.808755 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb93c0-dd4f-424c-8c5c-08dcc5cdd380 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:35.818801 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 632/1264] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:10:35.819568 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb93c0-dd4f-424c-8c5c-08dcc5cdd380 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:35.828882 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb93c0-dd4f-424c-8c5c-08dcc5cdd380 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:35.833913 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9ea85-3298-4ffa-a335-e4e158e69a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:35.834497 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9ea85-3298-4ffa-a335-e4e158e69a34 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:35.834776 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9ea85-3298-4ffa-a335-e4e158e69a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:35.839335 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9ea85-3298-4ffa-a335-e4e158e69a34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:35.839335 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9ea85-3298-4ffa-a335-e4e158e69a34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:35.839335 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9ea85-3298-4ffa-a335-e4e158e69a34 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:35.847161 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 633/1265] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:10:35.848843 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942927d-0d59-4357-909e-bb2a23fb6295 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:35.849124 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942927d-0d59-4357-909e-bb2a23fb6295 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:35.849393 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942927d-0d59-4357-909e-bb2a23fb6295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:35.867310 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-3942927d-0d59-4357-909e-bb2a23fb6295 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:35.868552 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3942927d-0d59-4357-909e-bb2a23fb6295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:35.875992 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 634/1266] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:35.876788 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3942927d-0d59-4357-909e-bb2a23fb6295 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:35.885742 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3942927d-0d59-4357-909e-bb2a23fb6295 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:35.890237 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0bbb0-1212-4e04-be8b-11c21c433c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:35.890820 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0bbb0-1212-4e04-be8b-11c21c433c3a admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:35.891097 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0bbb0-1212-4e04-be8b-11c21c433c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:35.891367 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0bbb0-1212-4e04-be8b-11c21c433c3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:35.891992 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0bbb0-1212-4e04-be8b-11c21c433c3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:35.893592 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0bbb0-1212-4e04-be8b-11c21c433c3a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:35.903641 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 633/1267] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:10:35 2022] POST /identity/v3/users => generated 286 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:10:35.903641 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19790ef3-65aa-4fb5-a565-db76ad142bc2 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:35.903867 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 635/1268] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:10:35.904517 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0bbb0-1212-4e04-be8b-11c21c433c3a admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:35.914570 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0bbb0-1212-4e04-be8b-11c21c433c3a admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:35.917031 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19790ef3-65aa-4fb5-a565-db76ad142bc2 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:35.919340 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc541b20-ebdf-444b-9689-a863ece0a186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:35.919937 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc541b20-ebdf-444b-9689-a863ece0a186 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:35.920256 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc541b20-ebdf-444b-9689-a863ece0a186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:35.920533 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc541b20-ebdf-444b-9689-a863ece0a186 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:35.921291 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc541b20-ebdf-444b-9689-a863ece0a186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:35.921919 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ba9f9-4487-4a9b-88ee-a292fbb4fb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:35.922514 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ba9f9-4487-4a9b-88ee-a292fbb4fb4e admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:35.922789 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ba9f9-4487-4a9b-88ee-a292fbb4fb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:35.922896 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc541b20-ebdf-444b-9689-a863ece0a186 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:35.923061 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ba9f9-4487-4a9b-88ee-a292fbb4fb4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:35.923694 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72ba9f9-4487-4a9b-88ee-a292fbb4fb4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:35.925359 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72ba9f9-4487-4a9b-88ee-a292fbb4fb4e admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:35.936257 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 636/1269] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:10:35.936257 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc541b20-ebdf-444b-9689-a863ece0a186 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:35.936538 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 634/1270] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:10:35.937128 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ba9f9-4487-4a9b-88ee-a292fbb4fb4e admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:35.944335 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc541b20-ebdf-444b-9689-a863ece0a186 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:35.948952 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e013e300-e279-4dd8-ba0f-b6320c746730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:35.949118 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ba9f9-4487-4a9b-88ee-a292fbb4fb4e admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:35.949600 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013e300-e279-4dd8-ba0f-b6320c746730 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:35.949884 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013e300-e279-4dd8-ba0f-b6320c746730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:35.950161 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013e300-e279-4dd8-ba0f-b6320c746730 admin admin] PATH_INFO: `/v3/projects/35adffd47f334db69701a48b5f11b1a2/users/bfef80e955344073a2a35c569e199f24/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:35.954035 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d5863-1fd6-4be1-ac51-dbf62137b0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:35.954676 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d5863-1fd6-4be1-ac51-dbf62137b0da admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:35.954957 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d5863-1fd6-4be1-ac51-dbf62137b0da admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:35.959012 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d5863-1fd6-4be1-ac51-dbf62137b0da admin admin] PATH_INFO: `/v3/projects/6914d8489bd44d659dbc4a1f591b4f04/users/39bb671cf2cc4a388e6d8aa08f07371e/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:35.966203 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e013e300-e279-4dd8-ba0f-b6320c746730 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35adffd47f334db69701a48b5f11b1a2, user_id=bfef80e955344073a2a35c569e199f24, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:35.969002 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e013e300-e279-4dd8-ba0f-b6320c746730 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:35.971495 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d5863-1fd6-4be1-ac51-dbf62137b0da admin admin] RBAC: Authorizing `identity:create_grant(project_id=6914d8489bd44d659dbc4a1f591b4f04, user_id=39bb671cf2cc4a388e6d8aa08f07371e, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:35.974787 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d5863-1fd6-4be1-ac51-dbf62137b0da admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:36.055856 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 637/1271] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:10:35 2022] PUT /identity/v3/projects/35adffd47f334db69701a48b5f11b1a2/users/bfef80e955344073a2a35c569e199f24/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:10:36.056711 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e013e300-e279-4dd8-ba0f-b6320c746730 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:36.090691 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 635/1272] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:10:35 2022] PUT /identity/v3/projects/6914d8489bd44d659dbc4a1f591b4f04/users/39bb671cf2cc4a388e6d8aa08f07371e/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:10:36.091767 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d5863-1fd6-4be1-ac51-dbf62137b0da admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:36.120049 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e013e300-e279-4dd8-ba0f-b6320c746730 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:36.154897 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d5863-1fd6-4be1-ac51-dbf62137b0da admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:36.158570 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087dd96-062c-40dc-a4e1-2702dd078090 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:36.159165 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087dd96-062c-40dc-a4e1-2702dd078090 service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:36.159445 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087dd96-062c-40dc-a4e1-2702dd078090 service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:36.159717 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087dd96-062c-40dc-a4e1-2702dd078090 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:36.176684 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893ea0e-1738-4d13-a6eb-d99e8fae3bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:36.177230 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893ea0e-1738-4d13-a6eb-d99e8fae3bee admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:36.177514 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893ea0e-1738-4d13-a6eb-d99e8fae3bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:36.177786 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893ea0e-1738-4d13-a6eb-d99e8fae3bee admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:36.178428 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3893ea0e-1738-4d13-a6eb-d99e8fae3bee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:36.180024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3893ea0e-1738-4d13-a6eb-d99e8fae3bee admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:36.189735 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 638/1273] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:10:36.190542 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893ea0e-1738-4d13-a6eb-d99e8fae3bee admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:36.201916 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893ea0e-1738-4d13-a6eb-d99e8fae3bee admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:36.207533 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80454387-b777-4824-96bf-d80e254e1e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:36.208163 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80454387-b777-4824-96bf-d80e254e1e34 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:36.208477 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80454387-b777-4824-96bf-d80e254e1e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:36.208708 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80454387-b777-4824-96bf-d80e254e1e34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:36.209345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80454387-b777-4824-96bf-d80e254e1e34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:36.210888 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80454387-b777-4824-96bf-d80e254e1e34 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:36.221156 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 639/1274] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:10:36.221582 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b087dd96-062c-40dc-a4e1-2702dd078090 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:36.221951 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80454387-b777-4824-96bf-d80e254e1e34 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:36.223638 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b087dd96-062c-40dc-a4e1-2702dd078090 service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:36.233359 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80454387-b777-4824-96bf-d80e254e1e34 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:36.233942 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 636/1275] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:10:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:10:36.234588 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087dd96-062c-40dc-a4e1-2702dd078090 service neutron] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:36.238185 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98814c-8394-4d58-8ce8-05aa7c6f96f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:36.238780 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98814c-8394-4d58-8ce8-05aa7c6f96f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:36.239069 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98814c-8394-4d58-8ce8-05aa7c6f96f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:36.239482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98814c-8394-4d58-8ce8-05aa7c6f96f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:36.239947 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98814c-8394-4d58-8ce8-05aa7c6f96f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:36.241609 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98814c-8394-4d58-8ce8-05aa7c6f96f1 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:36.243608 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087dd96-062c-40dc-a4e1-2702dd078090 service neutron] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:36.247088 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:36.248940 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f541a-6b3e-4856-ae26-e6e90c83dc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:36.249842 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f541a-6b3e-4856-ae26-e6e90c83dc31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:36.250137 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f541a-6b3e-4856-ae26-e6e90c83dc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:36.250414 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f541a-6b3e-4856-ae26-e6e90c83dc31 admin admin] PATH_INFO: `/v3/projects/ef96b16ea7fc476f827e1a44cff24577/users/cd22c5f91c4b439eae11a8d7748516bc/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:36.253027 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 640/1276] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:10:36.257278 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98814c-8394-4d58-8ce8-05aa7c6f96f1 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:36.266724 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f541a-6b3e-4856-ae26-e6e90c83dc31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef96b16ea7fc476f827e1a44cff24577, user_id=cd22c5f91c4b439eae11a8d7748516bc, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:36.267016 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98814c-8394-4d58-8ce8-05aa7c6f96f1 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:36.269553 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f541a-6b3e-4856-ae26-e6e90c83dc31 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:36.272114 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad14282-7f24-4e82-81e1-5b29a5045f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:36.272803 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad14282-7f24-4e82-81e1-5b29a5045f0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:36.273084 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad14282-7f24-4e82-81e1-5b29a5045f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:36.273409 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad14282-7f24-4e82-81e1-5b29a5045f0b admin admin] PATH_INFO: `/v3/projects/c0542bd44d334f10a8e7042880d0887b/users/3b34a4129e834125933ecaee4ccf099b/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:36.288106 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad14282-7f24-4e82-81e1-5b29a5045f0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0542bd44d334f10a8e7042880d0887b, user_id=3b34a4129e834125933ecaee4ccf099b, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:36.291062 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad14282-7f24-4e82-81e1-5b29a5045f0b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:36.358472 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 637/1277] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:10:36 2022] PUT /identity/v3/projects/ef96b16ea7fc476f827e1a44cff24577/users/cd22c5f91c4b439eae11a8d7748516bc/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:10:36.360015 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719b908-5afb-4df1-86ca-04e3bb3479c2 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:36.360217 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719b908-5afb-4df1-86ca-04e3bb3479c2 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:36.368207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719b908-5afb-4df1-86ca-04e3bb3479c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:36.381373 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-c719b908-5afb-4df1-86ca-04e3bb3479c2 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:36.382664 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-c719b908-5afb-4df1-86ca-04e3bb3479c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:36.386813 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:36.429113 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 641/1278] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:10:36 2022] PUT /identity/v3/projects/c0542bd44d334f10a8e7042880d0887b/users/3b34a4129e834125933ecaee4ccf099b/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:10:36.429113 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e82e4-fe4c-47e8-ba6b-600d85216ca8 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:36.429396 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e82e4-fe4c-47e8-ba6b-600d85216ca8 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:36.429525 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e82e4-fe4c-47e8-ba6b-600d85216ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:36.452026 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 638/1279] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:10:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:36.452913 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719b908-5afb-4df1-86ca-04e3bb3479c2 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:36.458827 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-a60e82e4-fe4c-47e8-ba6b-600d85216ca8 None None] MFA Rules not processed for user `39bb671cf2cc4a388e6d8aa08f07371e`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:36.464514 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a60e82e4-fe4c-47e8-ba6b-600d85216ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:36.464642 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719b908-5afb-4df1-86ca-04e3bb3479c2 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:36.525854 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0da0a-4fee-47d5-9296-bec1866f52aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:36.526531 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0da0a-4fee-47d5-9296-bec1866f52aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:36.526812 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0da0a-4fee-47d5-9296-bec1866f52aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:36.527089 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0da0a-4fee-47d5-9296-bec1866f52aa admin admin] PATH_INFO: `/v3/projects/ce7a0ac8b0f841c28abe07992124c63e/users/4b5d753f78e34b7e93122415bf3ff950/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:36.534843 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 642/1280] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:10:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:36.536224 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e82e4-fe4c-47e8-ba6b-600d85216ca8 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:36.542674 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e0da0a-4fee-47d5-9296-bec1866f52aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce7a0ac8b0f841c28abe07992124c63e, user_id=4b5d753f78e34b7e93122415bf3ff950, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:36.544807 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e0da0a-4fee-47d5-9296-bec1866f52aa admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:36.549086 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e82e4-fe4c-47e8-ba6b-600d85216ca8 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:36.554763 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c4e86-39d0-410a-ae29-91c5e3b62032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:36.555402 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c4e86-39d0-410a-ae29-91c5e3b62032 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:36.555680 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c4e86-39d0-410a-ae29-91c5e3b62032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:36.556018 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c4e86-39d0-410a-ae29-91c5e3b62032 admin admin] PATH_INFO: `/v3/projects/3e30b770d9ce4d46a5b0f46a07dc650f/users/1519c41b8f9e4724b520bab8f741b783/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:36.572398 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c4e86-39d0-410a-ae29-91c5e3b62032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e30b770d9ce4d46a5b0f46a07dc650f, user_id=1519c41b8f9e4724b520bab8f741b783, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:36.575145 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c4e86-39d0-410a-ae29-91c5e3b62032 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:36.707022 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 643/1281] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:10:36 2022] PUT /identity/v3/projects/3e30b770d9ce4d46a5b0f46a07dc650f/users/1519c41b8f9e4724b520bab8f741b783/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:10:36.707638 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 639/1282] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:10:36 2022] PUT /identity/v3/projects/ce7a0ac8b0f841c28abe07992124c63e/users/4b5d753f78e34b7e93122415bf3ff950/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:10:36.707981 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c4e86-39d0-410a-ae29-91c5e3b62032 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:36.708643 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27b72d-299d-42c8-9200-ac12c37cec5d None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:36.708930 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27b72d-299d-42c8-9200-ac12c37cec5d None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:36.709207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27b72d-299d-42c8-9200-ac12c37cec5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:36.742685 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-0e27b72d-299d-42c8-9200-ac12c37cec5d None None] MFA Rules not processed for user `cd22c5f91c4b439eae11a8d7748516bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:36.743900 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-0e27b72d-299d-42c8-9200-ac12c37cec5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:36.776690 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c4e86-39d0-410a-ae29-91c5e3b62032 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:36.816227 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 640/1283] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:10:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:36.819314 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13840565-1896-40ea-b2b5-28eaa153f83a None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:36.831208 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13840565-1896-40ea-b2b5-28eaa153f83a None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:36.833577 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:36.834081 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13840565-1896-40ea-b2b5-28eaa153f83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:36.857110 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b56da-045e-48b3-94f1-940bf43fffe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:36.857741 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b56da-045e-48b3-94f1-940bf43fffe4 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:36.858020 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b56da-045e-48b3-94f1-940bf43fffe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:36.858347 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b56da-045e-48b3-94f1-940bf43fffe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:36.858982 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b56da-045e-48b3-94f1-940bf43fffe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:36.860772 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b56da-045e-48b3-94f1-940bf43fffe4 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:36.871171 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 644/1284] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:10:36.872120 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b56da-045e-48b3-94f1-940bf43fffe4 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:36.880570 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-13840565-1896-40ea-b2b5-28eaa153f83a None None] MFA Rules not processed for user `3b34a4129e834125933ecaee4ccf099b`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:36.882429 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-13840565-1896-40ea-b2b5-28eaa153f83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:36.894133 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:36.931696 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b56da-045e-48b3-94f1-940bf43fffe4 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:36.935436 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5bffc5-3e21-4f2a-b231-1ebd56c5f03c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:36.936101 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bffc5-3e21-4f2a-b231-1ebd56c5f03c service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:36.936387 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bffc5-3e21-4f2a-b231-1ebd56c5f03c service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:36.936666 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bffc5-3e21-4f2a-b231-1ebd56c5f03c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:36.946500 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5bffc5-3e21-4f2a-b231-1ebd56c5f03c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:36.947967 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5bffc5-3e21-4f2a-b231-1ebd56c5f03c service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:36.953546 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 641/1285] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:10:36 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:36.954367 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13840565-1896-40ea-b2b5-28eaa153f83a None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:36.957864 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 645/1286] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:10:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:10:36.959028 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b03abb-dd05-4131-aefa-045518479b3f None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:36.959311 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b03abb-dd05-4131-aefa-045518479b3f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:36.959737 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b03abb-dd05-4131-aefa-045518479b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:36.965370 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13840565-1896-40ea-b2b5-28eaa153f83a None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:36.970529 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b042a-24ce-4ee4-b8e3-976f3bb3f38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:36.971143 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b042a-24ce-4ee4-b8e3-976f3bb3f38d admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:36.971422 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b042a-24ce-4ee4-b8e3-976f3bb3f38d admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:36.971695 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b042a-24ce-4ee4-b8e3-976f3bb3f38d admin admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:36.972372 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b042a-24ce-4ee4-b8e3-976f3bb3f38d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:36.974410 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b042a-24ce-4ee4-b8e3-976f3bb3f38d admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:36.980102 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-96b03abb-dd05-4131-aefa-045518479b3f None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:36.981422 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-96b03abb-dd05-4131-aefa-045518479b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:36.989652 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 646/1287] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:10:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:36.990965 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ebea7-6f2c-4639-920d-1c86ecd66662 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:36.991127 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ebea7-6f2c-4639-920d-1c86ecd66662 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:36.991477 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ebea7-6f2c-4639-920d-1c86ecd66662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:37.020793 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-652ebea7-6f2c-4639-920d-1c86ecd66662 None None] MFA Rules not processed for user `4b5d753f78e34b7e93122415bf3ff950`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:37.022018 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-652ebea7-6f2c-4639-920d-1c86ecd66662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:37.085655 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 647/1288] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:10:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:37.087137 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317335d-fd69-4980-bf4b-787151a6d375 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:37.087429 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317335d-fd69-4980-bf4b-787151a6d375 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:37.087711 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317335d-fd69-4980-bf4b-787151a6d375 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:37.089885 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 648/1289] 10.222.0.45 () {54 vars in 961 bytes} [Wed Oct 26 11:10:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:10:37.090153 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317335d-fd69-4980-bf4b-787151a6d375 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:37.104019 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317335d-fd69-4980-bf4b-787151a6d375 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:37.109772 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32aec2b-52ee-4c9c-8d2b-4089a8819558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:37.110706 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32aec2b-52ee-4c9c-8d2b-4089a8819558 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:37.111236 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32aec2b-52ee-4c9c-8d2b-4089a8819558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:37.111703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32aec2b-52ee-4c9c-8d2b-4089a8819558 admin admin] PATH_INFO: `/v3/projects/f4758e603ad246ce810a7915315abe94/users/e66949cd31ae4d96b5540cd9fab4ba0e/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:37.128352 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32aec2b-52ee-4c9c-8d2b-4089a8819558 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4758e603ad246ce810a7915315abe94, user_id=e66949cd31ae4d96b5540cd9fab4ba0e, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:37.132298 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32aec2b-52ee-4c9c-8d2b-4089a8819558 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:37.142675 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 642/1290] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:10:36 2022] POST /identity/v3/projects => generated 381 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:10:37.142675 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b042a-24ce-4ee4-b8e3-976f3bb3f38d admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:37.210455 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b042a-24ce-4ee4-b8e3-976f3bb3f38d admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:37.215265 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c7499-477a-442b-8370-38b8a469cfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:37.215872 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c7499-477a-442b-8370-38b8a469cfe0 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:37.216177 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c7499-477a-442b-8370-38b8a469cfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:37.216453 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c7499-477a-442b-8370-38b8a469cfe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:37.217087 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c7499-477a-442b-8370-38b8a469cfe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:37.218977 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c7499-477a-442b-8370-38b8a469cfe0 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:37.258048 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 649/1291] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:10:37 2022] PUT /identity/v3/projects/f4758e603ad246ce810a7915315abe94/users/e66949cd31ae4d96b5540cd9fab4ba0e/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:10:37.259113 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32aec2b-52ee-4c9c-8d2b-4089a8819558 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:37.337243 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:37.344131 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32aec2b-52ee-4c9c-8d2b-4089a8819558 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:37.356840 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589c310-bb19-4bac-b945-602113974144 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:37.356840 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589c310-bb19-4bac-b945-602113974144 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:37.356840 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589c310-bb19-4bac-b945-602113974144 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:37.356840 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589c310-bb19-4bac-b945-602113974144 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:37.366808 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 643/1292] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:10:37 2022] POST /identity/v3/projects => generated 357 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:10:37.368437 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c7499-477a-442b-8370-38b8a469cfe0 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:37.437762 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0589c310-bb19-4bac-b945-602113974144 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:37.439241 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0589c310-bb19-4bac-b945-602113974144 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:37.444404 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c7499-477a-442b-8370-38b8a469cfe0 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:37.449361 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5634f5cf-6671-4ddc-a0a8-9e6456707263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:37.449976 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634f5cf-6671-4ddc-a0a8-9e6456707263 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:37.450259 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634f5cf-6671-4ddc-a0a8-9e6456707263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:37.450384 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 650/1293] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:10:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:10:37.450528 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634f5cf-6671-4ddc-a0a8-9e6456707263 admin admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:37.451190 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5634f5cf-6671-4ddc-a0a8-9e6456707263 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:37.451677 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b970f0-770a-444c-8d8e-8dafe88a33ed None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:37.452035 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b970f0-770a-444c-8d8e-8dafe88a33ed None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:37.452490 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b970f0-770a-444c-8d8e-8dafe88a33ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:37.453264 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5634f5cf-6671-4ddc-a0a8-9e6456707263 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:37.493019 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-01b970f0-770a-444c-8d8e-8dafe88a33ed None None] MFA Rules not processed for user `a852a777cb6a4863bebdb949cc71ea65`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:37.494258 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-01b970f0-770a-444c-8d8e-8dafe88a33ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:37.574995 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 644/1294] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:10:37 2022] POST /identity/v3/projects => generated 377 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:10:37.576126 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5634f5cf-6671-4ddc-a0a8-9e6456707263 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:37.603451 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:37.704218 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5634f5cf-6671-4ddc-a0a8-9e6456707263 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:37.710294 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5984eb3-fe1d-4775-94bf-6f08fbb222ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:37.711303 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5984eb3-fe1d-4775-94bf-6f08fbb222ae admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:37.711647 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5984eb3-fe1d-4775-94bf-6f08fbb222ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:37.712568 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5984eb3-fe1d-4775-94bf-6f08fbb222ae admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:37.713359 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5984eb3-fe1d-4775-94bf-6f08fbb222ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:37.716286 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5984eb3-fe1d-4775-94bf-6f08fbb222ae admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:37.729594 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 651/1295] 10.222.0.45 () {58 vars in 1058 bytes} [Wed Oct 26 11:10:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:37.731520 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de262461-7238-4724-82dd-eadc3aa8338d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:37.732159 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de262461-7238-4724-82dd-eadc3aa8338d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:37.732468 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de262461-7238-4724-82dd-eadc3aa8338d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:37.768687 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-de262461-7238-4724-82dd-eadc3aa8338d None None] MFA Rules not processed for user `e66949cd31ae4d96b5540cd9fab4ba0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:37.770094 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-de262461-7238-4724-82dd-eadc3aa8338d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:37.842779 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 645/1296] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:10:37 2022] POST /identity/v3/users => generated 297 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:10:37.842779 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5984eb3-fe1d-4775-94bf-6f08fbb222ae admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:37.856013 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5984eb3-fe1d-4775-94bf-6f08fbb222ae admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:37.865373 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 652/1297] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:10:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:37.865373 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de262461-7238-4724-82dd-eadc3aa8338d None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:37.870391 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca401ec1-e242-4603-9c59-007e318bde42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:37.872200 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:37.873451 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca401ec1-e242-4603-9c59-007e318bde42 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:37.873968 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca401ec1-e242-4603-9c59-007e318bde42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:37.874456 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca401ec1-e242-4603-9c59-007e318bde42 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:37.875643 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca401ec1-e242-4603-9c59-007e318bde42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:37.878128 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca401ec1-e242-4603-9c59-007e318bde42 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:37.892841 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de262461-7238-4724-82dd-eadc3aa8338d None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:37.908502 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8fc70-250b-44e2-a127-df640e06363c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:37.909139 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8fc70-250b-44e2-a127-df640e06363c admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:37.909422 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8fc70-250b-44e2-a127-df640e06363c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:37.909769 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8fc70-250b-44e2-a127-df640e06363c admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:37.911110 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8fc70-250b-44e2-a127-df640e06363c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:37.913079 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8fc70-250b-44e2-a127-df640e06363c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:38.002777 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 646/1298] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:10:37 2022] POST /identity/v3/users => generated 285 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:10:38.004713 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca401ec1-e242-4603-9c59-007e318bde42 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:38.078405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca401ec1-e242-4603-9c59-007e318bde42 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:38.084492 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa17b13-d393-4e14-8f81-7f671ce6721e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:38.085110 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa17b13-d393-4e14-8f81-7f671ce6721e service nova] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:38.085391 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa17b13-d393-4e14-8f81-7f671ce6721e service nova] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:38.085666 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa17b13-d393-4e14-8f81-7f671ce6721e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:38.124986 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 653/1299] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:10:37 2022] POST /identity/v3/users => generated 295 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:10:38.135033 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8fc70-250b-44e2-a127-df640e06363c admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:38.137573 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8fc70-250b-44e2-a127-df640e06363c admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:38.142104 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991860be-7954-4947-b979-5947714720c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:38.142707 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991860be-7954-4947-b979-5947714720c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:38.142984 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991860be-7954-4947-b979-5947714720c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:38.143254 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991860be-7954-4947-b979-5947714720c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:38.143919 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991860be-7954-4947-b979-5947714720c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:38.145732 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991860be-7954-4947-b979-5947714720c2 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:38.149485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa17b13-d393-4e14-8f81-7f671ce6721e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:38.151147 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa17b13-d393-4e14-8f81-7f671ce6721e service nova] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:38.160125 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 654/1300] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:10:38.162173 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991860be-7954-4947-b979-5947714720c2 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:38.176616 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991860be-7954-4947-b979-5947714720c2 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:38.181722 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b4f629-d764-4a69-83b8-e533fa986d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:38.182031 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 647/1301] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:10:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:10:38.182835 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa17b13-d393-4e14-8f81-7f671ce6721e service nova] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:38.184002 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4f629-d764-4a69-83b8-e533fa986d3f admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:38.184002 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4f629-d764-4a69-83b8-e533fa986d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:38.184002 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4f629-d764-4a69-83b8-e533fa986d3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:38.184409 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b4f629-d764-4a69-83b8-e533fa986d3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:38.186445 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b4f629-d764-4a69-83b8-e533fa986d3f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:38.196661 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa17b13-d393-4e14-8f81-7f671ce6721e service nova] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:38.202379 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ccf27-3506-42b9-ab2f-04b876ae868f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:38.203214 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ccf27-3506-42b9-ab2f-04b876ae868f admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:38.203635 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ccf27-3506-42b9-ab2f-04b876ae868f admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:38.203972 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ccf27-3506-42b9-ab2f-04b876ae868f admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:38.204761 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252ccf27-3506-42b9-ab2f-04b876ae868f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:38.207179 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252ccf27-3506-42b9-ab2f-04b876ae868f admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:38.226037 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 648/1302] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:10:38.227409 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ccf27-3506-42b9-ab2f-04b876ae868f admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:38.241769 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ccf27-3506-42b9-ab2f-04b876ae868f admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:38.246979 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5edcb5-8d01-4b71-bc1c-59098339ef92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:38.247848 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5edcb5-8d01-4b71-bc1c-59098339ef92 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:38.249050 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5edcb5-8d01-4b71-bc1c-59098339ef92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:38.249466 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5edcb5-8d01-4b71-bc1c-59098339ef92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:38.250257 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5edcb5-8d01-4b71-bc1c-59098339ef92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:38.252205 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5edcb5-8d01-4b71-bc1c-59098339ef92 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:38.267539 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 649/1303] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:10:38.270550 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5edcb5-8d01-4b71-bc1c-59098339ef92 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:38.282659 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5edcb5-8d01-4b71-bc1c-59098339ef92 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:38.288176 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e33356-d0f7-44b4-9160-c2d290230952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:38.289161 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e33356-d0f7-44b4-9160-c2d290230952 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:38.289540 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e33356-d0f7-44b4-9160-c2d290230952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:38.289917 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e33356-d0f7-44b4-9160-c2d290230952 admin admin] PATH_INFO: `/v3/projects/a7a34f496605467e86e6069140272a99/users/d1522b342024427c9e3cd6de01d96134/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:38.310229 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 655/1304] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:10:38 2022] POST /identity/v3/projects => generated 373 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:10:38.311255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b4f629-d764-4a69-83b8-e533fa986d3f admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:38.335459 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:38.343075 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e33356-d0f7-44b4-9160-c2d290230952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a34f496605467e86e6069140272a99, user_id=d1522b342024427c9e3cd6de01d96134, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:38.350212 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e33356-d0f7-44b4-9160-c2d290230952 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:38.440925 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b4f629-d764-4a69-83b8-e533fa986d3f admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:38.447352 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2331c-2544-40de-a827-b92b4eec45c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:38.447352 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2331c-2544-40de-a827-b92b4eec45c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:38.447352 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2331c-2544-40de-a827-b92b4eec45c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:38.447352 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2331c-2544-40de-a827-b92b4eec45c6 admin admin] PATH_INFO: `/v3/projects/671d396c09d74fc88fbc5eb358f02f90/users/d7bf876584c24aa0a0151ea99a3a7b2d/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:38.462976 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef2331c-2544-40de-a827-b92b4eec45c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=671d396c09d74fc88fbc5eb358f02f90, user_id=d7bf876584c24aa0a0151ea99a3a7b2d, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:38.466967 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef2331c-2544-40de-a827-b92b4eec45c6 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:38.535481 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 650/1305] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:10:38 2022] PUT /identity/v3/projects/a7a34f496605467e86e6069140272a99/users/d1522b342024427c9e3cd6de01d96134/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:10:38.535481 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e33356-d0f7-44b4-9160-c2d290230952 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:38.587163 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 656/1306] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:10:38 2022] PUT /identity/v3/projects/671d396c09d74fc88fbc5eb358f02f90/users/d7bf876584c24aa0a0151ea99a3a7b2d/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:10:38.588153 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2331c-2544-40de-a827-b92b4eec45c6 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:38.633455 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e33356-d0f7-44b4-9160-c2d290230952 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:38.716733 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39620204-db79-4547-8a5f-693a523397fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:38.717412 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39620204-db79-4547-8a5f-693a523397fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:38.717787 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39620204-db79-4547-8a5f-693a523397fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:38.718131 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39620204-db79-4547-8a5f-693a523397fd admin admin] PATH_INFO: `/v3/projects/856d7ec13a4c422fa730fe355c9dede6/users/47e8c5f1ff744e9081594655ad7c3fe9/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:38.735322 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39620204-db79-4547-8a5f-693a523397fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=856d7ec13a4c422fa730fe355c9dede6, user_id=47e8c5f1ff744e9081594655ad7c3fe9, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:38.738722 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39620204-db79-4547-8a5f-693a523397fd admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:38.739155 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2331c-2544-40de-a827-b92b4eec45c6 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:38.744892 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a414c-b304-4927-9ec3-a117b6af4973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:38.745515 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a414c-b304-4927-9ec3-a117b6af4973 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:38.745812 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a414c-b304-4927-9ec3-a117b6af4973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:38.746068 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a414c-b304-4927-9ec3-a117b6af4973 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:38.746712 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a414c-b304-4927-9ec3-a117b6af4973 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:38.748774 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a414c-b304-4927-9ec3-a117b6af4973 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:38.857413 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 651/1307] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:10:38 2022] PUT /identity/v3/projects/856d7ec13a4c422fa730fe355c9dede6/users/47e8c5f1ff744e9081594655ad7c3fe9/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:10:38.857413 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c4eee-a88b-4b76-99a0-96310bb06f7b None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:38.857413 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c4eee-a88b-4b76-99a0-96310bb06f7b None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:38.857413 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c4eee-a88b-4b76-99a0-96310bb06f7b None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:38.857413 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 652/1308] 10.222.0.45 () {54 vars in 912 bytes} [Wed Oct 26 11:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:10:38.857413 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c4eee-a88b-4b76-99a0-96310bb06f7b None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:38.950684 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 657/1309] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:10:38 2022] POST /identity/v3/users => generated 293 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:10:38.951613 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a414c-b304-4927-9ec3-a117b6af4973 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:38.961485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c4eee-a88b-4b76-99a0-96310bb06f7b None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:38.967232 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a119233-8ddc-419d-9ff1-e87768a3ae96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:38.968505 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a119233-8ddc-419d-9ff1-e87768a3ae96 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:38.969037 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a119233-8ddc-419d-9ff1-e87768a3ae96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:38.969547 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a119233-8ddc-419d-9ff1-e87768a3ae96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:38.970469 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a119233-8ddc-419d-9ff1-e87768a3ae96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:38.972426 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a119233-8ddc-419d-9ff1-e87768a3ae96 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:38.973622 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a414c-b304-4927-9ec3-a117b6af4973 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:38.983801 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e3725-f9da-4472-aef2-4f7c336f8e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:38.984502 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e3725-f9da-4472-aef2-4f7c336f8e5f admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:38.984787 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e3725-f9da-4472-aef2-4f7c336f8e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:38.985063 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e3725-f9da-4472-aef2-4f7c336f8e5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:38.991058 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 653/1310] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:10:38.991984 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e3725-f9da-4472-aef2-4f7c336f8e5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:38.992600 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a119233-8ddc-419d-9ff1-e87768a3ae96 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:38.993790 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e3725-f9da-4472-aef2-4f7c336f8e5f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:39.017396 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a119233-8ddc-419d-9ff1-e87768a3ae96 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:39.020468 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 658/1311] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:10:39.021886 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d577d6f-6c20-43a2-a404-996d931b3b43 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:39.022181 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d577d6f-6c20-43a2-a404-996d931b3b43 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:39.022460 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d577d6f-6c20-43a2-a404-996d931b3b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:39.025674 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a7274-8a90-4495-93fd-934280eceac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:39.026998 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a7274-8a90-4495-93fd-934280eceac0 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:39.027579 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a7274-8a90-4495-93fd-934280eceac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:39.028552 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a7274-8a90-4495-93fd-934280eceac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:39.030960 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a7274-8a90-4495-93fd-934280eceac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:39.033159 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a7274-8a90-4495-93fd-934280eceac0 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:39.102494 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 654/1312] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:10:39.102494 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a7274-8a90-4495-93fd-934280eceac0 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:39.128429 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a7274-8a90-4495-93fd-934280eceac0 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:39.128639 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-2d577d6f-6c20-43a2-a404-996d931b3b43 None None] MFA Rules not processed for user `a852a777cb6a4863bebdb949cc71ea65`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:39.129124 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359bde60-6245-40e0-a73f-d020b6282625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:39.129251 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2d577d6f-6c20-43a2-a404-996d931b3b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:39.129333 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359bde60-6245-40e0-a73f-d020b6282625 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:39.129333 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359bde60-6245-40e0-a73f-d020b6282625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:39.129333 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359bde60-6245-40e0-a73f-d020b6282625 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:39.129333 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359bde60-6245-40e0-a73f-d020b6282625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:39.137574 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359bde60-6245-40e0-a73f-d020b6282625 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:39.148228 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:39.169356 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 655/1313] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:10:39.170244 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359bde60-6245-40e0-a73f-d020b6282625 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:39.190940 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359bde60-6245-40e0-a73f-d020b6282625 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:39.200376 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c433c-a4cf-47a8-a52f-97653ab0fdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:39.202319 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c433c-a4cf-47a8-a52f-97653ab0fdae admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:39.202877 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c433c-a4cf-47a8-a52f-97653ab0fdae admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:39.203378 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c433c-a4cf-47a8-a52f-97653ab0fdae admin admin] PATH_INFO: `/v3/projects/a7a34f496605467e86e6069140272a99/users/d1522b342024427c9e3cd6de01d96134/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:39.214724 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c433c-a4cf-47a8-a52f-97653ab0fdae admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a34f496605467e86e6069140272a99, user_id=d1522b342024427c9e3cd6de01d96134, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:39.218871 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c433c-a4cf-47a8-a52f-97653ab0fdae admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:39.231641 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 656/1314] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:10:39 2022] PUT /identity/v3/projects/a7a34f496605467e86e6069140272a99/users/d1522b342024427c9e3cd6de01d96134/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:10:39.232594 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c433c-a4cf-47a8-a52f-97653ab0fdae admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:39.247875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 659/1315] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Oct 26 11:10:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:39.249380 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d577d6f-6c20-43a2-a404-996d931b3b43 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:39.279092 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d577d6f-6c20-43a2-a404-996d931b3b43 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:39.323332 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c433c-a4cf-47a8-a52f-97653ab0fdae admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:39.334882 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daaaa69-ff79-43fe-9013-f992f9ae44b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:39.335573 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daaaa69-ff79-43fe-9013-f992f9ae44b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:39.335854 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daaaa69-ff79-43fe-9013-f992f9ae44b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:39.336158 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daaaa69-ff79-43fe-9013-f992f9ae44b6 admin admin] PATH_INFO: `/v3/projects/671d396c09d74fc88fbc5eb358f02f90/users/d7bf876584c24aa0a0151ea99a3a7b2d/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:39.338220 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daaaa69-ff79-43fe-9013-f992f9ae44b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=671d396c09d74fc88fbc5eb358f02f90, user_id=d7bf876584c24aa0a0151ea99a3a7b2d, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:39.341985 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daaaa69-ff79-43fe-9013-f992f9ae44b6 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:39.354206 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 657/1316] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:10:39 2022] PUT /identity/v3/projects/671d396c09d74fc88fbc5eb358f02f90/users/d7bf876584c24aa0a0151ea99a3a7b2d/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:10:39.355073 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daaaa69-ff79-43fe-9013-f992f9ae44b6 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:39.366681 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509da44-45f0-4a45-be62-76acd6b5ccce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:39.368098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509da44-45f0-4a45-be62-76acd6b5ccce admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:39.368994 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509da44-45f0-4a45-be62-76acd6b5ccce admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:39.369386 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509da44-45f0-4a45-be62-76acd6b5ccce admin admin] PATH_INFO: `/v3/projects/856d7ec13a4c422fa730fe355c9dede6/users/47e8c5f1ff744e9081594655ad7c3fe9/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:39.371868 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a509da44-45f0-4a45-be62-76acd6b5ccce admin admin] RBAC: Authorizing `identity:create_grant(project_id=856d7ec13a4c422fa730fe355c9dede6, user_id=47e8c5f1ff744e9081594655ad7c3fe9, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:39.376392 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a509da44-45f0-4a45-be62-76acd6b5ccce admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:39.392616 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 660/1317] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:10:39 2022] PUT /identity/v3/projects/856d7ec13a4c422fa730fe355c9dede6/users/47e8c5f1ff744e9081594655ad7c3fe9/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:10:39.393856 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b79054-8b16-4896-8d05-b4846cc13f48 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:39.394325 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b79054-8b16-4896-8d05-b4846cc13f48 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:39.394667 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b79054-8b16-4896-8d05-b4846cc13f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:39.467045 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-70b79054-8b16-4896-8d05-b4846cc13f48 None None] MFA Rules not processed for user `d1522b342024427c9e3cd6de01d96134`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:39.469036 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-70b79054-8b16-4896-8d05-b4846cc13f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:39.509206 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daaaa69-ff79-43fe-9013-f992f9ae44b6 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:39.580213 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 661/1318] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:10:39 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:39.582254 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b79054-8b16-4896-8d05-b4846cc13f48 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:39.633330 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b4692-acd1-4e11-9ef2-96fb73e1e737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:39.633920 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b4692-acd1-4e11-9ef2-96fb73e1e737 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:39.634260 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b4692-acd1-4e11-9ef2-96fb73e1e737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:39.634539 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b4692-acd1-4e11-9ef2-96fb73e1e737 admin admin] PATH_INFO: `/v3/projects/2e3182c9e58d4cda905e571a9ab4d4cf/users/33891d048c644b3f83d111fcb467effd/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:39.673211 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b4692-acd1-4e11-9ef2-96fb73e1e737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e3182c9e58d4cda905e571a9ab4d4cf, user_id=33891d048c644b3f83d111fcb467effd, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:39.676460 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b4692-acd1-4e11-9ef2-96fb73e1e737 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:39.686795 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:39.692304 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b79054-8b16-4896-8d05-b4846cc13f48 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:39.697891 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385460a-60a6-4ac6-810b-2f99ddd4311f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:39.698804 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385460a-60a6-4ac6-810b-2f99ddd4311f service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:39.699284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385460a-60a6-4ac6-810b-2f99ddd4311f service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:39.699744 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385460a-60a6-4ac6-810b-2f99ddd4311f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:39.780427 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 658/1319] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:10:39 2022] PUT /identity/v3/projects/2e3182c9e58d4cda905e571a9ab4d4cf/users/33891d048c644b3f83d111fcb467effd/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:10:39.784940 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb0b71-2530-4844-974b-3b5bb450d8ed None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:39.785791 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb0b71-2530-4844-974b-3b5bb450d8ed None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:39.786067 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb0b71-2530-4844-974b-3b5bb450d8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:39.803810 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385460a-60a6-4ac6-810b-2f99ddd4311f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:39.806950 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385460a-60a6-4ac6-810b-2f99ddd4311f service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:39.821969 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 662/1320] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:10:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:10:39.823879 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ed4bd-cb51-40d2-bce7-68eef6712e28 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:39.824511 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ed4bd-cb51-40d2-bce7-68eef6712e28 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:39.825053 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ed4bd-cb51-40d2-bce7-68eef6712e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:39.849660 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-fdbb0b71-2530-4844-974b-3b5bb450d8ed None None] MFA Rules not processed for user `d7bf876584c24aa0a0151ea99a3a7b2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:39.856537 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-fdbb0b71-2530-4844-974b-3b5bb450d8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:39.869229 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-964ed4bd-cb51-40d2-bce7-68eef6712e28 None None] MFA Rules not processed for user `47e8c5f1ff744e9081594655ad7c3fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:39.871000 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-964ed4bd-cb51-40d2-bce7-68eef6712e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:39.992497 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 663/1321] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:10:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:39.993511 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ed4bd-cb51-40d2-bce7-68eef6712e28 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:40.020924 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 659/1322] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:10:39 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:40.021998 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb0b71-2530-4844-974b-3b5bb450d8ed None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:40.067530 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ed4bd-cb51-40d2-bce7-68eef6712e28 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:40.076755 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ba27e-6d35-4ecb-acda-50d7a535ea90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:40.082613 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ba27e-6d35-4ecb-acda-50d7a535ea90 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:40.082613 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ba27e-6d35-4ecb-acda-50d7a535ea90 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:40.082613 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ba27e-6d35-4ecb-acda-50d7a535ea90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:40.194838 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb0b71-2530-4844-974b-3b5bb450d8ed None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:40.197137 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ba27e-6d35-4ecb-acda-50d7a535ea90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:40.199673 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ba27e-6d35-4ecb-acda-50d7a535ea90 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:40.205428 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02078c61-6410-45d1-8ef9-10112d22f223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:40.206067 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02078c61-6410-45d1-8ef9-10112d22f223 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:40.209475 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02078c61-6410-45d1-8ef9-10112d22f223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:40.209798 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02078c61-6410-45d1-8ef9-10112d22f223 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:40.212970 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02078c61-6410-45d1-8ef9-10112d22f223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:40.219341 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02078c61-6410-45d1-8ef9-10112d22f223 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:40.238450 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 664/1323] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:10:39 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:10:40.242691 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 660/1324] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:10:40.246832 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ba27e-6d35-4ecb-acda-50d7a535ea90 service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:40.263401 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ba27e-6d35-4ecb-acda-50d7a535ea90 service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:40.278834 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bfa8d2-bc9e-4300-a64a-cd9d1f9a5ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:40.281667 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfa8d2-bc9e-4300-a64a-cd9d1f9a5ae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:40.282797 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfa8d2-bc9e-4300-a64a-cd9d1f9a5ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:40.284954 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfa8d2-bc9e-4300-a64a-cd9d1f9a5ae2 admin admin] PATH_INFO: `/v3/projects/2e3182c9e58d4cda905e571a9ab4d4cf/users/33891d048c644b3f83d111fcb467effd/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:40.291591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bfa8d2-bc9e-4300-a64a-cd9d1f9a5ae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e3182c9e58d4cda905e571a9ab4d4cf, user_id=33891d048c644b3f83d111fcb467effd, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:40.299477 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bfa8d2-bc9e-4300-a64a-cd9d1f9a5ae2 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:40.335352 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 665/1325] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:10:40 2022] PUT /identity/v3/projects/2e3182c9e58d4cda905e571a9ab4d4cf/users/33891d048c644b3f83d111fcb467effd/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:10:40.346186 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930da7c-77e6-4ed8-8bf0-a8aabaeeca2c None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:40.347306 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930da7c-77e6-4ed8-8bf0-a8aabaeeca2c None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:40.348392 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930da7c-77e6-4ed8-8bf0-a8aabaeeca2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:40.407648 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-a930da7c-77e6-4ed8-8bf0-a8aabaeeca2c None None] MFA Rules not processed for user `33891d048c644b3f83d111fcb467effd`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:40.408372 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-a930da7c-77e6-4ed8-8bf0-a8aabaeeca2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:40.427381 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bfa8d2-bc9e-4300-a64a-cd9d1f9a5ae2 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:40.519258 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bfa8d2-bc9e-4300-a64a-cd9d1f9a5ae2 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:40.526129 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499b32e-8c21-48f0-a6ff-551e9e89cb86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:40.531096 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499b32e-8c21-48f0-a6ff-551e9e89cb86 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:40.531388 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499b32e-8c21-48f0-a6ff-551e9e89cb86 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:40.531735 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499b32e-8c21-48f0-a6ff-551e9e89cb86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:40.543511 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:40.573312 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 661/1326] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:10:40 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:40.623334 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499b32e-8c21-48f0-a6ff-551e9e89cb86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:40.624821 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499b32e-8c21-48f0-a6ff-551e9e89cb86 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:40.636144 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 666/1327] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:10:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:10:41.330344 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930da7c-77e6-4ed8-8bf0-a8aabaeeca2c None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:41.348883 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930da7c-77e6-4ed8-8bf0-a8aabaeeca2c None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:41.360173 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafae0d8-3d64-4628-abe6-15da3b226f20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:41.361132 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafae0d8-3d64-4628-abe6-15da3b226f20 service cinder] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:41.361565 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafae0d8-3d64-4628-abe6-15da3b226f20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:41.361995 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafae0d8-3d64-4628-abe6-15da3b226f20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:41.381828 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:41.557468 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafae0d8-3d64-4628-abe6-15da3b226f20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:41.557468 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafae0d8-3d64-4628-abe6-15da3b226f20 service cinder] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:41.573947 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 662/1328] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:10:41 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:10:42.053758 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499b32e-8c21-48f0-a6ff-551e9e89cb86 service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:42.067209 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499b32e-8c21-48f0-a6ff-551e9e89cb86 service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:42.086613 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a2966-ba51-4595-adce-e3122a04203c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:42.093110 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a2966-ba51-4595-adce-e3122a04203c service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:42.093110 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a2966-ba51-4595-adce-e3122a04203c service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:42.093110 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a2966-ba51-4595-adce-e3122a04203c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:42.110605 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a2966-ba51-4595-adce-e3122a04203c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:42.118161 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a2966-ba51-4595-adce-e3122a04203c service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:42.144320 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 667/1329] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:10:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:10:42.330837 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafae0d8-3d64-4628-abe6-15da3b226f20 service cinder] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:42.343002 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafae0d8-3d64-4628-abe6-15da3b226f20 service cinder] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:42.352142 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e65ee-2791-4204-9cd6-4a36f4505268 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:42.352785 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e65ee-2791-4204-9cd6-4a36f4505268 service cinder] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:42.353072 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e65ee-2791-4204-9cd6-4a36f4505268 service cinder] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:42.353348 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e65ee-2791-4204-9cd6-4a36f4505268 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:42.471284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:42.572035 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e65ee-2791-4204-9cd6-4a36f4505268 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:42.573696 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e65ee-2791-4204-9cd6-4a36f4505268 service cinder] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:42.615227 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 663/1330] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:10:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:10:42.712673 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b8b58-04ab-4b90-b50d-7f008928eef9 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:42.713246 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b8b58-04ab-4b90-b50d-7f008928eef9 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:42.713622 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b8b58-04ab-4b90-b50d-7f008928eef9 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:42.715374 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 668/1331] 10.222.0.45 () {54 vars in 961 bytes} [Wed Oct 26 11:10:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 11:10:42.736522 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe4a84-c3ef-4be3-976f-f5d6f0206378 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:42.737675 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe4a84-c3ef-4be3-976f-f5d6f0206378 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:42.738053 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe4a84-c3ef-4be3-976f-f5d6f0206378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:42.802614 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-58fe4a84-c3ef-4be3-976f-f5d6f0206378 None None] MFA Rules not processed for user `a852a777cb6a4863bebdb949cc71ea65`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:42.804797 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b8b58-04ab-4b90-b50d-7f008928eef9 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:42.814803 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-58fe4a84-c3ef-4be3-976f-f5d6f0206378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:42.823793 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b8b58-04ab-4b90-b50d-7f008928eef9 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:42.832718 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08a2cf-fb6c-460a-9a46-cbe174748e14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:42.833483 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08a2cf-fb6c-460a-9a46-cbe174748e14 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:42.833883 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08a2cf-fb6c-460a-9a46-cbe174748e14 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:42.834255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08a2cf-fb6c-460a-9a46-cbe174748e14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:43.013452 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08a2cf-fb6c-460a-9a46-cbe174748e14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:43.015579 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08a2cf-fb6c-460a-9a46-cbe174748e14 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:43.028901 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 664/1332] 10.222.0.45 () {58 vars in 1058 bytes} [Wed Oct 26 11:10:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:43.030485 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 669/1333] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:10:42 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:10:43.037367 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df6a76-9eae-4d43-be94-6b6412c4657b None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:43.037563 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df6a76-9eae-4d43-be94-6b6412c4657b None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:43.038134 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df6a76-9eae-4d43-be94-6b6412c4657b None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:43.049469 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 665/1334] 10.222.0.45 () {54 vars in 912 bytes} [Wed Oct 26 11:10:43 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:10:43.050561 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730d9c0-2637-4cfe-af53-76e4a03d041e None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:43.051071 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730d9c0-2637-4cfe-af53-76e4a03d041e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:43.053013 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730d9c0-2637-4cfe-af53-76e4a03d041e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:43.102908 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:43.111836 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-7730d9c0-2637-4cfe-af53-76e4a03d041e None None] MFA Rules not processed for user `a852a777cb6a4863bebdb949cc71ea65`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:43.114631 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7730d9c0-2637-4cfe-af53-76e4a03d041e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:43.154362 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 670/1335] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Oct 26 11:10:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:43.206530 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:43.277494 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df6a76-9eae-4d43-be94-6b6412c4657b None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:43.301303 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df6a76-9eae-4d43-be94-6b6412c4657b None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:43.326319 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dbc554-aec8-49af-893b-f1d01547e51b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:43.330545 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbc554-aec8-49af-893b-f1d01547e51b service cinder] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:43.331056 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbc554-aec8-49af-893b-f1d01547e51b service cinder] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:43.332024 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbc554-aec8-49af-893b-f1d01547e51b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:43.498232 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dbc554-aec8-49af-893b-f1d01547e51b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:43.499701 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dbc554-aec8-49af-893b-f1d01547e51b service cinder] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:43.512959 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 666/1336] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:10:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:10:43.880365 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730d9c0-2637-4cfe-af53-76e4a03d041e None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:43.900691 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730d9c0-2637-4cfe-af53-76e4a03d041e None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:43.931263 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941ca19-c97d-451a-8cc7-94cc3b6f2757 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:43.935139 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941ca19-c97d-451a-8cc7-94cc3b6f2757 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:43.936420 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941ca19-c97d-451a-8cc7-94cc3b6f2757 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:43.940245 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941ca19-c97d-451a-8cc7-94cc3b6f2757 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:43.986944 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9941ca19-c97d-451a-8cc7-94cc3b6f2757 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:43.990819 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9941ca19-c97d-451a-8cc7-94cc3b6f2757 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:44.022496 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 671/1337] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:10:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:10:44.442570 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42886ba9-b11f-4b10-b539-a2c4bbc30aaa None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:44.443090 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42886ba9-b11f-4b10-b539-a2c4bbc30aaa None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:44.443199 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42886ba9-b11f-4b10-b539-a2c4bbc30aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:44.506629 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-42886ba9-b11f-4b10-b539-a2c4bbc30aaa None None] MFA Rules not processed for user `82b945fd48524bbc8604d388472dcdc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:44.508574 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-42886ba9-b11f-4b10-b539-a2c4bbc30aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:44.636103 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 667/1338] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:10:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:44.646544 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d1de4-4c0b-4068-aae0-2e4d817e7f0e None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:44.646998 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d1de4-4c0b-4068-aae0-2e4d817e7f0e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:44.647096 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d1de4-4c0b-4068-aae0-2e4d817e7f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:44.737324 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-960d1de4-4c0b-4068-aae0-2e4d817e7f0e None None] MFA Rules not processed for user `82b945fd48524bbc8604d388472dcdc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:44.738683 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-960d1de4-4c0b-4068-aae0-2e4d817e7f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:44.749547 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 672/1339] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:10:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:44.762430 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42886ba9-b11f-4b10-b539-a2c4bbc30aaa None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:44.824475 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42886ba9-b11f-4b10-b539-a2c4bbc30aaa None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:44.834168 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02988b6d-9d2f-43c1-ad82-16927b7a0f5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:44.834818 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02988b6d-9d2f-43c1-ad82-16927b7a0f5a service nova] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:44.835103 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02988b6d-9d2f-43c1-ad82-16927b7a0f5a service nova] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:44.835387 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02988b6d-9d2f-43c1-ad82-16927b7a0f5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:44.854330 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02988b6d-9d2f-43c1-ad82-16927b7a0f5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:44.858918 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02988b6d-9d2f-43c1-ad82-16927b7a0f5a service nova] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:44.887419 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 668/1340] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:10:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:10:45.410669 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:45.831087 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebf3ab-f23f-4098-bc0c-dcb2148cd7ce None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:45.835682 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebf3ab-f23f-4098-bc0c-dcb2148cd7ce None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:45.836306 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebf3ab-f23f-4098-bc0c-dcb2148cd7ce None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:45.840338 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 673/1341] 10.222.0.45 () {54 vars in 912 bytes} [Wed Oct 26 11:10:45 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:10:45.850134 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c2910-56ae-48f9-8fd2-39b090d6d29a None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:45.850711 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c2910-56ae-48f9-8fd2-39b090d6d29a None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:45.851833 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c2910-56ae-48f9-8fd2-39b090d6d29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:45.928386 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-a27c2910-56ae-48f9-8fd2-39b090d6d29a None None] MFA Rules not processed for user `522b4232cb4d430988d76a1cdb281e72`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:45.941355 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-a27c2910-56ae-48f9-8fd2-39b090d6d29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:46.112957 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 669/1342] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Oct 26 11:10:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:46.131578 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cebf3ab-f23f-4098-bc0c-dcb2148cd7ce None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:46.134045 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8cebf3ab-f23f-4098-bc0c-dcb2148cd7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:46.170182 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cebf3ab-f23f-4098-bc0c-dcb2148cd7ce None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:46.200684 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe923d-0eef-45a5-9a5d-421bdee5c639 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:46.207641 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c2910-56ae-48f9-8fd2-39b090d6d29a None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:46.209085 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe923d-0eef-45a5-9a5d-421bdee5c639 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:46.211735 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe923d-0eef-45a5-9a5d-421bdee5c639 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:46.212311 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe923d-0eef-45a5-9a5d-421bdee5c639 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:46.234236 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe923d-0eef-45a5-9a5d-421bdee5c639 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:46.240211 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe923d-0eef-45a5-9a5d-421bdee5c639 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:46.262566 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 674/1343] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:10:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:10:46.375019 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c2910-56ae-48f9-8fd2-39b090d6d29a None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:46.393867 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a6771c-1745-4b5c-ac35-d09151dd709e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:46.394729 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6771c-1745-4b5c-ac35-d09151dd709e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:46.395015 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6771c-1745-4b5c-ac35-d09151dd709e admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:46.395285 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6771c-1745-4b5c-ac35-d09151dd709e admin admin] PATH_INFO: `/v3/users/cd22c5f91c4b439eae11a8d7748516bc` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:46.411453 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a6771c-1745-4b5c-ac35-d09151dd709e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd22c5f91c4b439eae11a8d7748516bc)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:46.411453 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a6771c-1745-4b5c-ac35-d09151dd709e admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:46.698336 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe923d-0eef-45a5-9a5d-421bdee5c639 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:46.720341 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe923d-0eef-45a5-9a5d-421bdee5c639 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:46.734587 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d9ab2-9cde-41af-9bb9-e75b2a1a9ba4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:46.734840 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-f9a6771c-1745-4b5c-ac35-d09151dd709e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd22c5f91c4b439eae11a8d7748516bc'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:10:46.735711 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d9ab2-9cde-41af-9bb9-e75b2a1a9ba4 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:46.736216 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d9ab2-9cde-41af-9bb9-e75b2a1a9ba4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:46.736745 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d9ab2-9cde-41af-9bb9-e75b2a1a9ba4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:46.755165 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:46.839975 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-f9a6771c-1745-4b5c-ac35-d09151dd709e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd22c5f91c4b439eae11a8d7748516bc'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:10:46.863640 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-f9a6771c-1745-4b5c-ac35-d09151dd709e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd22c5f91c4b439eae11a8d7748516bc'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:10:46.864691 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-f9a6771c-1745-4b5c-ac35-d09151dd709e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd22c5f91c4b439eae11a8d7748516bc'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:10:46.875975 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-f9a6771c-1745-4b5c-ac35-d09151dd709e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd22c5f91c4b439eae11a8d7748516bc'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:10:46.887947 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d9ab2-9cde-41af-9bb9-e75b2a1a9ba4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:46.890613 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d9ab2-9cde-41af-9bb9-e75b2a1a9ba4 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:46.895009 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 670/1344] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:10:46 2022] DELETE /identity/v3/users/cd22c5f91c4b439eae11a8d7748516bc => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:10:46.899335 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b441b53-5cc4-4bfd-bd39-897480894ee8 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:46.899885 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b441b53-5cc4-4bfd-bd39-897480894ee8 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:46.900340 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b441b53-5cc4-4bfd-bd39-897480894ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:46.924088 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 675/1345] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:10:46 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:10:47.012938 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-5b441b53-5cc4-4bfd-bd39-897480894ee8 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:47.014420 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-5b441b53-5cc4-4bfd-bd39-897480894ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:47.214280 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 671/1346] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:10:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:10:47.246984 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d9ab2-9cde-41af-9bb9-e75b2a1a9ba4 service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:47.259860 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d9ab2-9cde-41af-9bb9-e75b2a1a9ba4 service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:47.492851 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03897d2-bda3-41e5-ad05-d57393a8e92d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:47.493755 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03897d2-bda3-41e5-ad05-d57393a8e92d service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:47.494979 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03897d2-bda3-41e5-ad05-d57393a8e92d service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:47.495299 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03897d2-bda3-41e5-ad05-d57393a8e92d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:47.539112 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03897d2-bda3-41e5-ad05-d57393a8e92d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:47.544890 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03897d2-bda3-41e5-ad05-d57393a8e92d service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:47.591318 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 676/1347] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:10:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:10:47.614089 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b441b53-5cc4-4bfd-bd39-897480894ee8 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:47.615706 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-5b441b53-5cc4-4bfd-bd39-897480894ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:47.822259 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b441b53-5cc4-4bfd-bd39-897480894ee8 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:47.831761 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e550a7d-ef43-45fb-8bfe-1c36b659a0e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4f9a2bba0e748b6a98fa7dea2482ddf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:47.832685 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e550a7d-ef43-45fb-8bfe-1c36b659a0e6 service placement] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:47.832987 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e550a7d-ef43-45fb-8bfe-1c36b659a0e6 service placement] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:47.833434 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e550a7d-ef43-45fb-8bfe-1c36b659a0e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:47.835606 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-2e550a7d-ef43-45fb-8bfe-1c36b659a0e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:47.849435 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e550a7d-ef43-45fb-8bfe-1c36b659a0e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:47.851325 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e550a7d-ef43-45fb-8bfe-1c36b659a0e6 service placement] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:47.864277 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 672/1348] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:10:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:10:47.897764 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:48.891350 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03897d2-bda3-41e5-ad05-d57393a8e92d service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:48.891350 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c03897d2-bda3-41e5-ad05-d57393a8e92d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:48.909390 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03897d2-bda3-41e5-ad05-d57393a8e92d service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:48.915140 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15daf233-ed0a-40bc-8e4a-73b31483adc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:48.915787 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15daf233-ed0a-40bc-8e4a-73b31483adc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:48.916085 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15daf233-ed0a-40bc-8e4a-73b31483adc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:48.916371 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15daf233-ed0a-40bc-8e4a-73b31483adc1 admin admin] PATH_INFO: `/v3/projects/ef96b16ea7fc476f827e1a44cff24577` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:48.917665 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15daf233-ed0a-40bc-8e4a-73b31483adc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef96b16ea7fc476f827e1a44cff24577)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:48.920719 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15daf233-ed0a-40bc-8e4a-73b31483adc1 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:49.068463 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:49.314916 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-15daf233-ed0a-40bc-8e4a-73b31483adc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef96b16ea7fc476f827e1a44cff24577', 'request_id': 'req-15daf233-ed0a-40bc-8e4a-73b31483adc1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:10:49.352925 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-15daf233-ed0a-40bc-8e4a-73b31483adc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef96b16ea7fc476f827e1a44cff24577', 'request_id': 'req-15daf233-ed0a-40bc-8e4a-73b31483adc1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:10:49.502812 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-15daf233-ed0a-40bc-8e4a-73b31483adc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef96b16ea7fc476f827e1a44cff24577', 'request_id': 'req-15daf233-ed0a-40bc-8e4a-73b31483adc1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:10:49.549066 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-15daf233-ed0a-40bc-8e4a-73b31483adc1 admin admin] The token cache is being invalidate because project ef96b16ea7fc476f827e1a44cff24577 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:10:49.551153 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-15daf233-ed0a-40bc-8e4a-73b31483adc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:10:49.558527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-15daf233-ed0a-40bc-8e4a-73b31483adc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:10:49.564286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 677/1349] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:10:48 2022] DELETE /identity/v3/projects/ef96b16ea7fc476f827e1a44cff24577 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:10:49.574935 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f26ce-642c-4d10-9a4f-4de7ddb19668 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:49.575513 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f26ce-642c-4d10-9a4f-4de7ddb19668 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:49.575513 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f26ce-642c-4d10-9a4f-4de7ddb19668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:49.663402 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-166f26ce-642c-4d10-9a4f-4de7ddb19668 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:49.665369 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-166f26ce-642c-4d10-9a4f-4de7ddb19668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:49.840097 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 673/1350] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:10:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:49.851894 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384aed7-582e-436f-8b2a-dc7410add2d5 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:49.851894 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384aed7-582e-436f-8b2a-dc7410add2d5 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:49.851894 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384aed7-582e-436f-8b2a-dc7410add2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:49.911862 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-2384aed7-582e-436f-8b2a-dc7410add2d5 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:49.925691 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2384aed7-582e-436f-8b2a-dc7410add2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:49.952015 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 678/1351] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:10:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:49.956523 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f26ce-642c-4d10-9a4f-4de7ddb19668 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:49.977152 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f26ce-642c-4d10-9a4f-4de7ddb19668 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:49.988815 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ec061-40bb-4d9b-8518-1f734920f493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:49.989727 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ec061-40bb-4d9b-8518-1f734920f493 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:49.990283 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ec061-40bb-4d9b-8518-1f734920f493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:49.990726 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ec061-40bb-4d9b-8518-1f734920f493 admin admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:49.991746 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ec061-40bb-4d9b-8518-1f734920f493 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:10:49.992623 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ec061-40bb-4d9b-8518-1f734920f493 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:49.996816 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ec061-40bb-4d9b-8518-1f734920f493 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:50.010029 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce5613-4e4b-4214-a932-130affed4c6d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:50.010279 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce5613-4e4b-4214-a932-130affed4c6d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:50.010546 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce5613-4e4b-4214-a932-130affed4c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:50.026919 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 674/1352] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:10:50.028332 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ec061-40bb-4d9b-8518-1f734920f493 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:50.062929 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ec061-40bb-4d9b-8518-1f734920f493 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:50.094004 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6eccb-1c93-422a-a312-42c8881dfda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:50.094949 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6eccb-1c93-422a-a312-42c8881dfda9 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:50.095382 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6eccb-1c93-422a-a312-42c8881dfda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:50.095661 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6eccb-1c93-422a-a312-42c8881dfda9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:50.096426 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c6eccb-1c93-422a-a312-42c8881dfda9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:50.104091 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c6eccb-1c93-422a-a312-42c8881dfda9 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:50.110526 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-f9ce5613-4e4b-4214-a932-130affed4c6d None None] MFA Rules not processed for user `bfef80e955344073a2a35c569e199f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:50.112029 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f9ce5613-4e4b-4214-a932-130affed4c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:50.296760 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 679/1353] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:10:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:50.304891 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8995a8-866e-4841-b8d5-24c5b0f59561 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:50.305185 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8995a8-866e-4841-b8d5-24c5b0f59561 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:50.305468 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8995a8-866e-4841-b8d5-24c5b0f59561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:50.319212 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 675/1354] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:10:50 2022] POST /identity/v3/projects => generated 405 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:10:50.325021 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6eccb-1c93-422a-a312-42c8881dfda9 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:50.340768 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-ad8995a8-866e-4841-b8d5-24c5b0f59561 None None] MFA Rules not processed for user `bfef80e955344073a2a35c569e199f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:50.342252 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ad8995a8-866e-4841-b8d5-24c5b0f59561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:50.448791 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 680/1355] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:10:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:10:50.450950 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a54735-b5f6-46b4-b55e-02b7ad763997 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:50.451386 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a54735-b5f6-46b4-b55e-02b7ad763997 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:50.452180 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a54735-b5f6-46b4-b55e-02b7ad763997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:50.492041 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6eccb-1c93-422a-a312-42c8881dfda9 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:50.499104 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-34a54735-b5f6-46b4-b55e-02b7ad763997 None None] MFA Rules not processed for user `1519c41b8f9e4724b520bab8f741b783`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:50.500597 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-34a54735-b5f6-46b4-b55e-02b7ad763997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:50.504586 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3b159-11b2-407f-9eab-b75c8cbe7d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:50.505328 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3b159-11b2-407f-9eab-b75c8cbe7d83 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:50.505625 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3b159-11b2-407f-9eab-b75c8cbe7d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:50.506658 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3b159-11b2-407f-9eab-b75c8cbe7d83 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:50.510807 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc3b159-11b2-407f-9eab-b75c8cbe7d83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:50.514968 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc3b159-11b2-407f-9eab-b75c8cbe7d83 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:50.546291 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:50.623866 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 681/1356] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:10:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:50.626314 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a54735-b5f6-46b4-b55e-02b7ad763997 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:50.627383 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-34a54735-b5f6-46b4-b55e-02b7ad763997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:50.682570 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 676/1357] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:10:50 2022] POST /identity/v3/users => generated 303 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:10:50.686286 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3b159-11b2-407f-9eab-b75c8cbe7d83 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:50.688821 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-5cc3b159-11b2-407f-9eab-b75c8cbe7d83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:50.803970 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a54735-b5f6-46b4-b55e-02b7ad763997 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:50.808243 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3b159-11b2-407f-9eab-b75c8cbe7d83 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:50.809666 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d1b85-0b9e-485c-898b-3440261b598b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:50.811952 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d1b85-0b9e-485c-898b-3440261b598b service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:50.812379 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d1b85-0b9e-485c-898b-3440261b598b service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:50.812711 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d1b85-0b9e-485c-898b-3440261b598b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:50.820220 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552709af-f7bc-44d9-b54a-292919f8fe0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:50.820220 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552709af-f7bc-44d9-b54a-292919f8fe0a service nova] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:50.820220 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552709af-f7bc-44d9-b54a-292919f8fe0a service nova] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:50.820517 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552709af-f7bc-44d9-b54a-292919f8fe0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:50.823149 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d1b85-0b9e-485c-898b-3440261b598b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:50.825148 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d1b85-0b9e-485c-898b-3440261b598b service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:50.829961 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552709af-f7bc-44d9-b54a-292919f8fe0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:50.831664 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552709af-f7bc-44d9-b54a-292919f8fe0a service nova] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:50.844013 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 677/1358] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:10:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:10:50.844967 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552709af-f7bc-44d9-b54a-292919f8fe0a service nova] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:50.847561 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 682/1359] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:10:50 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:10:50.859481 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552709af-f7bc-44d9-b54a-292919f8fe0a service nova] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:50.864559 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b3db0-13dc-4152-a955-9942174d78bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:50.865181 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b3db0-13dc-4152-a955-9942174d78bf admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:50.865464 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b3db0-13dc-4152-a955-9942174d78bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:50.865815 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b3db0-13dc-4152-a955-9942174d78bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:50.866377 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b3db0-13dc-4152-a955-9942174d78bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:50.868956 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b3db0-13dc-4152-a955-9942174d78bf admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:50.882593 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 678/1360] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:10:50.888785 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d1b85-0b9e-485c-898b-3440261b598b service nova] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:50.919758 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d1b85-0b9e-485c-898b-3440261b598b service nova] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:50.932409 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4196c479-7119-45e6-8856-b45a85fd561d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:50.933255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196c479-7119-45e6-8856-b45a85fd561d admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:50.933635 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196c479-7119-45e6-8856-b45a85fd561d admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:50.934087 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196c479-7119-45e6-8856-b45a85fd561d admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:50.934828 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4196c479-7119-45e6-8856-b45a85fd561d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:50.938174 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4196c479-7119-45e6-8856-b45a85fd561d admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:50.968359 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 683/1361] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:10:50.969274 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b3db0-13dc-4152-a955-9942174d78bf admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:50.990061 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b3db0-13dc-4152-a955-9942174d78bf admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:51.008781 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08edb5f-1b95-4b82-885d-61d163d25504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:51.010398 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08edb5f-1b95-4b82-885d-61d163d25504 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:51.010705 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08edb5f-1b95-4b82-885d-61d163d25504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:51.010984 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08edb5f-1b95-4b82-885d-61d163d25504 admin admin] PATH_INFO: `/v3/projects/e10f985bfc874d599d8414c4c0ba2541/users/28b40fbb44904030bd7994f4a950343f/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:51.060512 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08edb5f-1b95-4b82-885d-61d163d25504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e10f985bfc874d599d8414c4c0ba2541, user_id=28b40fbb44904030bd7994f4a950343f, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:51.067150 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08edb5f-1b95-4b82-885d-61d163d25504 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:51.196337 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 679/1362] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:10:50 2022] PUT /identity/v3/projects/e10f985bfc874d599d8414c4c0ba2541/users/28b40fbb44904030bd7994f4a950343f/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:10:51.203599 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749b965-a3fb-4e30-b273-d8d3849800b1 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:51.204558 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749b965-a3fb-4e30-b273-d8d3849800b1 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:51.205078 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749b965-a3fb-4e30-b273-d8d3849800b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:51.251880 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-3749b965-a3fb-4e30-b273-d8d3849800b1 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:51.253808 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3749b965-a3fb-4e30-b273-d8d3849800b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:51.408999 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 684/1363] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:10:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:51.700015 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08edb5f-1b95-4b82-885d-61d163d25504 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:51.700015 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-b08edb5f-1b95-4b82-885d-61d163d25504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:51.700015 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08edb5f-1b95-4b82-885d-61d163d25504 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:51.702571 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d719db5-4cb5-4921-a8cd-8e743cedc3ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:51.702571 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d719db5-4cb5-4921-a8cd-8e743cedc3ee service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:51.702571 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d719db5-4cb5-4921-a8cd-8e743cedc3ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:51.702571 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d719db5-4cb5-4921-a8cd-8e743cedc3ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:51.703234 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d719db5-4cb5-4921-a8cd-8e743cedc3ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:51.703234 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d719db5-4cb5-4921-a8cd-8e743cedc3ee service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:51.703234 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 680/1364] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:10:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:10:51.841767 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:52.313121 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60bee3-3761-4326-ba14-b204ecc1cbef None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:52.314304 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60bee3-3761-4326-ba14-b204ecc1cbef None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:52.314789 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60bee3-3761-4326-ba14-b204ecc1cbef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:52.348692 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-5e60bee3-3761-4326-ba14-b204ecc1cbef None None] MFA Rules not processed for user `bfef80e955344073a2a35c569e199f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:52.350218 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5e60bee3-3761-4326-ba14-b204ecc1cbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:52.461895 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 685/1365] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:10:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:53.846514 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59744c71-8429-4f81-9420-3710ede44943 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:53.846514 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59744c71-8429-4f81-9420-3710ede44943 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:53.848694 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59744c71-8429-4f81-9420-3710ede44943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:53.920861 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:54.055533 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-59744c71-8429-4f81-9420-3710ede44943 None None] MFA Rules not processed for user `3c90765757a34c6291c9980a7d5d5c79`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:54.057066 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-59744c71-8429-4f81-9420-3710ede44943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:54.183793 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:54.228746 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 681/1366] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Oct 26 11:10:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:10:54.927303 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60bee3-3761-4326-ba14-b204ecc1cbef None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:54.928968 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5e60bee3-3761-4326-ba14-b204ecc1cbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:55.152007 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60bee3-3761-4326-ba14-b204ecc1cbef None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:55.158727 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777cd85e-25a5-4280-9a73-8525f84d877d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21b84cc38a848de8d19a41e1eb04a58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:55.159660 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cd85e-25a5-4280-9a73-8525f84d877d service swift] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:55.163108 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cd85e-25a5-4280-9a73-8525f84d877d service swift] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:55.163108 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cd85e-25a5-4280-9a73-8525f84d877d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:55.184587 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777cd85e-25a5-4280-9a73-8525f84d877d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:55.188328 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777cd85e-25a5-4280-9a73-8525f84d877d service swift] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:55.202956 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 686/1367] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Oct 26 11:10:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 26 11:10:55.299433 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d33ad-e83d-4ded-8180-93764e8d83d1 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:55.301559 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d33ad-e83d-4ded-8180-93764e8d83d1 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:55.302256 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d33ad-e83d-4ded-8180-93764e8d83d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:55.400778 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-de0d33ad-e83d-4ded-8180-93764e8d83d1 None None] MFA Rules not processed for user `28b40fbb44904030bd7994f4a950343f`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:55.402554 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-de0d33ad-e83d-4ded-8180-93764e8d83d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:55.692620 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777cd85e-25a5-4280-9a73-8525f84d877d service swift] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:55.694990 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 682/1368] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:10:55 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:55.722127 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777cd85e-25a5-4280-9a73-8525f84d877d service swift] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:55.739047 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81375f-4dc8-48ee-abb2-b30cd76e915c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:55.740034 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81375f-4dc8-48ee-abb2-b30cd76e915c admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:55.740691 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81375f-4dc8-48ee-abb2-b30cd76e915c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:55.741128 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81375f-4dc8-48ee-abb2-b30cd76e915c admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:55.745134 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81375f-4dc8-48ee-abb2-b30cd76e915c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:55.745134 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81375f-4dc8-48ee-abb2-b30cd76e915c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:55.883629 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 687/1369] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:10:55 2022] POST /identity/v3/projects => generated 403 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:10:55.892965 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d33ad-e83d-4ded-8180-93764e8d83d1 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:55.920587 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d33ad-e83d-4ded-8180-93764e8d83d1 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:56.071406 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36570e59-d3c1-4e8d-bd97-defdbe79080c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:56.073058 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36570e59-d3c1-4e8d-bd97-defdbe79080c admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:56.074299 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36570e59-d3c1-4e8d-bd97-defdbe79080c admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:56.074766 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36570e59-d3c1-4e8d-bd97-defdbe79080c admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:56.077532 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36570e59-d3c1-4e8d-bd97-defdbe79080c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:56.081107 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36570e59-d3c1-4e8d-bd97-defdbe79080c admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:56.224186 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 683/1370] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:10:55 2022] POST /identity/v3/users => generated 308 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:10:56.225852 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81375f-4dc8-48ee-abb2-b30cd76e915c admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:56.242576 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81375f-4dc8-48ee-abb2-b30cd76e915c admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:56.257477 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3f97c-79dc-4eb1-8b78-d08f7ce18169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:56.258586 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3f97c-79dc-4eb1-8b78-d08f7ce18169 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:56.259084 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3f97c-79dc-4eb1-8b78-d08f7ce18169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:56.259641 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3f97c-79dc-4eb1-8b78-d08f7ce18169 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:56.260459 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3f97c-79dc-4eb1-8b78-d08f7ce18169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:56.262413 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3f97c-79dc-4eb1-8b78-d08f7ce18169 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:56.291082 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 688/1371] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:10:56.295597 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36570e59-d3c1-4e8d-bd97-defdbe79080c admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:56.309771 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36570e59-d3c1-4e8d-bd97-defdbe79080c admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:56.330996 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc47f0-38da-496f-a889-5e1331360b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:56.331665 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc47f0-38da-496f-a889-5e1331360b74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:56.334440 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc47f0-38da-496f-a889-5e1331360b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:56.334733 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc47f0-38da-496f-a889-5e1331360b74 admin admin] PATH_INFO: `/v3/projects/10612c7e3cee4c73964d9d666b40a979/users/a5a921d53fd04d92b533d3d2d70902c8/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:56.375541 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc47f0-38da-496f-a889-5e1331360b74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10612c7e3cee4c73964d9d666b40a979, user_id=a5a921d53fd04d92b533d3d2d70902c8, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:56.378349 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc47f0-38da-496f-a889-5e1331360b74 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:56.543834 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3f97c-79dc-4eb1-8b78-d08f7ce18169 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:56.545731 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-76a3f97c-79dc-4eb1-8b78-d08f7ce18169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:56.570781 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3f97c-79dc-4eb1-8b78-d08f7ce18169 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:56.572819 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 684/1372] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:10:56 2022] PUT /identity/v3/projects/10612c7e3cee4c73964d9d666b40a979/users/a5a921d53fd04d92b533d3d2d70902c8/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:10:56.579637 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc47f0-38da-496f-a889-5e1331360b74 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:56.948309 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c452fb-f3b1-40c6-b7d0-534dbe11d0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:56.948309 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c452fb-f3b1-40c6-b7d0-534dbe11d0ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:56.948309 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c452fb-f3b1-40c6-b7d0-534dbe11d0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:56.948309 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c452fb-f3b1-40c6-b7d0-534dbe11d0ee admin admin] PATH_INFO: `/v3/users/39bb671cf2cc4a388e6d8aa08f07371e` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:56.949720 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c452fb-f3b1-40c6-b7d0-534dbe11d0ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=39bb671cf2cc4a388e6d8aa08f07371e)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:56.949720 dv-cinder-862679-1-smb devstack@keystone.service[81623]: WARNING py.warnings [None req-90c452fb-f3b1-40c6-b7d0-534dbe11d0ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 26 11:10:56.949720 dv-cinder-862679-1-smb devstack@keystone.service[81623]: warnings.warn(msg) Oct 26 11:10:56.949720 dv-cinder-862679-1-smb devstack@keystone.service[81623]: Oct 26 11:10:56.949720 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c452fb-f3b1-40c6-b7d0-534dbe11d0ee admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:56.950497 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc47f0-38da-496f-a889-5e1331360b74 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:56.950497 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39346eef-a88d-4fa1-a02e-30f274eaf83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:56.950497 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39346eef-a88d-4fa1-a02e-30f274eaf83f admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:56.950497 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39346eef-a88d-4fa1-a02e-30f274eaf83f admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:56.950849 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39346eef-a88d-4fa1-a02e-30f274eaf83f admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:56.950849 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39346eef-a88d-4fa1-a02e-30f274eaf83f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:56.950849 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39346eef-a88d-4fa1-a02e-30f274eaf83f admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:56.950849 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 685/1373] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:10:56.950849 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687c20a-d653-4c16-b419-745883c6ce67 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:56.950849 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687c20a-d653-4c16-b419-745883c6ce67 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:56.951189 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687c20a-d653-4c16-b419-745883c6ce67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:56.977011 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-9687c20a-d653-4c16-b419-745883c6ce67 None None] MFA Rules not processed for user `522b4232cb4d430988d76a1cdb281e72`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:56.982737 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-9687c20a-d653-4c16-b419-745883c6ce67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:57.119884 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 686/1374] 10.222.0.46 () {58 vars in 1015 bytes} [Wed Oct 26 11:10:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:57.120828 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687c20a-d653-4c16-b419-745883c6ce67 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:57.177661 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687c20a-d653-4c16-b419-745883c6ce67 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:57.186682 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a67a3-2a67-486a-8fad-456c424e8723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:57.190808 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a67a3-2a67-486a-8fad-456c424e8723 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:57.191544 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a67a3-2a67-486a-8fad-456c424e8723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:57.191892 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a67a3-2a67-486a-8fad-456c424e8723 admin admin] PATH_INFO: `/v3/projects/10612c7e3cee4c73964d9d666b40a979/users/a5a921d53fd04d92b533d3d2d70902c8/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:57.201803 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a67a3-2a67-486a-8fad-456c424e8723 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10612c7e3cee4c73964d9d666b40a979, user_id=a5a921d53fd04d92b533d3d2d70902c8, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:57.205784 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a67a3-2a67-486a-8fad-456c424e8723 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:57.249942 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 687/1375] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:10:57 2022] PUT /identity/v3/projects/10612c7e3cee4c73964d9d666b40a979/users/a5a921d53fd04d92b533d3d2d70902c8/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:10:57.250885 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a67a3-2a67-486a-8fad-456c424e8723 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:57.307886 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:57.382395 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a67a3-2a67-486a-8fad-456c424e8723 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:57.388488 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474be8da-ddda-4eeb-845e-f4d46e375def service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:57.395372 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474be8da-ddda-4eeb-845e-f4d46e375def service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:57.395984 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474be8da-ddda-4eeb-845e-f4d46e375def service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:57.396346 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474be8da-ddda-4eeb-845e-f4d46e375def service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:57.426811 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474be8da-ddda-4eeb-845e-f4d46e375def service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:57.431690 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474be8da-ddda-4eeb-845e-f4d46e375def service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:57.469075 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 688/1376] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:10:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:10:57.570643 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-90c452fb-f3b1-40c6-b7d0-534dbe11d0ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39bb671cf2cc4a388e6d8aa08f07371e'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:10:57.624330 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:57.693207 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-90c452fb-f3b1-40c6-b7d0-534dbe11d0ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39bb671cf2cc4a388e6d8aa08f07371e'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:10:57.780421 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-90c452fb-f3b1-40c6-b7d0-534dbe11d0ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39bb671cf2cc4a388e6d8aa08f07371e'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:10:57.810893 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-90c452fb-f3b1-40c6-b7d0-534dbe11d0ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39bb671cf2cc4a388e6d8aa08f07371e'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:10:57.815127 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-90c452fb-f3b1-40c6-b7d0-534dbe11d0ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39bb671cf2cc4a388e6d8aa08f07371e'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:10:57.827914 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 689/1377] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:10:56 2022] DELETE /identity/v3/users/39bb671cf2cc4a388e6d8aa08f07371e => generated 0 bytes in 1285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:10:57.835522 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f35d7c-e48b-41cd-9bcf-f5aa789dff9e None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:57.835811 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f35d7c-e48b-41cd-9bcf-f5aa789dff9e None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:57.836106 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f35d7c-e48b-41cd-9bcf-f5aa789dff9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:57.897722 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-03f35d7c-e48b-41cd-9bcf-f5aa789dff9e None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:57.899150 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-03f35d7c-e48b-41cd-9bcf-f5aa789dff9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:58.219966 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 689/1378] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:10:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:58.280561 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c452fb-f3b1-40c6-b7d0-534dbe11d0ee admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:58.283238 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-90c452fb-f3b1-40c6-b7d0-534dbe11d0ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:58.529030 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c452fb-f3b1-40c6-b7d0-534dbe11d0ee admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:58.548383 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc42d2-4605-4968-b068-f4f555212ede service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:58.549176 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc42d2-4605-4968-b068-f4f555212ede service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:58.549619 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc42d2-4605-4968-b068-f4f555212ede service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:58.550105 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc42d2-4605-4968-b068-f4f555212ede service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:58.597788 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc42d2-4605-4968-b068-f4f555212ede service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:58.599600 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc42d2-4605-4968-b068-f4f555212ede service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:58.662030 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 690/1379] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:10:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:10:59.908691 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929409a4-2174-4151-9eb7-f625ab42b2eb None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:59.909461 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929409a4-2174-4151-9eb7-f625ab42b2eb None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:59.910456 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929409a4-2174-4151-9eb7-f625ab42b2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:00.000274 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-929409a4-2174-4151-9eb7-f625ab42b2eb None None] MFA Rules not processed for user `1519c41b8f9e4724b520bab8f741b783`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:00.003167 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-929409a4-2174-4151-9eb7-f625ab42b2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:00.045652 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:00.110462 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc42d2-4605-4968-b068-f4f555212ede service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:00.111893 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-dddc42d2-4605-4968-b068-f4f555212ede service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:00.156335 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc42d2-4605-4968-b068-f4f555212ede service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:00.178556 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 690/1380] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:10:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:00.199537 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d01cd-6fe5-4ca4-b345-330c3be38a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:00.200617 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d01cd-6fe5-4ca4-b345-330c3be38a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:00.201103 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d01cd-6fe5-4ca4-b345-330c3be38a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:00.201731 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d01cd-6fe5-4ca4-b345-330c3be38a37 admin admin] PATH_INFO: `/v3/projects/6914d8489bd44d659dbc4a1f591b4f04` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:00.204937 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d01cd-6fe5-4ca4-b345-330c3be38a37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6914d8489bd44d659dbc4a1f591b4f04)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:00.211011 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d01cd-6fe5-4ca4-b345-330c3be38a37 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:00.505729 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-208d01cd-6fe5-4ca4-b345-330c3be38a37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6914d8489bd44d659dbc4a1f591b4f04', 'request_id': 'req-208d01cd-6fe5-4ca4-b345-330c3be38a37'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:00.531367 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-208d01cd-6fe5-4ca4-b345-330c3be38a37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6914d8489bd44d659dbc4a1f591b4f04', 'request_id': 'req-208d01cd-6fe5-4ca4-b345-330c3be38a37'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:00.703455 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-208d01cd-6fe5-4ca4-b345-330c3be38a37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6914d8489bd44d659dbc4a1f591b4f04', 'request_id': 'req-208d01cd-6fe5-4ca4-b345-330c3be38a37'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:00.722785 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-208d01cd-6fe5-4ca4-b345-330c3be38a37 admin admin] The token cache is being invalidate because project 6914d8489bd44d659dbc4a1f591b4f04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:11:00.723179 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-208d01cd-6fe5-4ca4-b345-330c3be38a37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:00.724836 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-208d01cd-6fe5-4ca4-b345-330c3be38a37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:00.744706 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 691/1381] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:11:00 2022] DELETE /identity/v3/projects/6914d8489bd44d659dbc4a1f591b4f04 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:00.745906 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929409a4-2174-4151-9eb7-f625ab42b2eb None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:00.760520 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929409a4-2174-4151-9eb7-f625ab42b2eb None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:00.993243 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc56ba-03dd-4cb9-aa15-59c0a4f5d805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:00.994013 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc56ba-03dd-4cb9-aa15-59c0a4f5d805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:00.994239 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc56ba-03dd-4cb9-aa15-59c0a4f5d805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:00.994449 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc56ba-03dd-4cb9-aa15-59c0a4f5d805 admin admin] PATH_INFO: `/v3/users/d1522b342024427c9e3cd6de01d96134` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:01.027355 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dc56ba-03dd-4cb9-aa15-59c0a4f5d805 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1522b342024427c9e3cd6de01d96134)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:01.029395 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dc56ba-03dd-4cb9-aa15-59c0a4f5d805 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:01.369197 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-15dc56ba-03dd-4cb9-aa15-59c0a4f5d805 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1522b342024427c9e3cd6de01d96134'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:01.428506 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea0c91-e1d7-4bc9-bb04-b302cd0f0dee None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:01.429076 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea0c91-e1d7-4bc9-bb04-b302cd0f0dee None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:01.429076 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea0c91-e1d7-4bc9-bb04-b302cd0f0dee None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:01.430983 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 692/1382] 10.222.0.45 () {54 vars in 921 bytes} [Wed Oct 26 11:11:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:11:01.448399 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fbac6-3824-45d9-9d00-8a782e2c1637 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:01.449158 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fbac6-3824-45d9-9d00-8a782e2c1637 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:01.449656 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fbac6-3824-45d9-9d00-8a782e2c1637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:01.486741 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-1b7fbac6-3824-45d9-9d00-8a782e2c1637 None None] MFA Rules not processed for user `a852a777cb6a4863bebdb949cc71ea65`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:01.488892 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1b7fbac6-3824-45d9-9d00-8a782e2c1637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:01.543815 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-15dc56ba-03dd-4cb9-aa15-59c0a4f5d805 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1522b342024427c9e3cd6de01d96134'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:01.549402 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:01.588446 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-15dc56ba-03dd-4cb9-aa15-59c0a4f5d805 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1522b342024427c9e3cd6de01d96134'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:01.592883 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-15dc56ba-03dd-4cb9-aa15-59c0a4f5d805 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1522b342024427c9e3cd6de01d96134'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:01.629591 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-15dc56ba-03dd-4cb9-aa15-59c0a4f5d805 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1522b342024427c9e3cd6de01d96134'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:01.641396 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 691/1383] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:11:00 2022] DELETE /identity/v3/users/d1522b342024427c9e3cd6de01d96134 => generated 0 bytes in 896 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:01.743240 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 693/1384] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Oct 26 11:11:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:11:01.969383 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc56ba-03dd-4cb9-aa15-59c0a4f5d805 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:01.971339 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-15dc56ba-03dd-4cb9-aa15-59c0a4f5d805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:02.142662 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:02.165409 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa769623-d98d-4e4a-bd88-49d5be492738 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:02.165703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa769623-d98d-4e4a-bd88-49d5be492738 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:02.166011 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa769623-d98d-4e4a-bd88-49d5be492738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:02.218617 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc56ba-03dd-4cb9-aa15-59c0a4f5d805 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:02.238387 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbcba03-9963-4db3-a5e5-5321c47a78ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:02.240765 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcba03-9963-4db3-a5e5-5321c47a78ab service nova] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:02.243379 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcba03-9963-4db3-a5e5-5321c47a78ab service nova] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:02.249454 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcba03-9963-4db3-a5e5-5321c47a78ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:02.269024 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbcba03-9963-4db3-a5e5-5321c47a78ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:02.272019 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbcba03-9963-4db3-a5e5-5321c47a78ab service nova] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:02.294455 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-fa769623-d98d-4e4a-bd88-49d5be492738 None None] MFA Rules not processed for user `a5a921d53fd04d92b533d3d2d70902c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:02.295871 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-fa769623-d98d-4e4a-bd88-49d5be492738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:02.316046 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 692/1385] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:02.466328 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aaf7d9-f2a3-4734-a03c-7cc565a38a7e None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:02.466717 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aaf7d9-f2a3-4734-a03c-7cc565a38a7e None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:02.466998 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aaf7d9-f2a3-4734-a03c-7cc565a38a7e None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:02.475435 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 693/1386] 10.222.0.45 () {54 vars in 912 bytes} [Wed Oct 26 11:11:02 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:11:02.489926 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc88195-bf44-4ecb-9003-f6bfb16dda2f None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:02.490728 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc88195-bf44-4ecb-9003-f6bfb16dda2f None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:02.491053 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc88195-bf44-4ecb-9003-f6bfb16dda2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:02.503152 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 694/1387] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:02 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:11:02.551458 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-cbc88195-bf44-4ecb-9003-f6bfb16dda2f None None] MFA Rules not processed for user `522b4232cb4d430988d76a1cdb281e72`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:02.555677 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-cbc88195-bf44-4ecb-9003-f6bfb16dda2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:02.631861 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 694/1388] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Oct 26 11:11:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:02.656762 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa769623-d98d-4e4a-bd88-49d5be492738 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:02.659219 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-fa769623-d98d-4e4a-bd88-49d5be492738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:02.681765 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa769623-d98d-4e4a-bd88-49d5be492738 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:02.696040 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761ca16-7549-45d1-904e-23e716ff6337 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:02.696703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761ca16-7549-45d1-904e-23e716ff6337 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:02.696981 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761ca16-7549-45d1-904e-23e716ff6337 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:02.697422 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761ca16-7549-45d1-904e-23e716ff6337 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:02.716452 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7761ca16-7549-45d1-904e-23e716ff6337 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:02.718149 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7761ca16-7549-45d1-904e-23e716ff6337 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:02.733779 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 695/1389] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:03.578188 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc88195-bf44-4ecb-9003-f6bfb16dda2f None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:03.579968 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-cbc88195-bf44-4ecb-9003-f6bfb16dda2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:03.763763 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc88195-bf44-4ecb-9003-f6bfb16dda2f None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:03.767054 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74afc27e-a863-4498-b037-6aa1c0f3e321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:03.767979 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74afc27e-a863-4498-b037-6aa1c0f3e321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:03.768790 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74afc27e-a863-4498-b037-6aa1c0f3e321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:03.769249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74afc27e-a863-4498-b037-6aa1c0f3e321 admin admin] PATH_INFO: `/v3/projects/a7a34f496605467e86e6069140272a99` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:03.770841 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74afc27e-a863-4498-b037-6aa1c0f3e321 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7a34f496605467e86e6069140272a99)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:03.772275 dv-cinder-862679-1-smb devstack@keystone.service[81622]: WARNING py.warnings [None req-74afc27e-a863-4498-b037-6aa1c0f3e321 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 26 11:11:03.772275 dv-cinder-862679-1-smb devstack@keystone.service[81622]: warnings.warn(msg) Oct 26 11:11:03.772275 dv-cinder-862679-1-smb devstack@keystone.service[81622]: Oct 26 11:11:03.774729 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74afc27e-a863-4498-b037-6aa1c0f3e321 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:04.085225 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-74afc27e-a863-4498-b037-6aa1c0f3e321 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7a34f496605467e86e6069140272a99', 'request_id': 'req-74afc27e-a863-4498-b037-6aa1c0f3e321'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:04.183522 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-74afc27e-a863-4498-b037-6aa1c0f3e321 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7a34f496605467e86e6069140272a99', 'request_id': 'req-74afc27e-a863-4498-b037-6aa1c0f3e321'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:04.212168 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-74afc27e-a863-4498-b037-6aa1c0f3e321 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7a34f496605467e86e6069140272a99', 'request_id': 'req-74afc27e-a863-4498-b037-6aa1c0f3e321'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:04.275090 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-74afc27e-a863-4498-b037-6aa1c0f3e321 admin admin] The token cache is being invalidate because project a7a34f496605467e86e6069140272a99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:11:04.275390 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-74afc27e-a863-4498-b037-6aa1c0f3e321 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:04.276124 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-74afc27e-a863-4498-b037-6aa1c0f3e321 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:04.279515 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 695/1390] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:11:03 2022] DELETE /identity/v3/projects/a7a34f496605467e86e6069140272a99 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:04.291366 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7d637-3499-4c20-8eed-2c49db45e36e None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:04.291912 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7d637-3499-4c20-8eed-2c49db45e36e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:04.292000 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7d637-3499-4c20-8eed-2c49db45e36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:04.334628 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-42d7d637-3499-4c20-8eed-2c49db45e36e None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:04.335989 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-42d7d637-3499-4c20-8eed-2c49db45e36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:04.454412 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 696/1391] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:04.467116 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39decc-0ac8-4e7a-921e-9ad55d76adcd None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:04.467116 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39decc-0ac8-4e7a-921e-9ad55d76adcd None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:04.467116 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39decc-0ac8-4e7a-921e-9ad55d76adcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:04.537647 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-fe39decc-0ac8-4e7a-921e-9ad55d76adcd None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:04.541399 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-fe39decc-0ac8-4e7a-921e-9ad55d76adcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:04.585624 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 696/1392] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:04.591237 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7d637-3499-4c20-8eed-2c49db45e36e None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:04.609480 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7d637-3499-4c20-8eed-2c49db45e36e None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:04.617654 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64a5e5-ce89-4f71-8260-9b881c679918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:04.619986 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64a5e5-ce89-4f71-8260-9b881c679918 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:04.620453 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64a5e5-ce89-4f71-8260-9b881c679918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:04.620937 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64a5e5-ce89-4f71-8260-9b881c679918 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:04.621800 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d64a5e5-ce89-4f71-8260-9b881c679918 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:11:04.622250 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d64a5e5-ce89-4f71-8260-9b881c679918 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:04.624407 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d64a5e5-ce89-4f71-8260-9b881c679918 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:04.650789 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 697/1393] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:11:04.655063 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39decc-0ac8-4e7a-921e-9ad55d76adcd None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:04.665499 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39decc-0ac8-4e7a-921e-9ad55d76adcd None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:04.687740 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90b99f-66cf-429d-8a84-94c8e3db92ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:04.687740 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90b99f-66cf-429d-8a84-94c8e3db92ba admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:04.687740 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90b99f-66cf-429d-8a84-94c8e3db92ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:04.687740 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90b99f-66cf-429d-8a84-94c8e3db92ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:04.688137 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad90b99f-66cf-429d-8a84-94c8e3db92ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:04.688891 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad90b99f-66cf-429d-8a84-94c8e3db92ba admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:04.852766 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795266f8-ea8e-4983-b205-78432d197d9b None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:04.853724 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795266f8-ea8e-4983-b205-78432d197d9b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:04.854058 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795266f8-ea8e-4983-b205-78432d197d9b None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:04.855944 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 698/1394] 10.222.0.45 () {54 vars in 921 bytes} [Wed Oct 26 11:11:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:11:04.861319 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 697/1395] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:11:04 2022] POST /identity/v3/projects => generated 379 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:04.868590 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795266f8-ea8e-4983-b205-78432d197d9b None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:04.900325 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66fe08-ab8b-4947-ad6e-2fd8e8cdd074 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:04.900705 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66fe08-ab8b-4947-ad6e-2fd8e8cdd074 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:04.900991 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66fe08-ab8b-4947-ad6e-2fd8e8cdd074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:04.961826 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:04.978479 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:04.991854 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-1b66fe08-ab8b-4947-ad6e-2fd8e8cdd074 None None] MFA Rules not processed for user `b4f9a2bba0e748b6a98fa7dea2482ddf`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:04.997020 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-1b66fe08-ab8b-4947-ad6e-2fd8e8cdd074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:05.146060 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795266f8-ea8e-4983-b205-78432d197d9b None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:05.159590 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112592ee-4267-444e-99ed-c9d9216d8b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:05.160265 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112592ee-4267-444e-99ed-c9d9216d8b12 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:05.161571 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112592ee-4267-444e-99ed-c9d9216d8b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:05.162092 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112592ee-4267-444e-99ed-c9d9216d8b12 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:05.169590 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112592ee-4267-444e-99ed-c9d9216d8b12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:05.186936 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112592ee-4267-444e-99ed-c9d9216d8b12 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:05.223378 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 698/1396] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Oct 26 11:11:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:11:05.351361 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 699/1397] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:11:04 2022] POST /identity/v3/users => generated 290 bytes in 483 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:11:05.355765 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66fe08-ab8b-4947-ad6e-2fd8e8cdd074 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:05.380581 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66fe08-ab8b-4947-ad6e-2fd8e8cdd074 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:05.386436 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e7d60-c2c7-4dc1-92b5-48d5333d4d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:05.387259 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e7d60-c2c7-4dc1-92b5-48d5333d4d9e admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:05.387537 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e7d60-c2c7-4dc1-92b5-48d5333d4d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:05.387809 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e7d60-c2c7-4dc1-92b5-48d5333d4d9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:05.388508 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e7d60-c2c7-4dc1-92b5-48d5333d4d9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:05.390441 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e7d60-c2c7-4dc1-92b5-48d5333d4d9e admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:05.461871 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac66bb-eea3-4863-b23a-dd49596d519c None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:05.462168 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac66bb-eea3-4863-b23a-dd49596d519c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:05.462436 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac66bb-eea3-4863-b23a-dd49596d519c None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:05.464014 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 700/1398] 10.222.0.45 () {54 vars in 961 bytes} [Wed Oct 26 11:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:11:05.482125 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15516d7-ce3c-4e39-b8fa-77a23a369cdc None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:05.482328 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15516d7-ce3c-4e39-b8fa-77a23a369cdc None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:05.482817 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15516d7-ce3c-4e39-b8fa-77a23a369cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:05.489784 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 699/1399] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:05.504226 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e7d60-c2c7-4dc1-92b5-48d5333d4d9e admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:05.531280 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-b15516d7-ce3c-4e39-b8fa-77a23a369cdc None None] MFA Rules not processed for user `b4f9a2bba0e748b6a98fa7dea2482ddf`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:05.533384 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b15516d7-ce3c-4e39-b8fa-77a23a369cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:05.575355 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e7d60-c2c7-4dc1-92b5-48d5333d4d9e admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:05.592609 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b4688-bdd8-4160-a660-6160714f3bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:05.595633 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b4688-bdd8-4160-a660-6160714f3bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:05.596418 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b4688-bdd8-4160-a660-6160714f3bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:05.597496 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b4688-bdd8-4160-a660-6160714f3bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:05.598934 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b4688-bdd8-4160-a660-6160714f3bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:05.602693 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b4688-bdd8-4160-a660-6160714f3bc5 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:05.625341 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 701/1400] 10.222.0.45 () {58 vars in 1058 bytes} [Wed Oct 26 11:11:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 26 11:11:05.626701 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15516d7-ce3c-4e39-b8fa-77a23a369cdc None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:05.637229 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 700/1401] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:05.638962 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b4688-bdd8-4160-a660-6160714f3bc5 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:05.648192 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15516d7-ce3c-4e39-b8fa-77a23a369cdc None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:05.657629 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b4688-bdd8-4160-a660-6160714f3bc5 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:05.662817 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14493c92-b4a5-457c-9242-39e80b4acb34 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4f9a2bba0e748b6a98fa7dea2482ddf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:05.664580 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14493c92-b4a5-457c-9242-39e80b4acb34 service placement] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:05.665186 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493e4d5-31de-4483-a888-fddd57b58614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:05.665589 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14493c92-b4a5-457c-9242-39e80b4acb34 service placement] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:05.666285 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493e4d5-31de-4483-a888-fddd57b58614 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:05.666686 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14493c92-b4a5-457c-9242-39e80b4acb34 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:05.666899 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493e4d5-31de-4483-a888-fddd57b58614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:05.667368 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493e4d5-31de-4483-a888-fddd57b58614 admin admin] PATH_INFO: `/v3/projects/1e9b0320355b4ecd9ed0ce682c6feca1/users/f3425be20bda4143b231e58867949aa6/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:05.689117 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14493c92-b4a5-457c-9242-39e80b4acb34 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:05.692562 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14493c92-b4a5-457c-9242-39e80b4acb34 service placement] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:05.696801 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1493e4d5-31de-4483-a888-fddd57b58614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e9b0320355b4ecd9ed0ce682c6feca1, user_id=f3425be20bda4143b231e58867949aa6, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:05.701051 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1493e4d5-31de-4483-a888-fddd57b58614 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:05.745308 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 702/1402] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:05.820815 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 701/1403] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:05 2022] PUT /identity/v3/projects/1e9b0320355b4ecd9ed0ce682c6feca1/users/f3425be20bda4143b231e58867949aa6/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:05.823488 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c0021-be1a-48a5-853c-aaf507a96729 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:05.824263 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c0021-be1a-48a5-853c-aaf507a96729 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:05.824833 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c0021-be1a-48a5-853c-aaf507a96729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:05.885039 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-231c0021-be1a-48a5-853c-aaf507a96729 None None] MFA Rules not processed for user `f3425be20bda4143b231e58867949aa6`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:05.888568 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-231c0021-be1a-48a5-853c-aaf507a96729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:05.932315 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65654b-0014-42b5-af90-edb6f98bceda None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:05.932699 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65654b-0014-42b5-af90-edb6f98bceda None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:05.932984 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65654b-0014-42b5-af90-edb6f98bceda None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:05.939893 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 702/1404] 10.222.0.45 () {54 vars in 921 bytes} [Wed Oct 26 11:11:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:11:05.982073 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823c163-ba36-41cb-a77e-f11ef3ad446c None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:05.986322 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823c163-ba36-41cb-a77e-f11ef3ad446c None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:05.986322 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823c163-ba36-41cb-a77e-f11ef3ad446c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:06.078556 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-8823c163-ba36-41cb-a77e-f11ef3ad446c None None] MFA Rules not processed for user `a852a777cb6a4863bebdb949cc71ea65`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:06.078556 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-8823c163-ba36-41cb-a77e-f11ef3ad446c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:06.202360 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 703/1405] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:11:06.207228 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c0021-be1a-48a5-853c-aaf507a96729 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:06.392700 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 703/1406] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Oct 26 11:11:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:11:06.463643 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823c163-ba36-41cb-a77e-f11ef3ad446c None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:06.468589 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-8823c163-ba36-41cb-a77e-f11ef3ad446c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:06.493969 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c0021-be1a-48a5-853c-aaf507a96729 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:06.502268 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87bf3e8-e9bd-44d6-88de-47bfeaeb1f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:06.502957 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87bf3e8-e9bd-44d6-88de-47bfeaeb1f29 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:06.503362 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87bf3e8-e9bd-44d6-88de-47bfeaeb1f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:06.503706 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87bf3e8-e9bd-44d6-88de-47bfeaeb1f29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:06.505674 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87bf3e8-e9bd-44d6-88de-47bfeaeb1f29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:06.510118 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87bf3e8-e9bd-44d6-88de-47bfeaeb1f29 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:06.538889 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823c163-ba36-41cb-a77e-f11ef3ad446c None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:06.566608 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5c86f-9019-48d4-87f3-b6c7d9019de1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:06.566608 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5c86f-9019-48d4-87f3-b6c7d9019de1 service nova] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:06.566608 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5c86f-9019-48d4-87f3-b6c7d9019de1 service nova] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:06.567401 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5c86f-9019-48d4-87f3-b6c7d9019de1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:06.591370 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5c86f-9019-48d4-87f3-b6c7d9019de1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:06.593892 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5c86f-9019-48d4-87f3-b6c7d9019de1 service nova] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:06.610629 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 704/1407] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:06.633029 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 704/1408] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:11:06 2022] POST /identity/v3/projects => generated 381 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:11:06.637076 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5c86f-9019-48d4-87f3-b6c7d9019de1 service nova] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:06.675462 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5c86f-9019-48d4-87f3-b6c7d9019de1 service nova] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:06.828129 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1be64-512d-4b1c-b172-ab41a51b03a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:06.830975 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1be64-512d-4b1c-b172-ab41a51b03a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:06.831319 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1be64-512d-4b1c-b172-ab41a51b03a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:06.831610 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1be64-512d-4b1c-b172-ab41a51b03a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:06.833119 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1be64-512d-4b1c-b172-ab41a51b03a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:06.835934 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1be64-512d-4b1c-b172-ab41a51b03a5 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:07.091382 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 705/1409] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:11:06 2022] POST /identity/v3/users => generated 297 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:07.095526 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87bf3e8-e9bd-44d6-88de-47bfeaeb1f29 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:07.105514 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:07.110053 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87bf3e8-e9bd-44d6-88de-47bfeaeb1f29 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:07.125101 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb60b54-1539-45fc-a0d3-8820d6b9a2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:07.126330 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb60b54-1539-45fc-a0d3-8820d6b9a2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:07.126623 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb60b54-1539-45fc-a0d3-8820d6b9a2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:07.126905 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb60b54-1539-45fc-a0d3-8820d6b9a2d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:07.137491 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb60b54-1539-45fc-a0d3-8820d6b9a2d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:07.137491 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb60b54-1539-45fc-a0d3-8820d6b9a2d1 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:07.144772 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 705/1410] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:07.149428 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1be64-512d-4b1c-b172-ab41a51b03a5 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:07.163826 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1be64-512d-4b1c-b172-ab41a51b03a5 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:07.172176 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b780c35-3bb8-4d5a-9d9c-5a41d254c541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:07.172176 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b780c35-3bb8-4d5a-9d9c-5a41d254c541 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:07.172496 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b780c35-3bb8-4d5a-9d9c-5a41d254c541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:07.172904 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b780c35-3bb8-4d5a-9d9c-5a41d254c541 admin admin] PATH_INFO: `/v3/projects/4304eae9b0d749e9bf3e545a90bb3bdb/users/5e9b9d95386c477abfe11a10e88d93c8/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:07.207998 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b780c35-3bb8-4d5a-9d9c-5a41d254c541 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4304eae9b0d749e9bf3e545a90bb3bdb, user_id=5e9b9d95386c477abfe11a10e88d93c8, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:07.214730 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b780c35-3bb8-4d5a-9d9c-5a41d254c541 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:07.338307 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 706/1411] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:07 2022] PUT /identity/v3/projects/4304eae9b0d749e9bf3e545a90bb3bdb/users/5e9b9d95386c477abfe11a10e88d93c8/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:11:07.342736 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb60b54-1539-45fc-a0d3-8820d6b9a2d1 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:07.371942 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb60b54-1539-45fc-a0d3-8820d6b9a2d1 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:07.477822 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f914622-9f9f-4bb6-b1ac-0d0b89b6715b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:07.479069 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f914622-9f9f-4bb6-b1ac-0d0b89b6715b admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:07.479753 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f914622-9f9f-4bb6-b1ac-0d0b89b6715b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:07.480246 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f914622-9f9f-4bb6-b1ac-0d0b89b6715b admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:07.481132 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f914622-9f9f-4bb6-b1ac-0d0b89b6715b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:07.483087 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f914622-9f9f-4bb6-b1ac-0d0b89b6715b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:07.497697 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 706/1412] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:07.502107 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b780c35-3bb8-4d5a-9d9c-5a41d254c541 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:07.513677 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b780c35-3bb8-4d5a-9d9c-5a41d254c541 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:07.519299 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d80a0-2757-4a35-837e-67997d535fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:07.520831 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d80a0-2757-4a35-837e-67997d535fe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:07.521168 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d80a0-2757-4a35-837e-67997d535fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:07.521500 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d80a0-2757-4a35-837e-67997d535fe2 admin admin] PATH_INFO: `/v3/projects/4304eae9b0d749e9bf3e545a90bb3bdb/users/5e9b9d95386c477abfe11a10e88d93c8/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:07.523718 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d80a0-2757-4a35-837e-67997d535fe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4304eae9b0d749e9bf3e545a90bb3bdb, user_id=5e9b9d95386c477abfe11a10e88d93c8, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:07.526743 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d80a0-2757-4a35-837e-67997d535fe2 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:07.562502 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 707/1413] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:07 2022] PUT /identity/v3/projects/4304eae9b0d749e9bf3e545a90bb3bdb/users/5e9b9d95386c477abfe11a10e88d93c8/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:07.564345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbde93-d9fa-4ac7-b7ad-f39788a3bc8e None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:07.570719 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbde93-d9fa-4ac7-b7ad-f39788a3bc8e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:07.571186 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbde93-d9fa-4ac7-b7ad-f39788a3bc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:07.654322 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-6dcbde93-d9fa-4ac7-b7ad-f39788a3bc8e None None] MFA Rules not processed for user `5e9b9d95386c477abfe11a10e88d93c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:07.655866 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6dcbde93-d9fa-4ac7-b7ad-f39788a3bc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:07.782163 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 707/1414] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:07 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:07.801916 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d80a0-2757-4a35-837e-67997d535fe2 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:07.809078 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-243d80a0-2757-4a35-837e-67997d535fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:07.853888 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbde93-d9fa-4ac7-b7ad-f39788a3bc8e None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:07.855971 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6dcbde93-d9fa-4ac7-b7ad-f39788a3bc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:07.980887 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d80a0-2757-4a35-837e-67997d535fe2 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:08.011872 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923aed5-e213-4126-9152-8c315567f3a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:08.012640 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923aed5-e213-4126-9152-8c315567f3a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:08.012937 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923aed5-e213-4126-9152-8c315567f3a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:08.013214 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923aed5-e213-4126-9152-8c315567f3a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:08.042533 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923aed5-e213-4126-9152-8c315567f3a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:08.048488 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923aed5-e213-4126-9152-8c315567f3a8 service cinder] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:08.077126 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 708/1415] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:07 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:08.081143 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbde93-d9fa-4ac7-b7ad-f39788a3bc8e None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:08.088621 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf368e-a64c-499e-9a54-ca469c45c40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:08.089454 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf368e-a64c-499e-9a54-ca469c45c40b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:08.094010 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf368e-a64c-499e-9a54-ca469c45c40b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:08.094010 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf368e-a64c-499e-9a54-ca469c45c40b admin admin] PATH_INFO: `/v3/users/28b40fbb44904030bd7994f4a950343f` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:08.094010 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf368e-a64c-499e-9a54-ca469c45c40b admin admin] RBAC: Authorizing `identity:delete_user(user_id=28b40fbb44904030bd7994f4a950343f)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:08.096015 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf368e-a64c-499e-9a54-ca469c45c40b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:08.533114 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1bbf368e-a64c-499e-9a54-ca469c45c40b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28b40fbb44904030bd7994f4a950343f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:08.612205 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1bbf368e-a64c-499e-9a54-ca469c45c40b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28b40fbb44904030bd7994f4a950343f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:08.627075 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1bbf368e-a64c-499e-9a54-ca469c45c40b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28b40fbb44904030bd7994f4a950343f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:08.637818 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1bbf368e-a64c-499e-9a54-ca469c45c40b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28b40fbb44904030bd7994f4a950343f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:08.638826 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1bbf368e-a64c-499e-9a54-ca469c45c40b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28b40fbb44904030bd7994f4a950343f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:08.668762 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 708/1416] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:11:07 2022] DELETE /identity/v3/users/28b40fbb44904030bd7994f4a950343f => generated 0 bytes in 815 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:11:08.755831 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:09.116307 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923aed5-e213-4126-9152-8c315567f3a8 service cinder] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:09.141460 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923aed5-e213-4126-9152-8c315567f3a8 service cinder] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:09.242764 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a7d63-8b39-4833-8c89-5827b1b6f1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:09.246412 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a7d63-8b39-4833-8c89-5827b1b6f1e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:09.246412 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a7d63-8b39-4833-8c89-5827b1b6f1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:09.246412 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a7d63-8b39-4833-8c89-5827b1b6f1e8 admin admin] PATH_INFO: `/v3/projects/e10f985bfc874d599d8414c4c0ba2541` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:09.246412 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a7d63-8b39-4833-8c89-5827b1b6f1e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e10f985bfc874d599d8414c4c0ba2541)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:09.248909 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a7d63-8b39-4833-8c89-5827b1b6f1e8 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:09.913693 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-c24a7d63-8b39-4833-8c89-5827b1b6f1e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e10f985bfc874d599d8414c4c0ba2541', 'request_id': 'req-c24a7d63-8b39-4833-8c89-5827b1b6f1e8'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:10.058961 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-c24a7d63-8b39-4833-8c89-5827b1b6f1e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e10f985bfc874d599d8414c4c0ba2541', 'request_id': 'req-c24a7d63-8b39-4833-8c89-5827b1b6f1e8'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:10.079240 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-c24a7d63-8b39-4833-8c89-5827b1b6f1e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e10f985bfc874d599d8414c4c0ba2541', 'request_id': 'req-c24a7d63-8b39-4833-8c89-5827b1b6f1e8'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:10.093914 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-c24a7d63-8b39-4833-8c89-5827b1b6f1e8 admin admin] The token cache is being invalidate because project e10f985bfc874d599d8414c4c0ba2541 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:11:10.094216 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-c24a7d63-8b39-4833-8c89-5827b1b6f1e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:10.094880 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-c24a7d63-8b39-4833-8c89-5827b1b6f1e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:10.096435 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 709/1417] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:11:09 2022] DELETE /identity/v3/projects/e10f985bfc874d599d8414c4c0ba2541 => generated 0 bytes in 981 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:10.101514 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf368e-a64c-499e-9a54-ca469c45c40b admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:10.103711 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1bbf368e-a64c-499e-9a54-ca469c45c40b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:10.117958 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf368e-a64c-499e-9a54-ca469c45c40b admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:10.176931 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871d1d5-13b6-47b3-8b0f-cf5a8e7946d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:10.188270 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871d1d5-13b6-47b3-8b0f-cf5a8e7946d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:10.188270 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871d1d5-13b6-47b3-8b0f-cf5a8e7946d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:10.188270 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871d1d5-13b6-47b3-8b0f-cf5a8e7946d6 admin admin] PATH_INFO: `/v3/users/a5a921d53fd04d92b533d3d2d70902c8` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:10.188270 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871d1d5-13b6-47b3-8b0f-cf5a8e7946d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5a921d53fd04d92b533d3d2d70902c8)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:10.188270 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871d1d5-13b6-47b3-8b0f-cf5a8e7946d6 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:10.427831 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-8871d1d5-13b6-47b3-8b0f-cf5a8e7946d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5a921d53fd04d92b533d3d2d70902c8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:10.429556 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a7d63-8b39-4833-8c89-5827b1b6f1e8 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:10.431612 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-c24a7d63-8b39-4833-8c89-5827b1b6f1e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:10.464112 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:10.497251 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-8871d1d5-13b6-47b3-8b0f-cf5a8e7946d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5a921d53fd04d92b533d3d2d70902c8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:10.499065 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a7d63-8b39-4833-8c89-5827b1b6f1e8 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:10.503811 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63150fea-bac6-4d3b-83d6-717d18096672 tempest-VolumeQuotaClassesTest-1419880758 tempest-VolumeQuotaClassesTest-1419880758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e9b9d95386c477abfe11a10e88d93c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4304eae9b0d749e9bf3e545a90bb3bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:10.507947 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63150fea-bac6-4d3b-83d6-717d18096672 tempest-VolumeQuotaClassesTest-1419880758 tempest-VolumeQuotaClassesTest-1419880758-project-admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:10.507947 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63150fea-bac6-4d3b-83d6-717d18096672 tempest-VolumeQuotaClassesTest-1419880758 tempest-VolumeQuotaClassesTest-1419880758-project-admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:10.507947 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63150fea-bac6-4d3b-83d6-717d18096672 tempest-VolumeQuotaClassesTest-1419880758 tempest-VolumeQuotaClassesTest-1419880758-project-admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:10.507947 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63150fea-bac6-4d3b-83d6-717d18096672 tempest-VolumeQuotaClassesTest-1419880758 tempest-VolumeQuotaClassesTest-1419880758-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:11:10.508312 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63150fea-bac6-4d3b-83d6-717d18096672 tempest-VolumeQuotaClassesTest-1419880758 tempest-VolumeQuotaClassesTest-1419880758-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:10.509788 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63150fea-bac6-4d3b-83d6-717d18096672 tempest-VolumeQuotaClassesTest-1419880758 tempest-VolumeQuotaClassesTest-1419880758-project-admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:10.514005 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-8871d1d5-13b6-47b3-8b0f-cf5a8e7946d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5a921d53fd04d92b533d3d2d70902c8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:10.523265 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 710/1418] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 11:11:10.527824 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63150fea-bac6-4d3b-83d6-717d18096672 tempest-VolumeQuotaClassesTest-1419880758 tempest-VolumeQuotaClassesTest-1419880758-project-admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:10.530271 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-8871d1d5-13b6-47b3-8b0f-cf5a8e7946d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5a921d53fd04d92b533d3d2d70902c8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:10.530990 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-8871d1d5-13b6-47b3-8b0f-cf5a8e7946d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5a921d53fd04d92b533d3d2d70902c8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:10.544584 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 709/1419] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:11:10 2022] DELETE /identity/v3/users/a5a921d53fd04d92b533d3d2d70902c8 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:10.544794 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63150fea-bac6-4d3b-83d6-717d18096672 tempest-VolumeQuotaClassesTest-1419880758 tempest-VolumeQuotaClassesTest-1419880758-project-admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:10.620225 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf951738-5d3a-4419-9181-caaf285e622f tempest-VolumeQuotaClassesTest-1419880758 tempest-VolumeQuotaClassesTest-1419880758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e9b9d95386c477abfe11a10e88d93c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4304eae9b0d749e9bf3e545a90bb3bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:10.621185 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf951738-5d3a-4419-9181-caaf285e622f tempest-VolumeQuotaClassesTest-1419880758 tempest-VolumeQuotaClassesTest-1419880758-project-admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:10.621652 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf951738-5d3a-4419-9181-caaf285e622f tempest-VolumeQuotaClassesTest-1419880758 tempest-VolumeQuotaClassesTest-1419880758-project-admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:10.622122 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf951738-5d3a-4419-9181-caaf285e622f tempest-VolumeQuotaClassesTest-1419880758 tempest-VolumeQuotaClassesTest-1419880758-project-admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:10.623846 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf951738-5d3a-4419-9181-caaf285e622f tempest-VolumeQuotaClassesTest-1419880758 tempest-VolumeQuotaClassesTest-1419880758-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:10.626349 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf951738-5d3a-4419-9181-caaf285e622f tempest-VolumeQuotaClassesTest-1419880758 tempest-VolumeQuotaClassesTest-1419880758-project-admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:10.726940 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 711/1420] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:11:10 2022] POST /identity/v3/projects => generated 354 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:11:10.730919 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871d1d5-13b6-47b3-8b0f-cf5a8e7946d6 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:10.732767 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8871d1d5-13b6-47b3-8b0f-cf5a8e7946d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:10.747457 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871d1d5-13b6-47b3-8b0f-cf5a8e7946d6 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:10.807513 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c6454-7515-40a1-9fa9-20037e4f89eb tempest-VolumeQuotaClassesTest-1419880758 tempest-VolumeQuotaClassesTest-1419880758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e9b9d95386c477abfe11a10e88d93c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4304eae9b0d749e9bf3e545a90bb3bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:10.809434 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c6454-7515-40a1-9fa9-20037e4f89eb tempest-VolumeQuotaClassesTest-1419880758 tempest-VolumeQuotaClassesTest-1419880758-project-admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:10.809434 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c6454-7515-40a1-9fa9-20037e4f89eb tempest-VolumeQuotaClassesTest-1419880758 tempest-VolumeQuotaClassesTest-1419880758-project-admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:10.809434 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c6454-7515-40a1-9fa9-20037e4f89eb tempest-VolumeQuotaClassesTest-1419880758 tempest-VolumeQuotaClassesTest-1419880758-project-admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:10.809434 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670c6454-7515-40a1-9fa9-20037e4f89eb tempest-VolumeQuotaClassesTest-1419880758 tempest-VolumeQuotaClassesTest-1419880758-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:11:10.809833 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670c6454-7515-40a1-9fa9-20037e4f89eb tempest-VolumeQuotaClassesTest-1419880758 tempest-VolumeQuotaClassesTest-1419880758-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:10.811267 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670c6454-7515-40a1-9fa9-20037e4f89eb tempest-VolumeQuotaClassesTest-1419880758 tempest-VolumeQuotaClassesTest-1419880758-project-admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:10.822590 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 710/1421] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:11:10.865073 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf951738-5d3a-4419-9181-caaf285e622f tempest-VolumeQuotaClassesTest-1419880758 tempest-VolumeQuotaClassesTest-1419880758-project-admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:10.875720 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c6454-7515-40a1-9fa9-20037e4f89eb tempest-VolumeQuotaClassesTest-1419880758 tempest-VolumeQuotaClassesTest-1419880758-project-admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:10.877147 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf951738-5d3a-4419-9181-caaf285e622f tempest-VolumeQuotaClassesTest-1419880758 tempest-VolumeQuotaClassesTest-1419880758-project-admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:10.878082 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-670c6454-7515-40a1-9fa9-20037e4f89eb tempest-VolumeQuotaClassesTest-1419880758 tempest-VolumeQuotaClassesTest-1419880758-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:10.882741 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0bbea-f1f0-41c7-8767-451864ec13ab tempest-VolumeQuotaClassesTest-1419880758 tempest-VolumeQuotaClassesTest-1419880758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e9b9d95386c477abfe11a10e88d93c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4304eae9b0d749e9bf3e545a90bb3bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:10.883531 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0bbea-f1f0-41c7-8767-451864ec13ab tempest-VolumeQuotaClassesTest-1419880758 tempest-VolumeQuotaClassesTest-1419880758-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:10.883906 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0bbea-f1f0-41c7-8767-451864ec13ab tempest-VolumeQuotaClassesTest-1419880758 tempest-VolumeQuotaClassesTest-1419880758-project-admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:10.884628 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0bbea-f1f0-41c7-8767-451864ec13ab tempest-VolumeQuotaClassesTest-1419880758 tempest-VolumeQuotaClassesTest-1419880758-project-admin] PATH_INFO: `/v3/projects/f26f440019664a95be2bea0d6d470e59` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:10.885732 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc0bbea-f1f0-41c7-8767-451864ec13ab tempest-VolumeQuotaClassesTest-1419880758 tempest-VolumeQuotaClassesTest-1419880758-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f26f440019664a95be2bea0d6d470e59)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:10.887816 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc0bbea-f1f0-41c7-8767-451864ec13ab tempest-VolumeQuotaClassesTest-1419880758 tempest-VolumeQuotaClassesTest-1419880758-project-admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:10.948823 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c6454-7515-40a1-9fa9-20037e4f89eb tempest-VolumeQuotaClassesTest-1419880758 tempest-VolumeQuotaClassesTest-1419880758-project-admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:10.953441 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351edb82-2cc9-49cf-940b-348f8af498a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:10.954080 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351edb82-2cc9-49cf-940b-348f8af498a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:10.954362 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351edb82-2cc9-49cf-940b-348f8af498a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:10.954635 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351edb82-2cc9-49cf-940b-348f8af498a1 admin admin] PATH_INFO: `/v3/projects/10612c7e3cee4c73964d9d666b40a979` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:10.955750 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351edb82-2cc9-49cf-940b-348f8af498a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10612c7e3cee4c73964d9d666b40a979)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:10.957766 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351edb82-2cc9-49cf-940b-348f8af498a1 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:11.014827 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-1cc0bbea-f1f0-41c7-8767-451864ec13ab tempest-VolumeQuotaClassesTest-1419880758 tempest-VolumeQuotaClassesTest-1419880758-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f26f440019664a95be2bea0d6d470e59', 'request_id': 'req-1cc0bbea-f1f0-41c7-8767-451864ec13ab'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:11.091519 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-351edb82-2cc9-49cf-940b-348f8af498a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10612c7e3cee4c73964d9d666b40a979', 'request_id': 'req-351edb82-2cc9-49cf-940b-348f8af498a1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:11.098038 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-351edb82-2cc9-49cf-940b-348f8af498a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10612c7e3cee4c73964d9d666b40a979', 'request_id': 'req-351edb82-2cc9-49cf-940b-348f8af498a1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:11.102944 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-1cc0bbea-f1f0-41c7-8767-451864ec13ab tempest-VolumeQuotaClassesTest-1419880758 tempest-VolumeQuotaClassesTest-1419880758-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f26f440019664a95be2bea0d6d470e59', 'request_id': 'req-1cc0bbea-f1f0-41c7-8767-451864ec13ab'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:11.109932 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-1cc0bbea-f1f0-41c7-8767-451864ec13ab tempest-VolumeQuotaClassesTest-1419880758 tempest-VolumeQuotaClassesTest-1419880758-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f26f440019664a95be2bea0d6d470e59', 'request_id': 'req-1cc0bbea-f1f0-41c7-8767-451864ec13ab'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:11.121013 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-1cc0bbea-f1f0-41c7-8767-451864ec13ab tempest-VolumeQuotaClassesTest-1419880758 tempest-VolumeQuotaClassesTest-1419880758-project-admin] The token cache is being invalidate because project f26f440019664a95be2bea0d6d470e59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:11:11.121309 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-1cc0bbea-f1f0-41c7-8767-451864ec13ab tempest-VolumeQuotaClassesTest-1419880758 tempest-VolumeQuotaClassesTest-1419880758-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:11.122060 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-1cc0bbea-f1f0-41c7-8767-451864ec13ab tempest-VolumeQuotaClassesTest-1419880758 tempest-VolumeQuotaClassesTest-1419880758-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:11.123810 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 712/1422] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:11:10 2022] DELETE /identity/v3/projects/f26f440019664a95be2bea0d6d470e59 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:11.206852 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-351edb82-2cc9-49cf-940b-348f8af498a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10612c7e3cee4c73964d9d666b40a979', 'request_id': 'req-351edb82-2cc9-49cf-940b-348f8af498a1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:11.226207 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-351edb82-2cc9-49cf-940b-348f8af498a1 admin admin] The token cache is being invalidate because project 10612c7e3cee4c73964d9d666b40a979 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:11:11.226207 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-351edb82-2cc9-49cf-940b-348f8af498a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:11.226207 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-351edb82-2cc9-49cf-940b-348f8af498a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:11.226207 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 711/1423] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:11:10 2022] DELETE /identity/v3/projects/10612c7e3cee4c73964d9d666b40a979 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:11:11.230000 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb371c-22a0-4b4d-84d9-fbab4ca1861a None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:11.240148 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb371c-22a0-4b4d-84d9-fbab4ca1861a None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:11.240148 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb371c-22a0-4b4d-84d9-fbab4ca1861a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:11.259897 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-abfb371c-22a0-4b4d-84d9-fbab4ca1861a None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:11.261224 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-abfb371c-22a0-4b4d-84d9-fbab4ca1861a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:11.267964 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351edb82-2cc9-49cf-940b-348f8af498a1 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:11.267964 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-351edb82-2cc9-49cf-940b-348f8af498a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:11.321985 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 713/1424] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:11.327804 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351edb82-2cc9-49cf-940b-348f8af498a1 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:11.329679 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c96a1b-fdf1-4c6c-aa7c-74862b8fae21 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:11.329996 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c96a1b-fdf1-4c6c-aa7c-74862b8fae21 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:11.330248 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c96a1b-fdf1-4c6c-aa7c-74862b8fae21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:11.333922 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e12da-83c6-4ac0-8b21-abe8c7098bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:11.334594 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e12da-83c6-4ac0-8b21-abe8c7098bfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:11.334883 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e12da-83c6-4ac0-8b21-abe8c7098bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:11.335155 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e12da-83c6-4ac0-8b21-abe8c7098bfb admin admin] PATH_INFO: `/v3/users/4b5d753f78e34b7e93122415bf3ff950` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:11.336499 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e12da-83c6-4ac0-8b21-abe8c7098bfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b5d753f78e34b7e93122415bf3ff950)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:11.338489 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e12da-83c6-4ac0-8b21-abe8c7098bfb admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:11.351441 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-a4c96a1b-fdf1-4c6c-aa7c-74862b8fae21 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:11.352812 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-a4c96a1b-fdf1-4c6c-aa7c-74862b8fae21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:11.365746 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 714/1425] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:11:11.366900 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c96a1b-fdf1-4c6c-aa7c-74862b8fae21 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:11.375836 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c96a1b-fdf1-4c6c-aa7c-74862b8fae21 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:11.381100 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306e356-a208-418a-9a4f-247104ddf8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:11.381763 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306e356-a208-418a-9a4f-247104ddf8fd admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:11.382047 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306e356-a208-418a-9a4f-247104ddf8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:11.382320 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306e356-a208-418a-9a4f-247104ddf8fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:11.382954 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306e356-a208-418a-9a4f-247104ddf8fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:11:11.383254 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306e356-a208-418a-9a4f-247104ddf8fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:11.384902 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306e356-a208-418a-9a4f-247104ddf8fd admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:11.396662 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 715/1426] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 11:11:11.400886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306e356-a208-418a-9a4f-247104ddf8fd admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:11.410486 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306e356-a208-418a-9a4f-247104ddf8fd admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:11.415089 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a627fc6-c86b-46aa-b074-71605e448bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:11.420800 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a627fc6-c86b-46aa-b074-71605e448bdb admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:11.420800 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a627fc6-c86b-46aa-b074-71605e448bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:11.420800 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a627fc6-c86b-46aa-b074-71605e448bdb admin admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:11.420800 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a627fc6-c86b-46aa-b074-71605e448bdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:11.420800 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a627fc6-c86b-46aa-b074-71605e448bdb admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:11.495050 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 716/1427] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:11:11 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:11:11.500650 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a627fc6-c86b-46aa-b074-71605e448bdb admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:11.526668 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-838e12da-83c6-4ac0-8b21-abe8c7098bfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b5d753f78e34b7e93122415bf3ff950'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:11.575616 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a627fc6-c86b-46aa-b074-71605e448bdb admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:11.580684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b07e87-5ff0-4cf3-8899-f69a90fda482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:11.581369 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b07e87-5ff0-4cf3-8899-f69a90fda482 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:11.581626 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b07e87-5ff0-4cf3-8899-f69a90fda482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:11.581899 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b07e87-5ff0-4cf3-8899-f69a90fda482 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:11.582623 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b07e87-5ff0-4cf3-8899-f69a90fda482 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:11.584758 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b07e87-5ff0-4cf3-8899-f69a90fda482 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:11.606208 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-838e12da-83c6-4ac0-8b21-abe8c7098bfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b5d753f78e34b7e93122415bf3ff950'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:11.621128 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-838e12da-83c6-4ac0-8b21-abe8c7098bfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b5d753f78e34b7e93122415bf3ff950'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:11.628789 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-838e12da-83c6-4ac0-8b21-abe8c7098bfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b5d753f78e34b7e93122415bf3ff950'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:11.629558 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-838e12da-83c6-4ac0-8b21-abe8c7098bfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b5d753f78e34b7e93122415bf3ff950'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:11.636004 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 712/1428] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:11:11 2022] DELETE /identity/v3/users/4b5d753f78e34b7e93122415bf3ff950 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:11:11.646846 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1eaf7a-0895-4db4-b4c0-a26bd08f122e None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:11.647203 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1eaf7a-0895-4db4-b4c0-a26bd08f122e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:11.647556 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1eaf7a-0895-4db4-b4c0-a26bd08f122e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:11.670170 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-fe1eaf7a-0895-4db4-b4c0-a26bd08f122e None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:11.671770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 717/1429] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:11:11 2022] POST /identity/v3/users => generated 294 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:11:11.674573 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-fe1eaf7a-0895-4db4-b4c0-a26bd08f122e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:11.675860 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b07e87-5ff0-4cf3-8899-f69a90fda482 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:11.678655 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-86b07e87-5ff0-4cf3-8899-f69a90fda482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:11.688719 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:11.701522 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b07e87-5ff0-4cf3-8899-f69a90fda482 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:11.781161 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 713/1430] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:11:11.792379 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1eaf7a-0895-4db4-b4c0-a26bd08f122e None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:11.794457 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-fe1eaf7a-0895-4db4-b4c0-a26bd08f122e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:11.821141 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbfaf72-5562-4ddb-94c9-8dad1998f6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:11.822441 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbfaf72-5562-4ddb-94c9-8dad1998f6e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:11.822848 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbfaf72-5562-4ddb-94c9-8dad1998f6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:11.823411 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbfaf72-5562-4ddb-94c9-8dad1998f6e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:11.824154 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbfaf72-5562-4ddb-94c9-8dad1998f6e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:11.825776 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbfaf72-5562-4ddb-94c9-8dad1998f6e5 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:11.837752 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 718/1431] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:11.844400 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbfaf72-5562-4ddb-94c9-8dad1998f6e5 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:11.855318 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbfaf72-5562-4ddb-94c9-8dad1998f6e5 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:11.863554 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1eaf7a-0895-4db4-b4c0-a26bd08f122e None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:11.863739 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364407e-94d9-4aa9-a35a-68bf93c0a9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:11.864422 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364407e-94d9-4aa9-a35a-68bf93c0a9cc admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:11.865236 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364407e-94d9-4aa9-a35a-68bf93c0a9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:11.865645 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364407e-94d9-4aa9-a35a-68bf93c0a9cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:11.866300 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2364407e-94d9-4aa9-a35a-68bf93c0a9cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:11.868045 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2364407e-94d9-4aa9-a35a-68bf93c0a9cc admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:11.868185 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4cebe6-e96f-4225-92b8-d5e49accd019 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:11.868795 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cebe6-e96f-4225-92b8-d5e49accd019 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:11.869080 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cebe6-e96f-4225-92b8-d5e49accd019 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:11.869547 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cebe6-e96f-4225-92b8-d5e49accd019 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:11.882679 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4cebe6-e96f-4225-92b8-d5e49accd019 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:11.882882 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 719/1432] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:11.882988 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4cebe6-e96f-4225-92b8-d5e49accd019 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:11.883999 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364407e-94d9-4aa9-a35a-68bf93c0a9cc admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:11.894132 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 714/1433] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:11.895104 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364407e-94d9-4aa9-a35a-68bf93c0a9cc admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:11.900570 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7646b-7e54-4d4f-841d-651fc6e8725a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:11.901326 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7646b-7e54-4d4f-841d-651fc6e8725a admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:11.901697 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7646b-7e54-4d4f-841d-651fc6e8725a admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:11.902018 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7646b-7e54-4d4f-841d-651fc6e8725a admin admin] PATH_INFO: `/v3/projects/abffeb351bc146edacd94a4a7604687a/users/ebab267e4b9248f189ac0df85c6bdc9f/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:11.924030 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7646b-7e54-4d4f-841d-651fc6e8725a admin admin] RBAC: Authorizing `identity:create_grant(project_id=abffeb351bc146edacd94a4a7604687a, user_id=ebab267e4b9248f189ac0df85c6bdc9f, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:11.926883 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7646b-7e54-4d4f-841d-651fc6e8725a admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:11.932232 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4cebe6-e96f-4225-92b8-d5e49accd019 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:11.933753 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5c4cebe6-e96f-4225-92b8-d5e49accd019 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:11.948333 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4cebe6-e96f-4225-92b8-d5e49accd019 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:11.960253 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93abfc8-f565-46fa-9a5b-7701e4802303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:11.960253 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93abfc8-f565-46fa-9a5b-7701e4802303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:11.960253 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93abfc8-f565-46fa-9a5b-7701e4802303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:11.960253 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93abfc8-f565-46fa-9a5b-7701e4802303 admin admin] PATH_INFO: `/v3/users/f3425be20bda4143b231e58867949aa6` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:11.960651 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93abfc8-f565-46fa-9a5b-7701e4802303 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3425be20bda4143b231e58867949aa6)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:11.960793 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93abfc8-f565-46fa-9a5b-7701e4802303 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:12.075005 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 720/1434] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:11 2022] PUT /identity/v3/projects/abffeb351bc146edacd94a4a7604687a/users/ebab267e4b9248f189ac0df85c6bdc9f/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:12.088730 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bf016-20f0-4c35-8b5d-8f553ed8be43 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:12.089037 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bf016-20f0-4c35-8b5d-8f553ed8be43 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:12.089311 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bf016-20f0-4c35-8b5d-8f553ed8be43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:12.119709 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-489bf016-20f0-4c35-8b5d-8f553ed8be43 None None] MFA Rules not processed for user `ebab267e4b9248f189ac0df85c6bdc9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:12.120989 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-489bf016-20f0-4c35-8b5d-8f553ed8be43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:12.199724 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 721/1435] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:11:12.204218 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489bf016-20f0-4c35-8b5d-8f553ed8be43 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:12.246339 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d93abfc8-f565-46fa-9a5b-7701e4802303 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3425be20bda4143b231e58867949aa6'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:12.302101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489bf016-20f0-4c35-8b5d-8f553ed8be43 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:12.308726 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af75f9-10ab-4996-9528-472995a03fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:12.315164 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af75f9-10ab-4996-9528-472995a03fc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:12.315164 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af75f9-10ab-4996-9528-472995a03fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:12.315164 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af75f9-10ab-4996-9528-472995a03fc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:12.315164 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69af75f9-10ab-4996-9528-472995a03fc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:12.315164 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69af75f9-10ab-4996-9528-472995a03fc2 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:12.371700 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d93abfc8-f565-46fa-9a5b-7701e4802303 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3425be20bda4143b231e58867949aa6'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:12.385638 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d93abfc8-f565-46fa-9a5b-7701e4802303 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3425be20bda4143b231e58867949aa6'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:12.392956 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d93abfc8-f565-46fa-9a5b-7701e4802303 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3425be20bda4143b231e58867949aa6'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:12.393846 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d93abfc8-f565-46fa-9a5b-7701e4802303 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3425be20bda4143b231e58867949aa6'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:12.401313 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 715/1436] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:11:11 2022] DELETE /identity/v3/users/f3425be20bda4143b231e58867949aa6 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:11:12.412715 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a1a63-43b9-493f-892a-ae75d4bd0ea2 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:12.412715 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a1a63-43b9-493f-892a-ae75d4bd0ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:12.412715 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a1a63-43b9-493f-892a-ae75d4bd0ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:12.428049 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-163a1a63-43b9-493f-892a-ae75d4bd0ea2 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:12.429540 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-163a1a63-43b9-493f-892a-ae75d4bd0ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:12.476127 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 722/1437] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:11:12 2022] POST /identity/v3/projects => generated 387 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:11:12.480193 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af75f9-10ab-4996-9528-472995a03fc2 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:12.482018 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-69af75f9-10ab-4996-9528-472995a03fc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:12.527189 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 716/1438] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:11:12.537289 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a1a63-43b9-493f-892a-ae75d4bd0ea2 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:12.539971 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-163a1a63-43b9-493f-892a-ae75d4bd0ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:12.563329 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af75f9-10ab-4996-9528-472995a03fc2 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:12.568896 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62ef2d-9176-486e-977a-6dcad745ea44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:12.569557 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62ef2d-9176-486e-977a-6dcad745ea44 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:12.569844 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62ef2d-9176-486e-977a-6dcad745ea44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:12.570163 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62ef2d-9176-486e-977a-6dcad745ea44 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:12.570800 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c62ef2d-9176-486e-977a-6dcad745ea44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:12.572852 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c62ef2d-9176-486e-977a-6dcad745ea44 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:12.600640 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a1a63-43b9-493f-892a-ae75d4bd0ea2 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:12.655649 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5702d418-c6a3-4113-bb1c-61d47bc5d97c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:12.656306 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702d418-c6a3-4113-bb1c-61d47bc5d97c service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:12.656593 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702d418-c6a3-4113-bb1c-61d47bc5d97c service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:12.656885 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702d418-c6a3-4113-bb1c-61d47bc5d97c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:12.666520 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5702d418-c6a3-4113-bb1c-61d47bc5d97c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:12.668028 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5702d418-c6a3-4113-bb1c-61d47bc5d97c service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:12.681908 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 717/1439] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:11:12.682816 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5702d418-c6a3-4113-bb1c-61d47bc5d97c service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:12.684285 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5702d418-c6a3-4113-bb1c-61d47bc5d97c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:12.685514 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 723/1440] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:11:12 2022] POST /identity/v3/users => generated 300 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:11:12.686430 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62ef2d-9176-486e-977a-6dcad745ea44 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:12.699392 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62ef2d-9176-486e-977a-6dcad745ea44 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:12.705262 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f3374-f323-424a-a491-1e5eb1ab1d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:12.708351 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5702d418-c6a3-4113-bb1c-61d47bc5d97c service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:12.709905 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f3374-f323-424a-a491-1e5eb1ab1d62 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:12.710196 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f3374-f323-424a-a491-1e5eb1ab1d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:12.710471 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f3374-f323-424a-a491-1e5eb1ab1d62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:12.711140 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382f3374-f323-424a-a491-1e5eb1ab1d62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:12.715257 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382f3374-f323-424a-a491-1e5eb1ab1d62 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:12.717608 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc35072-c802-43d3-940e-5223b271008f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:12.721830 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc35072-c802-43d3-940e-5223b271008f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:12.721830 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc35072-c802-43d3-940e-5223b271008f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:12.721830 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc35072-c802-43d3-940e-5223b271008f admin admin] PATH_INFO: `/v3/projects/ce7a0ac8b0f841c28abe07992124c63e` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:12.722407 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc35072-c802-43d3-940e-5223b271008f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce7a0ac8b0f841c28abe07992124c63e)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:12.724954 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc35072-c802-43d3-940e-5223b271008f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:12.744038 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:12.746612 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 724/1441] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:12.753630 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f3374-f323-424a-a491-1e5eb1ab1d62 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:12.763748 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f3374-f323-424a-a491-1e5eb1ab1d62 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:12.769304 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2093e-5690-4ff9-b7e2-05f783bb0cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:12.770366 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2093e-5690-4ff9-b7e2-05f783bb0cb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:12.770366 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2093e-5690-4ff9-b7e2-05f783bb0cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:12.770685 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2093e-5690-4ff9-b7e2-05f783bb0cb9 admin admin] PATH_INFO: `/v3/projects/2da66f06fe7444469d51672dda75e39b/users/75da8f2c8c35446e9694fdbb4bb6c43b/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:12.787612 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c2093e-5690-4ff9-b7e2-05f783bb0cb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2da66f06fe7444469d51672dda75e39b, user_id=75da8f2c8c35446e9694fdbb4bb6c43b, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:12.790377 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c2093e-5690-4ff9-b7e2-05f783bb0cb9 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:12.870519 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 725/1442] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:12 2022] PUT /identity/v3/projects/2da66f06fe7444469d51672dda75e39b/users/75da8f2c8c35446e9694fdbb4bb6c43b/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:12.871367 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2093e-5690-4ff9-b7e2-05f783bb0cb9 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:12.873908 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-57c2093e-5690-4ff9-b7e2-05f783bb0cb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:12.904162 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-bbc35072-c802-43d3-940e-5223b271008f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce7a0ac8b0f841c28abe07992124c63e', 'request_id': 'req-bbc35072-c802-43d3-940e-5223b271008f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:12.912337 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-bbc35072-c802-43d3-940e-5223b271008f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce7a0ac8b0f841c28abe07992124c63e', 'request_id': 'req-bbc35072-c802-43d3-940e-5223b271008f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:12.943415 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2093e-5690-4ff9-b7e2-05f783bb0cb9 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:12.995320 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-bbc35072-c802-43d3-940e-5223b271008f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce7a0ac8b0f841c28abe07992124c63e', 'request_id': 'req-bbc35072-c802-43d3-940e-5223b271008f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:13.010231 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-bbc35072-c802-43d3-940e-5223b271008f admin admin] The token cache is being invalidate because project ce7a0ac8b0f841c28abe07992124c63e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:11:13.010676 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-bbc35072-c802-43d3-940e-5223b271008f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:13.010819 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f8bf6-233c-40a0-9f9e-087604434560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:13.011359 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-bbc35072-c802-43d3-940e-5223b271008f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:13.012364 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f8bf6-233c-40a0-9f9e-087604434560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:13.012863 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f8bf6-233c-40a0-9f9e-087604434560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:13.013398 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f8bf6-233c-40a0-9f9e-087604434560 admin admin] PATH_INFO: `/v3/users/3b34a4129e834125933ecaee4ccf099b` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:13.013506 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 718/1443] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:11:12 2022] DELETE /identity/v3/projects/ce7a0ac8b0f841c28abe07992124c63e => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:13.014275 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc35072-c802-43d3-940e-5223b271008f admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:13.015384 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f8bf6-233c-40a0-9f9e-087604434560 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b34a4129e834125933ecaee4ccf099b)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:13.015719 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-bbc35072-c802-43d3-940e-5223b271008f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:13.018711 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f8bf6-233c-40a0-9f9e-087604434560 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:13.044384 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc35072-c802-43d3-940e-5223b271008f admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:13.055810 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76fdee5-0f20-4f37-96c2-f58251cb2713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:13.056575 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fdee5-0f20-4f37-96c2-f58251cb2713 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:13.056864 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fdee5-0f20-4f37-96c2-f58251cb2713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:13.057183 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fdee5-0f20-4f37-96c2-f58251cb2713 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:13.057891 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76fdee5-0f20-4f37-96c2-f58251cb2713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:13.059619 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76fdee5-0f20-4f37-96c2-f58251cb2713 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:13.072363 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 719/1444] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:13.073060 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76fdee5-0f20-4f37-96c2-f58251cb2713 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:13.077088 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b76fdee5-0f20-4f37-96c2-f58251cb2713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:13.092095 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76fdee5-0f20-4f37-96c2-f58251cb2713 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:13.098924 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bff269-aac1-4bac-ab3f-ff31153e34e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:13.099602 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bff269-aac1-4bac-ab3f-ff31153e34e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:13.099942 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bff269-aac1-4bac-ab3f-ff31153e34e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:13.100270 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bff269-aac1-4bac-ab3f-ff31153e34e7 admin admin] PATH_INFO: `/v3/users/47e8c5f1ff744e9081594655ad7c3fe9` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:13.104160 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bff269-aac1-4bac-ab3f-ff31153e34e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47e8c5f1ff744e9081594655ad7c3fe9)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:13.106509 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bff269-aac1-4bac-ab3f-ff31153e34e7 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:13.378421 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-195f8bf6-233c-40a0-9f9e-087604434560 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b34a4129e834125933ecaee4ccf099b'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:13.501618 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d9bff269-aac1-4bac-ab3f-ff31153e34e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47e8c5f1ff744e9081594655ad7c3fe9'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:13.525139 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-195f8bf6-233c-40a0-9f9e-087604434560 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b34a4129e834125933ecaee4ccf099b'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:13.553724 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-195f8bf6-233c-40a0-9f9e-087604434560 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b34a4129e834125933ecaee4ccf099b'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:13.553724 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-195f8bf6-233c-40a0-9f9e-087604434560 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b34a4129e834125933ecaee4ccf099b'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:13.563243 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-195f8bf6-233c-40a0-9f9e-087604434560 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b34a4129e834125933ecaee4ccf099b'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:13.574485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 726/1445] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:11:12 2022] DELETE /identity/v3/users/3b34a4129e834125933ecaee4ccf099b => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:13.576927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f8bf6-233c-40a0-9f9e-087604434560 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:13.578480 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-195f8bf6-233c-40a0-9f9e-087604434560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:13.653798 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f8bf6-233c-40a0-9f9e-087604434560 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:13.658664 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66981e-7c59-4940-9b51-149bbd6ab446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:13.659562 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66981e-7c59-4940-9b51-149bbd6ab446 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:13.660154 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66981e-7c59-4940-9b51-149bbd6ab446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:13.660446 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66981e-7c59-4940-9b51-149bbd6ab446 admin admin] PATH_INFO: `/v3/projects/2da66f06fe7444469d51672dda75e39b/users/75da8f2c8c35446e9694fdbb4bb6c43b/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:13.661562 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d9bff269-aac1-4bac-ab3f-ff31153e34e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47e8c5f1ff744e9081594655ad7c3fe9'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:13.662970 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c66981e-7c59-4940-9b51-149bbd6ab446 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2da66f06fe7444469d51672dda75e39b, user_id=75da8f2c8c35446e9694fdbb4bb6c43b, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:13.665687 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c66981e-7c59-4940-9b51-149bbd6ab446 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:13.684236 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 727/1446] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:13 2022] PUT /identity/v3/projects/2da66f06fe7444469d51672dda75e39b/users/75da8f2c8c35446e9694fdbb4bb6c43b/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:13.684236 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66981e-7c59-4940-9b51-149bbd6ab446 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:13.688871 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-4c66981e-7c59-4940-9b51-149bbd6ab446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:13.691598 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d9bff269-aac1-4bac-ab3f-ff31153e34e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47e8c5f1ff744e9081594655ad7c3fe9'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:13.702237 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d9bff269-aac1-4bac-ab3f-ff31153e34e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47e8c5f1ff744e9081594655ad7c3fe9'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:13.703211 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d9bff269-aac1-4bac-ab3f-ff31153e34e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47e8c5f1ff744e9081594655ad7c3fe9'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:13.715878 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 720/1447] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:11:13 2022] DELETE /identity/v3/users/47e8c5f1ff744e9081594655ad7c3fe9 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:13.717785 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8d089-bd93-47f3-876e-84a984de957d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:13.718166 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8d089-bd93-47f3-876e-84a984de957d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:13.718544 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8d089-bd93-47f3-876e-84a984de957d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:13.741892 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-aab8d089-bd93-47f3-876e-84a984de957d None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:13.743636 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-aab8d089-bd93-47f3-876e-84a984de957d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:13.813882 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66981e-7c59-4940-9b51-149bbd6ab446 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:13.824989 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 721/1448] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:13.826182 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb1300-61b3-4de6-b3f2-7c15ebc545b4 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:13.826467 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb1300-61b3-4de6-b3f2-7c15ebc545b4 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:13.826742 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb1300-61b3-4de6-b3f2-7c15ebc545b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:13.857705 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-15eb1300-61b3-4de6-b3f2-7c15ebc545b4 None None] MFA Rules not processed for user `75da8f2c8c35446e9694fdbb4bb6c43b`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:13.858970 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-15eb1300-61b3-4de6-b3f2-7c15ebc545b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:13.864537 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:13.901231 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd22bcc-272b-4fc0-9378-1d711bc5fde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:13.902071 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd22bcc-272b-4fc0-9378-1d711bc5fde7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:13.902356 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd22bcc-272b-4fc0-9378-1d711bc5fde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:13.902631 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd22bcc-272b-4fc0-9378-1d711bc5fde7 admin admin] PATH_INFO: `/v3/projects/1e9b0320355b4ecd9ed0ce682c6feca1` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:13.904027 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd22bcc-272b-4fc0-9378-1d711bc5fde7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e9b0320355b4ecd9ed0ce682c6feca1)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:13.906144 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd22bcc-272b-4fc0-9378-1d711bc5fde7 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:13.981324 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 722/1449] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:13 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:13.981324 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb1300-61b3-4de6-b3f2-7c15ebc545b4 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:13.981324 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-15eb1300-61b3-4de6-b3f2-7c15ebc545b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:14.055672 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb1300-61b3-4de6-b3f2-7c15ebc545b4 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:14.055672 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd2ce8-1a65-487f-90c2-997857cc419d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:14.055672 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd2ce8-1a65-487f-90c2-997857cc419d service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:14.055672 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd2ce8-1a65-487f-90c2-997857cc419d service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:14.056160 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd2ce8-1a65-487f-90c2-997857cc419d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:14.066464 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd2ce8-1a65-487f-90c2-997857cc419d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:14.068180 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd2ce8-1a65-487f-90c2-997857cc419d service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:14.080258 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 723/1450] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:14.081465 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd2ce8-1a65-487f-90c2-997857cc419d service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:14.082907 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-75fd2ce8-1a65-487f-90c2-997857cc419d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:14.159208 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-7cd22bcc-272b-4fc0-9378-1d711bc5fde7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e9b0320355b4ecd9ed0ce682c6feca1', 'request_id': 'req-7cd22bcc-272b-4fc0-9378-1d711bc5fde7'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:14.171690 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd2ce8-1a65-487f-90c2-997857cc419d service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:14.260715 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca53f9-1d1a-4920-85ec-50d857447cba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:14.261776 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca53f9-1d1a-4920-85ec-50d857447cba service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:14.261776 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca53f9-1d1a-4920-85ec-50d857447cba service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:14.262180 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca53f9-1d1a-4920-85ec-50d857447cba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:14.315449 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-7cd22bcc-272b-4fc0-9378-1d711bc5fde7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e9b0320355b4ecd9ed0ce682c6feca1', 'request_id': 'req-7cd22bcc-272b-4fc0-9378-1d711bc5fde7'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:14.324422 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-7cd22bcc-272b-4fc0-9378-1d711bc5fde7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e9b0320355b4ecd9ed0ce682c6feca1', 'request_id': 'req-7cd22bcc-272b-4fc0-9378-1d711bc5fde7'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:14.338659 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-7cd22bcc-272b-4fc0-9378-1d711bc5fde7 admin admin] The token cache is being invalidate because project 1e9b0320355b4ecd9ed0ce682c6feca1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:11:14.338833 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-7cd22bcc-272b-4fc0-9378-1d711bc5fde7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:14.340099 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-7cd22bcc-272b-4fc0-9378-1d711bc5fde7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:14.342670 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 728/1451] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:11:13 2022] DELETE /identity/v3/projects/1e9b0320355b4ecd9ed0ce682c6feca1 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:14.347209 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd22bcc-272b-4fc0-9378-1d711bc5fde7 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:14.351179 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-7cd22bcc-272b-4fc0-9378-1d711bc5fde7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:14.371056 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca53f9-1d1a-4920-85ec-50d857447cba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:14.372862 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca53f9-1d1a-4920-85ec-50d857447cba service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:14.386105 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 724/1452] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:14 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:14.450935 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca53f9-1d1a-4920-85ec-50d857447cba service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:14.452895 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd22bcc-272b-4fc0-9378-1d711bc5fde7 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:14.453895 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-14ca53f9-1d1a-4920-85ec-50d857447cba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:14.470849 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca53f9-1d1a-4920-85ec-50d857447cba service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:14.472165 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e0764-665c-49e8-bc16-a4b7d4aa4379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:14.472829 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e0764-665c-49e8-bc16-a4b7d4aa4379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:14.473708 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e0764-665c-49e8-bc16-a4b7d4aa4379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:14.473708 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e0764-665c-49e8-bc16-a4b7d4aa4379 admin admin] PATH_INFO: `/v3/users/5e9b9d95386c477abfe11a10e88d93c8` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:14.475395 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397e0764-665c-49e8-bc16-a4b7d4aa4379 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e9b9d95386c477abfe11a10e88d93c8)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:14.477360 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397e0764-665c-49e8-bc16-a4b7d4aa4379 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:14.486390 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d3016-8399-482f-a21a-dd3c55f7f86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:14.486970 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d3016-8399-482f-a21a-dd3c55f7f86f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:14.488102 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d3016-8399-482f-a21a-dd3c55f7f86f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:14.488618 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d3016-8399-482f-a21a-dd3c55f7f86f admin admin] PATH_INFO: `/v3/users/ebab267e4b9248f189ac0df85c6bdc9f` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:14.492220 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d3016-8399-482f-a21a-dd3c55f7f86f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebab267e4b9248f189ac0df85c6bdc9f)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:14.497217 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d3016-8399-482f-a21a-dd3c55f7f86f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:14.783092 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f08d3016-8399-482f-a21a-dd3c55f7f86f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebab267e4b9248f189ac0df85c6bdc9f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:14.812137 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-397e0764-665c-49e8-bc16-a4b7d4aa4379 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e9b9d95386c477abfe11a10e88d93c8'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:15.869199 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f08d3016-8399-482f-a21a-dd3c55f7f86f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebab267e4b9248f189ac0df85c6bdc9f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:15.897329 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f08d3016-8399-482f-a21a-dd3c55f7f86f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebab267e4b9248f189ac0df85c6bdc9f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:15.910583 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f08d3016-8399-482f-a21a-dd3c55f7f86f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebab267e4b9248f189ac0df85c6bdc9f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:15.914007 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f08d3016-8399-482f-a21a-dd3c55f7f86f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebab267e4b9248f189ac0df85c6bdc9f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:15.925469 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 725/1453] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:11:14 2022] DELETE /identity/v3/users/ebab267e4b9248f189ac0df85c6bdc9f => generated 0 bytes in 1474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:15.925469 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d3016-8399-482f-a21a-dd3c55f7f86f admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:15.929849 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f08d3016-8399-482f-a21a-dd3c55f7f86f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:15.961097 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-397e0764-665c-49e8-bc16-a4b7d4aa4379 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e9b9d95386c477abfe11a10e88d93c8'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:15.977098 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-397e0764-665c-49e8-bc16-a4b7d4aa4379 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e9b9d95386c477abfe11a10e88d93c8'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:15.977830 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-397e0764-665c-49e8-bc16-a4b7d4aa4379 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e9b9d95386c477abfe11a10e88d93c8'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:15.986392 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-397e0764-665c-49e8-bc16-a4b7d4aa4379 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e9b9d95386c477abfe11a10e88d93c8'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:15.993051 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 729/1454] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:11:14 2022] DELETE /identity/v3/users/5e9b9d95386c477abfe11a10e88d93c8 => generated 0 bytes in 1647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:15.994190 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e0764-665c-49e8-bc16-a4b7d4aa4379 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:15.995727 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-397e0764-665c-49e8-bc16-a4b7d4aa4379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:15.997142 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d3016-8399-482f-a21a-dd3c55f7f86f admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:16.059088 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408d991-e6c5-47f1-9f62-e96a759b6626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:16.059845 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408d991-e6c5-47f1-9f62-e96a759b6626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:16.060225 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408d991-e6c5-47f1-9f62-e96a759b6626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:16.060564 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408d991-e6c5-47f1-9f62-e96a759b6626 admin admin] PATH_INFO: `/v3/projects/856d7ec13a4c422fa730fe355c9dede6` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:16.061783 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408d991-e6c5-47f1-9f62-e96a759b6626 admin admin] RBAC: Authorizing `identity:delete_project(project_id=856d7ec13a4c422fa730fe355c9dede6)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:16.063807 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408d991-e6c5-47f1-9f62-e96a759b6626 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:16.064506 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e0764-665c-49e8-bc16-a4b7d4aa4379 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:16.069489 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1cc87f-5c43-4d1c-9e38-c69f0487dbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:16.070134 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cc87f-5c43-4d1c-9e38-c69f0487dbf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:16.070431 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cc87f-5c43-4d1c-9e38-c69f0487dbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:16.070691 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cc87f-5c43-4d1c-9e38-c69f0487dbf3 admin admin] PATH_INFO: `/v3/projects/c0542bd44d334f10a8e7042880d0887b` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:16.072133 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1cc87f-5c43-4d1c-9e38-c69f0487dbf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0542bd44d334f10a8e7042880d0887b)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:16.074050 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1cc87f-5c43-4d1c-9e38-c69f0487dbf3 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:16.222616 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-2408d991-e6c5-47f1-9f62-e96a759b6626 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '856d7ec13a4c422fa730fe355c9dede6', 'request_id': 'req-2408d991-e6c5-47f1-9f62-e96a759b6626'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:16.232873 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-2408d991-e6c5-47f1-9f62-e96a759b6626 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '856d7ec13a4c422fa730fe355c9dede6', 'request_id': 'req-2408d991-e6c5-47f1-9f62-e96a759b6626'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:16.264430 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-fb1cc87f-5c43-4d1c-9e38-c69f0487dbf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0542bd44d334f10a8e7042880d0887b', 'request_id': 'req-fb1cc87f-5c43-4d1c-9e38-c69f0487dbf3'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:16.332791 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-2408d991-e6c5-47f1-9f62-e96a759b6626 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '856d7ec13a4c422fa730fe355c9dede6', 'request_id': 'req-2408d991-e6c5-47f1-9f62-e96a759b6626'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:16.355259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-2408d991-e6c5-47f1-9f62-e96a759b6626 admin admin] The token cache is being invalidate because project 856d7ec13a4c422fa730fe355c9dede6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:11:16.358794 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-2408d991-e6c5-47f1-9f62-e96a759b6626 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:16.358794 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-2408d991-e6c5-47f1-9f62-e96a759b6626 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:16.358794 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 726/1455] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:11:15 2022] DELETE /identity/v3/projects/856d7ec13a4c422fa730fe355c9dede6 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:16.360243 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90160c-4b9b-4d8a-b79a-4fdea35c0f95 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:16.360347 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90160c-4b9b-4d8a-b79a-4fdea35c0f95 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:16.360667 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90160c-4b9b-4d8a-b79a-4fdea35c0f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:16.383776 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-4e90160c-4b9b-4d8a-b79a-4fdea35c0f95 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:16.385385 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4e90160c-4b9b-4d8a-b79a-4fdea35c0f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:16.464203 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 727/1456] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:16.465767 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f83251-8961-4985-9aba-a1f4537125d3 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:16.467501 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f83251-8961-4985-9aba-a1f4537125d3 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:16.467501 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f83251-8961-4985-9aba-a1f4537125d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:16.490598 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-82f83251-8961-4985-9aba-a1f4537125d3 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:16.491855 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-82f83251-8961-4985-9aba-a1f4537125d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:16.501199 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 728/1457] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:16.508809 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f83251-8961-4985-9aba-a1f4537125d3 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:16.508809 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-82f83251-8961-4985-9aba-a1f4537125d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:16.521426 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-fb1cc87f-5c43-4d1c-9e38-c69f0487dbf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0542bd44d334f10a8e7042880d0887b', 'request_id': 'req-fb1cc87f-5c43-4d1c-9e38-c69f0487dbf3'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:16.529091 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-fb1cc87f-5c43-4d1c-9e38-c69f0487dbf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0542bd44d334f10a8e7042880d0887b', 'request_id': 'req-fb1cc87f-5c43-4d1c-9e38-c69f0487dbf3'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:16.556004 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-fb1cc87f-5c43-4d1c-9e38-c69f0487dbf3 admin admin] The token cache is being invalidate because project c0542bd44d334f10a8e7042880d0887b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:11:16.556282 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-fb1cc87f-5c43-4d1c-9e38-c69f0487dbf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:16.557896 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-fb1cc87f-5c43-4d1c-9e38-c69f0487dbf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:16.561388 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 730/1458] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:11:15 2022] DELETE /identity/v3/projects/c0542bd44d334f10a8e7042880d0887b => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:16.565157 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5372cf-5c3a-46b8-a931-fec32b3cf8f9 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:16.565498 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5372cf-5c3a-46b8-a931-fec32b3cf8f9 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:16.565782 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5372cf-5c3a-46b8-a931-fec32b3cf8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:16.599824 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-ac5372cf-5c3a-46b8-a931-fec32b3cf8f9 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:16.608750 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-ac5372cf-5c3a-46b8-a931-fec32b3cf8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:16.622707 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 731/1459] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:16.623822 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5372cf-5c3a-46b8-a931-fec32b3cf8f9 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:16.625455 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-ac5372cf-5c3a-46b8-a931-fec32b3cf8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:16.638731 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5372cf-5c3a-46b8-a931-fec32b3cf8f9 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:16.651485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fe1c9-b07b-4d4d-abbb-e8cbb6525244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:16.652455 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fe1c9-b07b-4d4d-abbb-e8cbb6525244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:16.653291 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fe1c9-b07b-4d4d-abbb-e8cbb6525244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:16.653674 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fe1c9-b07b-4d4d-abbb-e8cbb6525244 admin admin] PATH_INFO: `/v3/users/d7bf876584c24aa0a0151ea99a3a7b2d` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:16.659238 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510fe1c9-b07b-4d4d-abbb-e8cbb6525244 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7bf876584c24aa0a0151ea99a3a7b2d)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:16.662353 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510fe1c9-b07b-4d4d-abbb-e8cbb6525244 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:16.662890 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f83251-8961-4985-9aba-a1f4537125d3 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:16.677668 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e8252-d03e-4260-908f-888ade0e36ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:16.678612 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e8252-d03e-4260-908f-888ade0e36ac service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:16.679042 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e8252-d03e-4260-908f-888ade0e36ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:16.679479 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e8252-d03e-4260-908f-888ade0e36ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:16.682573 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-629e8252-d03e-4260-908f-888ade0e36ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:16.703181 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e8252-d03e-4260-908f-888ade0e36ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:16.706575 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e8252-d03e-4260-908f-888ade0e36ac service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:16.728127 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 729/1460] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:16.729649 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e8252-d03e-4260-908f-888ade0e36ac service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:16.740082 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e8252-d03e-4260-908f-888ade0e36ac service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:16.746400 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4379849-28b3-4193-808b-43771d527606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:16.747047 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4379849-28b3-4193-808b-43771d527606 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:16.747330 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4379849-28b3-4193-808b-43771d527606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:16.747603 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4379849-28b3-4193-808b-43771d527606 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:16.748409 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4379849-28b3-4193-808b-43771d527606 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:11:16.748713 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4379849-28b3-4193-808b-43771d527606 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:16.751427 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4379849-28b3-4193-808b-43771d527606 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:16.765224 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 730/1461] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:11:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:11:16.766233 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4379849-28b3-4193-808b-43771d527606 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:16.768781 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f4379849-28b3-4193-808b-43771d527606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:16.788480 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4379849-28b3-4193-808b-43771d527606 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:16.795937 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb07e36-9324-4b09-9d41-bdfaaf1ecc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:16.795937 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb07e36-9324-4b09-9d41-bdfaaf1ecc9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:16.795937 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb07e36-9324-4b09-9d41-bdfaaf1ecc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:16.795937 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb07e36-9324-4b09-9d41-bdfaaf1ecc9e admin admin] PATH_INFO: `/v3/projects/4304eae9b0d749e9bf3e545a90bb3bdb` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:16.797536 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb07e36-9324-4b09-9d41-bdfaaf1ecc9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4304eae9b0d749e9bf3e545a90bb3bdb)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:16.799628 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb07e36-9324-4b09-9d41-bdfaaf1ecc9e admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:16.914669 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-510fe1c9-b07b-4d4d-abbb-e8cbb6525244 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7bf876584c24aa0a0151ea99a3a7b2d'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:16.978424 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-8fb07e36-9324-4b09-9d41-bdfaaf1ecc9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4304eae9b0d749e9bf3e545a90bb3bdb', 'request_id': 'req-8fb07e36-9324-4b09-9d41-bdfaaf1ecc9e'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:16.991219 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-8fb07e36-9324-4b09-9d41-bdfaaf1ecc9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4304eae9b0d749e9bf3e545a90bb3bdb', 'request_id': 'req-8fb07e36-9324-4b09-9d41-bdfaaf1ecc9e'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:17.035468 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-510fe1c9-b07b-4d4d-abbb-e8cbb6525244 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7bf876584c24aa0a0151ea99a3a7b2d'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:17.049401 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-510fe1c9-b07b-4d4d-abbb-e8cbb6525244 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7bf876584c24aa0a0151ea99a3a7b2d'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:17.050121 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-510fe1c9-b07b-4d4d-abbb-e8cbb6525244 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7bf876584c24aa0a0151ea99a3a7b2d'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:17.058054 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-510fe1c9-b07b-4d4d-abbb-e8cbb6525244 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7bf876584c24aa0a0151ea99a3a7b2d'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:17.065462 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 732/1462] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:11:16 2022] DELETE /identity/v3/users/d7bf876584c24aa0a0151ea99a3a7b2d => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:17.066558 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fe1c9-b07b-4d4d-abbb-e8cbb6525244 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:17.068761 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-510fe1c9-b07b-4d4d-abbb-e8cbb6525244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:17.147804 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fe1c9-b07b-4d4d-abbb-e8cbb6525244 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:17.150990 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7927d54f-d6f5-4792-b674-e703021fe364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:17.151747 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927d54f-d6f5-4792-b674-e703021fe364 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:17.152094 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927d54f-d6f5-4792-b674-e703021fe364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:17.152398 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927d54f-d6f5-4792-b674-e703021fe364 admin admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:17.153090 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7927d54f-d6f5-4792-b674-e703021fe364 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:17.155185 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7927d54f-d6f5-4792-b674-e703021fe364 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:17.162235 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:17.163227 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-8fb07e36-9324-4b09-9d41-bdfaaf1ecc9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4304eae9b0d749e9bf3e545a90bb3bdb', 'request_id': 'req-8fb07e36-9324-4b09-9d41-bdfaaf1ecc9e'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:17.177779 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-8fb07e36-9324-4b09-9d41-bdfaaf1ecc9e admin admin] The token cache is being invalidate because project 4304eae9b0d749e9bf3e545a90bb3bdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:11:17.178219 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-8fb07e36-9324-4b09-9d41-bdfaaf1ecc9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:17.178906 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-8fb07e36-9324-4b09-9d41-bdfaaf1ecc9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:17.186216 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 731/1463] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:11:16 2022] DELETE /identity/v3/projects/4304eae9b0d749e9bf3e545a90bb3bdb => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:17.188942 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565d61e-d87b-42eb-bb35-9632bddc0bdd None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:17.189233 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565d61e-d87b-42eb-bb35-9632bddc0bdd None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:17.189514 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565d61e-d87b-42eb-bb35-9632bddc0bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:17.220273 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-3565d61e-d87b-42eb-bb35-9632bddc0bdd None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:17.221691 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3565d61e-d87b-42eb-bb35-9632bddc0bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:17.232562 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 732/1464] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:17.240710 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857a3e4-79ea-4ad2-b6b4-ecf0371265ba None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:17.240999 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857a3e4-79ea-4ad2-b6b4-ecf0371265ba None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:17.241278 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857a3e4-79ea-4ad2-b6b4-ecf0371265ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:17.261106 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-1857a3e4-79ea-4ad2-b6b4-ecf0371265ba None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:17.262327 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1857a3e4-79ea-4ad2-b6b4-ecf0371265ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:17.270893 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 733/1465] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:11:17.274929 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857a3e4-79ea-4ad2-b6b4-ecf0371265ba None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:17.284937 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857a3e4-79ea-4ad2-b6b4-ecf0371265ba None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:17.289856 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a81e4b-bf74-490a-867b-4ec93e43ca25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:17.291218 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a81e4b-bf74-490a-867b-4ec93e43ca25 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:17.291218 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a81e4b-bf74-490a-867b-4ec93e43ca25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:17.291218 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a81e4b-bf74-490a-867b-4ec93e43ca25 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:17.291974 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a81e4b-bf74-490a-867b-4ec93e43ca25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:11:17.292386 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a81e4b-bf74-490a-867b-4ec93e43ca25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:17.294558 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a81e4b-bf74-490a-867b-4ec93e43ca25 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:17.312353 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 734/1466] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:11:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 11:11:17.316629 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a81e4b-bf74-490a-867b-4ec93e43ca25 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:17.331627 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 733/1467] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:11:17 2022] POST /identity/v3/projects => generated 399 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:17.333052 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7927d54f-d6f5-4792-b674-e703021fe364 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:17.335016 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-7927d54f-d6f5-4792-b674-e703021fe364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:17.341630 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a81e4b-bf74-490a-867b-4ec93e43ca25 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:17.419592 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fc368-66c4-4f45-91a7-6cc40554c0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:17.419991 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fc368-66c4-4f45-91a7-6cc40554c0c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:17.420313 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fc368-66c4-4f45-91a7-6cc40554c0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:17.420595 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fc368-66c4-4f45-91a7-6cc40554c0c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:17.421280 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1fc368-66c4-4f45-91a7-6cc40554c0c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:17.423020 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7927d54f-d6f5-4792-b674-e703021fe364 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:17.424896 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1fc368-66c4-4f45-91a7-6cc40554c0c4 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:17.451408 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a3455-f857-4a08-aab6-ec0ce187af59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:17.452548 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a3455-f857-4a08-aab6-ec0ce187af59 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:17.452839 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a3455-f857-4a08-aab6-ec0ce187af59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:17.453125 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a3455-f857-4a08-aab6-ec0ce187af59 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:17.453953 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a3455-f857-4a08-aab6-ec0ce187af59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:17.456265 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a3455-f857-4a08-aab6-ec0ce187af59 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:17.588958 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 735/1468] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:11:17 2022] POST /identity/v3/projects => generated 361 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:17.594098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fc368-66c4-4f45-91a7-6cc40554c0c4 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:17.657972 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 734/1469] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:11:17 2022] POST /identity/v3/users => generated 300 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:17.658148 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fc368-66c4-4f45-91a7-6cc40554c0c4 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:17.659059 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a3455-f857-4a08-aab6-ec0ce187af59 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:17.662769 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431d5ea-a5d3-4cff-a8a4-2b982cd68b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:17.663522 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431d5ea-a5d3-4cff-a8a4-2b982cd68b1e admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:17.663893 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431d5ea-a5d3-4cff-a8a4-2b982cd68b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:17.664392 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431d5ea-a5d3-4cff-a8a4-2b982cd68b1e admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:17.665118 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431d5ea-a5d3-4cff-a8a4-2b982cd68b1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:17.667234 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431d5ea-a5d3-4cff-a8a4-2b982cd68b1e admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:17.670531 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a3455-f857-4a08-aab6-ec0ce187af59 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:17.676109 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb5597-caec-4589-9435-a7c6d4e8d190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:17.676911 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb5597-caec-4589-9435-a7c6d4e8d190 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:17.677417 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb5597-caec-4589-9435-a7c6d4e8d190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:17.677691 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb5597-caec-4589-9435-a7c6d4e8d190 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:17.678348 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb5597-caec-4589-9435-a7c6d4e8d190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:17.679979 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb5597-caec-4589-9435-a7c6d4e8d190 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:17.691315 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 735/1470] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:17.695602 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb5597-caec-4589-9435-a7c6d4e8d190 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:17.705436 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb5597-caec-4589-9435-a7c6d4e8d190 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:17.710670 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e973231-6fa0-4201-82c1-fee7058630af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:17.711265 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e973231-6fa0-4201-82c1-fee7058630af admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:17.711546 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e973231-6fa0-4201-82c1-fee7058630af admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:17.711863 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e973231-6fa0-4201-82c1-fee7058630af admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:17.712532 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e973231-6fa0-4201-82c1-fee7058630af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:17.714269 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e973231-6fa0-4201-82c1-fee7058630af admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:17.729430 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 736/1471] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:11:17.730430 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e973231-6fa0-4201-82c1-fee7058630af admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:17.734100 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-8e973231-6fa0-4201-82c1-fee7058630af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:17.749256 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e973231-6fa0-4201-82c1-fee7058630af admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:17.754184 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a2bcf-ed57-45de-95f8-adaa1e39f621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:17.761572 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a2bcf-ed57-45de-95f8-adaa1e39f621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:17.761572 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a2bcf-ed57-45de-95f8-adaa1e39f621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:17.761572 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a2bcf-ed57-45de-95f8-adaa1e39f621 admin admin] PATH_INFO: `/v3/projects/671d396c09d74fc88fbc5eb358f02f90` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:17.761572 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a2bcf-ed57-45de-95f8-adaa1e39f621 admin admin] RBAC: Authorizing `identity:delete_project(project_id=671d396c09d74fc88fbc5eb358f02f90)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:17.761572 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a2bcf-ed57-45de-95f8-adaa1e39f621 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:17.837529 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 736/1472] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:11:17 2022] POST /identity/v3/users => generated 281 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:11:17.839104 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431d5ea-a5d3-4cff-a8a4-2b982cd68b1e admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:17.841541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c431d5ea-a5d3-4cff-a8a4-2b982cd68b1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:17.857407 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431d5ea-a5d3-4cff-a8a4-2b982cd68b1e admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:17.862424 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44b415-9796-4793-b40e-230c3336727b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:17.865220 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44b415-9796-4793-b40e-230c3336727b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:17.865220 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44b415-9796-4793-b40e-230c3336727b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:17.865220 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44b415-9796-4793-b40e-230c3336727b admin admin] PATH_INFO: `/v3/projects/abffeb351bc146edacd94a4a7604687a` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:17.866338 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44b415-9796-4793-b40e-230c3336727b admin admin] RBAC: Authorizing `identity:delete_project(project_id=abffeb351bc146edacd94a4a7604687a)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:17.868349 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44b415-9796-4793-b40e-230c3336727b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:17.915183 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-e50a2bcf-ed57-45de-95f8-adaa1e39f621 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '671d396c09d74fc88fbc5eb358f02f90', 'request_id': 'req-e50a2bcf-ed57-45de-95f8-adaa1e39f621'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:18.026968 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3d44b415-9796-4793-b40e-230c3336727b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abffeb351bc146edacd94a4a7604687a', 'request_id': 'req-3d44b415-9796-4793-b40e-230c3336727b'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:18.034269 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3d44b415-9796-4793-b40e-230c3336727b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abffeb351bc146edacd94a4a7604687a', 'request_id': 'req-3d44b415-9796-4793-b40e-230c3336727b'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:18.046139 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-e50a2bcf-ed57-45de-95f8-adaa1e39f621 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '671d396c09d74fc88fbc5eb358f02f90', 'request_id': 'req-e50a2bcf-ed57-45de-95f8-adaa1e39f621'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:18.174419 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-e50a2bcf-ed57-45de-95f8-adaa1e39f621 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '671d396c09d74fc88fbc5eb358f02f90', 'request_id': 'req-e50a2bcf-ed57-45de-95f8-adaa1e39f621'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:18.179184 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3d44b415-9796-4793-b40e-230c3336727b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abffeb351bc146edacd94a4a7604687a', 'request_id': 'req-3d44b415-9796-4793-b40e-230c3336727b'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:18.191469 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-e50a2bcf-ed57-45de-95f8-adaa1e39f621 admin admin] The token cache is being invalidate because project 671d396c09d74fc88fbc5eb358f02f90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:11:18.191737 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-e50a2bcf-ed57-45de-95f8-adaa1e39f621 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:18.192586 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-e50a2bcf-ed57-45de-95f8-adaa1e39f621 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:18.193794 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3d44b415-9796-4793-b40e-230c3336727b admin admin] The token cache is being invalidate because project abffeb351bc146edacd94a4a7604687a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:11:18.194195 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3d44b415-9796-4793-b40e-230c3336727b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:18.194936 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3d44b415-9796-4793-b40e-230c3336727b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:18.195053 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 737/1473] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:11:17 2022] DELETE /identity/v3/projects/671d396c09d74fc88fbc5eb358f02f90 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:18.198659 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a2bcf-ed57-45de-95f8-adaa1e39f621 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:18.199792 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 737/1474] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:11:17 2022] DELETE /identity/v3/projects/abffeb351bc146edacd94a4a7604687a => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:18.200685 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44b415-9796-4793-b40e-230c3336727b admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:18.200874 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-e50a2bcf-ed57-45de-95f8-adaa1e39f621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:18.202302 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3d44b415-9796-4793-b40e-230c3336727b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:18.273519 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a2bcf-ed57-45de-95f8-adaa1e39f621 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:18.274987 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44b415-9796-4793-b40e-230c3336727b admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:18.278502 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9febf94-98b8-4196-b3b5-c958b03ecd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:18.279174 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9febf94-98b8-4196-b3b5-c958b03ecd60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:18.279447 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9febf94-98b8-4196-b3b5-c958b03ecd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:18.279718 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9febf94-98b8-4196-b3b5-c958b03ecd60 admin admin] PATH_INFO: `/v3/projects/5a22609002534e7bad6ad60df4831535/users/d12855a5aa7b44618513f1a7f18e66a3/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:18.286389 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d20d11-e833-4ab1-a2b1-a2cf804b5d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:18.306854 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d20d11-e833-4ab1-a2b1-a2cf804b5d5c admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:18.306854 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d20d11-e833-4ab1-a2b1-a2cf804b5d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:18.306854 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d20d11-e833-4ab1-a2b1-a2cf804b5d5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:18.306854 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d20d11-e833-4ab1-a2b1-a2cf804b5d5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:18.306854 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d20d11-e833-4ab1-a2b1-a2cf804b5d5c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:18.307300 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9febf94-98b8-4196-b3b5-c958b03ecd60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a22609002534e7bad6ad60df4831535, user_id=d12855a5aa7b44618513f1a7f18e66a3, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:18.308639 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9febf94-98b8-4196-b3b5-c958b03ecd60 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:18.310071 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 738/1475] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:18.311314 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0168a6-e557-487e-81e2-678717bc909f None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:18.311602 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0168a6-e557-487e-81e2-678717bc909f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:18.311976 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0168a6-e557-487e-81e2-678717bc909f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:18.344797 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-ca0168a6-e557-487e-81e2-678717bc909f None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:18.346294 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ca0168a6-e557-487e-81e2-678717bc909f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:18.362417 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 739/1476] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:18.362417 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0168a6-e557-487e-81e2-678717bc909f None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:18.362417 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ca0168a6-e557-487e-81e2-678717bc909f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:18.373029 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0168a6-e557-487e-81e2-678717bc909f None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:18.378466 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0745a59-ffe9-4951-a6d5-c3ef4e8ec227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:18.379205 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0745a59-ffe9-4951-a6d5-c3ef4e8ec227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:18.379418 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0745a59-ffe9-4951-a6d5-c3ef4e8ec227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:18.379698 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0745a59-ffe9-4951-a6d5-c3ef4e8ec227 admin admin] PATH_INFO: `/v3/users/75da8f2c8c35446e9694fdbb4bb6c43b` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:18.381520 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0745a59-ffe9-4951-a6d5-c3ef4e8ec227 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75da8f2c8c35446e9694fdbb4bb6c43b)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:18.383494 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0745a59-ffe9-4951-a6d5-c3ef4e8ec227 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:18.417893 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 738/1477] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:18 2022] PUT /identity/v3/projects/5a22609002534e7bad6ad60df4831535/users/d12855a5aa7b44618513f1a7f18e66a3/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:18.419004 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9febf94-98b8-4196-b3b5-c958b03ecd60 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:18.488820 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9febf94-98b8-4196-b3b5-c958b03ecd60 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:18.493628 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486c7ed-9246-48c0-84aa-0fb1d4b18665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:18.495610 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486c7ed-9246-48c0-84aa-0fb1d4b18665 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:18.495610 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486c7ed-9246-48c0-84aa-0fb1d4b18665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:18.495610 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486c7ed-9246-48c0-84aa-0fb1d4b18665 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:18.495610 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486c7ed-9246-48c0-84aa-0fb1d4b18665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:18.497119 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486c7ed-9246-48c0-84aa-0fb1d4b18665 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:18.508858 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 739/1478] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:18.510104 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525e3fb-91d5-4fd8-b998-02afb33eee1e None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:18.510403 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525e3fb-91d5-4fd8-b998-02afb33eee1e None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:18.510669 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525e3fb-91d5-4fd8-b998-02afb33eee1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:18.530753 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-2525e3fb-91d5-4fd8-b998-02afb33eee1e None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:18.531992 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-2525e3fb-91d5-4fd8-b998-02afb33eee1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:18.539943 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 740/1479] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:18.541189 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e849a3-b5b9-4d25-a172-c597e7a353fc None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:18.541470 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e849a3-b5b9-4d25-a172-c597e7a353fc None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:18.541766 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e849a3-b5b9-4d25-a172-c597e7a353fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:18.572695 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-74e849a3-b5b9-4d25-a172-c597e7a353fc None None] MFA Rules not processed for user `d12855a5aa7b44618513f1a7f18e66a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:18.573942 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-74e849a3-b5b9-4d25-a172-c597e7a353fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:18.638150 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 741/1480] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:18 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:18.639118 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e849a3-b5b9-4d25-a172-c597e7a353fc None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:18.649166 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e849a3-b5b9-4d25-a172-c597e7a353fc None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:18.653687 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37763ccf-c963-4616-baac-97d7a40d1885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:18.654339 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37763ccf-c963-4616-baac-97d7a40d1885 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:18.654622 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37763ccf-c963-4616-baac-97d7a40d1885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:18.654890 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37763ccf-c963-4616-baac-97d7a40d1885 admin admin] PATH_INFO: `/v3/projects/a582294ed8404ac2bd0ac0ad53de54ac/users/2d4e54c2d4204fc889a1bc6d0c3b1763/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:18.675800 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-e0745a59-ffe9-4951-a6d5-c3ef4e8ec227 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75da8f2c8c35446e9694fdbb4bb6c43b'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:18.678528 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37763ccf-c963-4616-baac-97d7a40d1885 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a582294ed8404ac2bd0ac0ad53de54ac, user_id=2d4e54c2d4204fc889a1bc6d0c3b1763, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:18.681397 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37763ccf-c963-4616-baac-97d7a40d1885 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:18.785344 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-e0745a59-ffe9-4951-a6d5-c3ef4e8ec227 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75da8f2c8c35446e9694fdbb4bb6c43b'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:18.790900 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 742/1481] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:18 2022] PUT /identity/v3/projects/a582294ed8404ac2bd0ac0ad53de54ac/users/2d4e54c2d4204fc889a1bc6d0c3b1763/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:18.791203 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37763ccf-c963-4616-baac-97d7a40d1885 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:18.801458 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-e0745a59-ffe9-4951-a6d5-c3ef4e8ec227 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75da8f2c8c35446e9694fdbb4bb6c43b'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:18.809401 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-e0745a59-ffe9-4951-a6d5-c3ef4e8ec227 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75da8f2c8c35446e9694fdbb4bb6c43b'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:18.811019 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-e0745a59-ffe9-4951-a6d5-c3ef4e8ec227 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75da8f2c8c35446e9694fdbb4bb6c43b'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:18.820506 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 740/1482] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:11:18 2022] DELETE /identity/v3/users/75da8f2c8c35446e9694fdbb4bb6c43b => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:18.820506 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0745a59-ffe9-4951-a6d5-c3ef4e8ec227 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:18.820506 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e0745a59-ffe9-4951-a6d5-c3ef4e8ec227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:18.870356 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37763ccf-c963-4616-baac-97d7a40d1885 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:18.905765 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0745a59-ffe9-4951-a6d5-c3ef4e8ec227 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:18.910826 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cb552-fa59-440d-a6bb-7533c09dc4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:18.911997 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cb552-fa59-440d-a6bb-7533c09dc4ac admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:18.912320 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cb552-fa59-440d-a6bb-7533c09dc4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:18.912634 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cb552-fa59-440d-a6bb-7533c09dc4ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:18.913662 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749cb552-fa59-440d-a6bb-7533c09dc4ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:18.925485 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749cb552-fa59-440d-a6bb-7533c09dc4ac admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:18.933839 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2775c-28fd-4213-9f4c-16b774e3c035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:18.934386 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2775c-28fd-4213-9f4c-16b774e3c035 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:18.934670 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2775c-28fd-4213-9f4c-16b774e3c035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:18.934948 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2775c-28fd-4213-9f4c-16b774e3c035 admin admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:18.935630 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2775c-28fd-4213-9f4c-16b774e3c035 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:11:18.935932 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2775c-28fd-4213-9f4c-16b774e3c035 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:18.937574 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2775c-28fd-4213-9f4c-16b774e3c035 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:18.950253 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 743/1483] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:11:18.951377 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401250c5-ac9c-4cd3-8462-6c59ab2b2485 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:18.951674 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401250c5-ac9c-4cd3-8462-6c59ab2b2485 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:18.951951 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401250c5-ac9c-4cd3-8462-6c59ab2b2485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:18.980327 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-401250c5-ac9c-4cd3-8462-6c59ab2b2485 None None] MFA Rules not processed for user `2d4e54c2d4204fc889a1bc6d0c3b1763`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:18.981583 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-401250c5-ac9c-4cd3-8462-6c59ab2b2485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:19.031801 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:19.039782 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 741/1484] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:11:18 2022] POST /identity/v3/projects => generated 401 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:19.041706 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682a1fe-3be1-4c92-bf86-54ada1583c5a None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:19.042192 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682a1fe-3be1-4c92-bf86-54ada1583c5a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:19.042619 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682a1fe-3be1-4c92-bf86-54ada1583c5a None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:19.049259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 742/1485] 10.222.0.45 () {54 vars in 921 bytes} [Wed Oct 26 11:11:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:11:19.050476 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682a1fe-3be1-4c92-bf86-54ada1583c5a None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:19.053729 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0682a1fe-3be1-4c92-bf86-54ada1583c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:19.060924 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 744/1486] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:19.061761 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401250c5-ac9c-4cd3-8462-6c59ab2b2485 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:19.077059 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401250c5-ac9c-4cd3-8462-6c59ab2b2485 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:19.169959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682a1fe-3be1-4c92-bf86-54ada1583c5a None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:19.176361 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb673355-abda-4d06-b33c-4f7d569365a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:19.176987 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb673355-abda-4d06-b33c-4f7d569365a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:19.177377 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb673355-abda-4d06-b33c-4f7d569365a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:19.178377 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb673355-abda-4d06-b33c-4f7d569365a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:19.178377 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb673355-abda-4d06-b33c-4f7d569365a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:19.180557 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb673355-abda-4d06-b33c-4f7d569365a0 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:19.201753 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df97a79f-e984-4c2e-be1e-d47e314a4428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:19.202378 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97a79f-e984-4c2e-be1e-d47e314a4428 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:19.202650 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97a79f-e984-4c2e-be1e-d47e314a4428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:19.202927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97a79f-e984-4c2e-be1e-d47e314a4428 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:19.203581 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df97a79f-e984-4c2e-be1e-d47e314a4428 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:19.205571 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df97a79f-e984-4c2e-be1e-d47e314a4428 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:19.459185 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 745/1487] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:11:19 2022] POST /identity/v3/users => generated 307 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:19.460666 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132da556-8656-4b0e-a9cf-f28cc90e7ccc None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:19.461095 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132da556-8656-4b0e-a9cf-f28cc90e7ccc None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:19.461374 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132da556-8656-4b0e-a9cf-f28cc90e7ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:19.465716 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 743/1488] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:11:19 2022] POST /identity/v3/projects => generated 409 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:19.465716 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb673355-abda-4d06-b33c-4f7d569365a0 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:19.467255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-cb673355-abda-4d06-b33c-4f7d569365a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:19.486167 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-132da556-8656-4b0e-a9cf-f28cc90e7ccc None None] MFA Rules not processed for user `a852a777cb6a4863bebdb949cc71ea65`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:19.488286 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-132da556-8656-4b0e-a9cf-f28cc90e7ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:19.571544 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb673355-abda-4d06-b33c-4f7d569365a0 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:19.577097 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0fb4d3-e693-46a5-9b8d-27af46f047b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:19.577921 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0fb4d3-e693-46a5-9b8d-27af46f047b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:19.578362 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0fb4d3-e693-46a5-9b8d-27af46f047b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:19.578783 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0fb4d3-e693-46a5-9b8d-27af46f047b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:19.586012 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 746/1489] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Oct 26 11:11:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:19.589519 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132da556-8656-4b0e-a9cf-f28cc90e7ccc None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:19.642046 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0fb4d3-e693-46a5-9b8d-27af46f047b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:19.643584 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0fb4d3-e693-46a5-9b8d-27af46f047b5 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:19.653070 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 744/1490] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:19.654071 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0fb4d3-e693-46a5-9b8d-27af46f047b5 service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:19.664946 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0fb4d3-e693-46a5-9b8d-27af46f047b5 service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:19.670022 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ed68e-3f96-471c-979e-0b2b87c30248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:19.670250 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132da556-8656-4b0e-a9cf-f28cc90e7ccc None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:19.670844 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ed68e-3f96-471c-979e-0b2b87c30248 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:19.671264 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ed68e-3f96-471c-979e-0b2b87c30248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:19.671632 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ed68e-3f96-471c-979e-0b2b87c30248 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:19.672414 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ed68e-3f96-471c-979e-0b2b87c30248 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:19.674561 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ed68e-3f96-471c-979e-0b2b87c30248 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:19.683687 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c395943-c622-4a77-8dd1-e7d977c3120a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:19.684595 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c395943-c622-4a77-8dd1-e7d977c3120a admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:19.685339 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c395943-c622-4a77-8dd1-e7d977c3120a admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:19.685895 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c395943-c622-4a77-8dd1-e7d977c3120a admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:19.686700 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c395943-c622-4a77-8dd1-e7d977c3120a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:19.688535 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c395943-c622-4a77-8dd1-e7d977c3120a admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:19.705890 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 747/1491] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:19.705890 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c395943-c622-4a77-8dd1-e7d977c3120a admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:19.710191 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-5c395943-c622-4a77-8dd1-e7d977c3120a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:19.724871 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c395943-c622-4a77-8dd1-e7d977c3120a admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:19.729990 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ace04a-e449-459e-8439-0e68182c810e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:19.730944 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ace04a-e449-459e-8439-0e68182c810e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:19.730944 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ace04a-e449-459e-8439-0e68182c810e admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:19.735781 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ace04a-e449-459e-8439-0e68182c810e admin admin] PATH_INFO: `/v3/projects/2da66f06fe7444469d51672dda75e39b` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:19.735781 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ace04a-e449-459e-8439-0e68182c810e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2da66f06fe7444469d51672dda75e39b)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:19.735781 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ace04a-e449-459e-8439-0e68182c810e admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:19.767386 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 745/1492] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:11:19 2022] POST /identity/v3/users => generated 305 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:19.768569 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ed68e-3f96-471c-979e-0b2b87c30248 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:19.770348 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-429ed68e-3f96-471c-979e-0b2b87c30248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:19.788516 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ed68e-3f96-471c-979e-0b2b87c30248 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:19.794474 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c53cc-23e0-425c-8287-0e12483fcc04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:19.795098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c53cc-23e0-425c-8287-0e12483fcc04 service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:19.795385 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c53cc-23e0-425c-8287-0e12483fcc04 service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:19.798733 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c53cc-23e0-425c-8287-0e12483fcc04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:19.805677 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c53cc-23e0-425c-8287-0e12483fcc04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:19.807286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c53cc-23e0-425c-8287-0e12483fcc04 service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:19.818713 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 746/1493] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:19.829470 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c53cc-23e0-425c-8287-0e12483fcc04 service nova] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:19.830992 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-087c53cc-23e0-425c-8287-0e12483fcc04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:19.857160 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c53cc-23e0-425c-8287-0e12483fcc04 service nova] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:19.870592 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-d9ace04a-e449-459e-8439-0e68182c810e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2da66f06fe7444469d51672dda75e39b', 'request_id': 'req-d9ace04a-e449-459e-8439-0e68182c810e'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:19.922887 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95df4fa-65a4-4660-a150-371cf41aff4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:19.923711 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95df4fa-65a4-4660-a150-371cf41aff4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:19.924266 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95df4fa-65a4-4660-a150-371cf41aff4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:19.925317 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95df4fa-65a4-4660-a150-371cf41aff4e admin admin] PATH_INFO: `/v3/users/2d4e54c2d4204fc889a1bc6d0c3b1763` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:19.926619 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95df4fa-65a4-4660-a150-371cf41aff4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d4e54c2d4204fc889a1bc6d0c3b1763)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:19.929338 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95df4fa-65a4-4660-a150-371cf41aff4e admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:19.961287 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-d9ace04a-e449-459e-8439-0e68182c810e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2da66f06fe7444469d51672dda75e39b', 'request_id': 'req-d9ace04a-e449-459e-8439-0e68182c810e'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:19.971246 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-d9ace04a-e449-459e-8439-0e68182c810e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2da66f06fe7444469d51672dda75e39b', 'request_id': 'req-d9ace04a-e449-459e-8439-0e68182c810e'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:19.982239 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-d9ace04a-e449-459e-8439-0e68182c810e admin admin] The token cache is being invalidate because project 2da66f06fe7444469d51672dda75e39b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:11:19.982536 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-d9ace04a-e449-459e-8439-0e68182c810e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:19.983228 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-d9ace04a-e449-459e-8439-0e68182c810e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:19.984915 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 748/1494] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:11:19 2022] DELETE /identity/v3/projects/2da66f06fe7444469d51672dda75e39b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:19.985679 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ace04a-e449-459e-8439-0e68182c810e admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:19.987067 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-d9ace04a-e449-459e-8439-0e68182c810e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:20.000597 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ace04a-e449-459e-8439-0e68182c810e admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:20.005546 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f01c39-c5d5-43f5-8585-fed71662e3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:20.006222 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f01c39-c5d5-43f5-8585-fed71662e3e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:20.006503 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f01c39-c5d5-43f5-8585-fed71662e3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:20.006786 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f01c39-c5d5-43f5-8585-fed71662e3e5 admin admin] PATH_INFO: `/v3/projects/20eeb634e6f7400daa0042e31e4d28a0/users/1ee683384d3e472581a5bfbfebdebee6/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:20.021826 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f01c39-c5d5-43f5-8585-fed71662e3e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20eeb634e6f7400daa0042e31e4d28a0, user_id=1ee683384d3e472581a5bfbfebdebee6, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:20.024546 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f01c39-c5d5-43f5-8585-fed71662e3e5 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:20.165555 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 749/1495] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:19 2022] PUT /identity/v3/projects/20eeb634e6f7400daa0042e31e4d28a0/users/1ee683384d3e472581a5bfbfebdebee6/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:20.167031 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f01c39-c5d5-43f5-8585-fed71662e3e5 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:20.168690 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-69f01c39-c5d5-43f5-8585-fed71662e3e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:20.205474 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c95df4fa-65a4-4660-a150-371cf41aff4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d4e54c2d4204fc889a1bc6d0c3b1763'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:20.237349 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f01c39-c5d5-43f5-8585-fed71662e3e5 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:20.242002 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0fec9-54ed-4e78-9caf-fa189fb68585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:20.242616 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0fec9-54ed-4e78-9caf-fa189fb68585 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:20.242937 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0fec9-54ed-4e78-9caf-fa189fb68585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:20.243177 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0fec9-54ed-4e78-9caf-fa189fb68585 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:20.244176 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe0fec9-54ed-4e78-9caf-fa189fb68585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:20.245506 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe0fec9-54ed-4e78-9caf-fa189fb68585 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:20.255901 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 750/1496] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:20.257150 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367d265-4375-4c37-b954-0a1def32ec5f None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:20.257442 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367d265-4375-4c37-b954-0a1def32ec5f None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:20.257720 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367d265-4375-4c37-b954-0a1def32ec5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:20.278111 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-5367d265-4375-4c37-b954-0a1def32ec5f None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:20.279496 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-5367d265-4375-4c37-b954-0a1def32ec5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:20.289825 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 751/1497] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:20.290860 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5367d265-4375-4c37-b954-0a1def32ec5f None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:20.300213 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5367d265-4375-4c37-b954-0a1def32ec5f None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:20.304819 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce54f4b-b430-4773-a5ff-c81f7b2bcf94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:20.305403 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce54f4b-b430-4773-a5ff-c81f7b2bcf94 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:20.305686 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce54f4b-b430-4773-a5ff-c81f7b2bcf94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:20.305959 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce54f4b-b430-4773-a5ff-c81f7b2bcf94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:20.306594 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce54f4b-b430-4773-a5ff-c81f7b2bcf94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:20.308320 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce54f4b-b430-4773-a5ff-c81f7b2bcf94 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:20.308926 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c95df4fa-65a4-4660-a150-371cf41aff4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d4e54c2d4204fc889a1bc6d0c3b1763'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:20.318194 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 752/1498] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:20.318992 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce54f4b-b430-4773-a5ff-c81f7b2bcf94 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:20.324307 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c95df4fa-65a4-4660-a150-371cf41aff4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d4e54c2d4204fc889a1bc6d0c3b1763'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:20.332846 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c95df4fa-65a4-4660-a150-371cf41aff4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d4e54c2d4204fc889a1bc6d0c3b1763'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:20.334096 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c95df4fa-65a4-4660-a150-371cf41aff4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d4e54c2d4204fc889a1bc6d0c3b1763'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:20.337357 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce54f4b-b430-4773-a5ff-c81f7b2bcf94 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:20.341225 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 747/1499] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:11:19 2022] DELETE /identity/v3/users/2d4e54c2d4204fc889a1bc6d0c3b1763 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:20.343906 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae84622-5865-4198-b002-2d5ca57e98f0 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:20.344309 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae84622-5865-4198-b002-2d5ca57e98f0 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:20.344922 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae84622-5865-4198-b002-2d5ca57e98f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:20.347343 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30814e93-5c64-4cab-b633-7177051a277a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:20.347972 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30814e93-5c64-4cab-b633-7177051a277a admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:20.348445 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30814e93-5c64-4cab-b633-7177051a277a admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:20.348730 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30814e93-5c64-4cab-b633-7177051a277a admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:20.349632 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30814e93-5c64-4cab-b633-7177051a277a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:20.351254 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30814e93-5c64-4cab-b633-7177051a277a admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:20.362255 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 753/1500] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:20.363608 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30814e93-5c64-4cab-b633-7177051a277a admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:20.366983 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-30814e93-5c64-4cab-b633-7177051a277a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:20.370283 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-bae84622-5865-4198-b002-2d5ca57e98f0 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:20.372116 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-bae84622-5865-4198-b002-2d5ca57e98f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:20.381772 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30814e93-5c64-4cab-b633-7177051a277a admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:20.438309 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 748/1501] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:20.439555 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b4d06-ba2f-407a-bd13-83c1ec2ea637 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:20.439864 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b4d06-ba2f-407a-bd13-83c1ec2ea637 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:20.440255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b4d06-ba2f-407a-bd13-83c1ec2ea637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:20.448251 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a777a49-2da9-4f60-86c3-ff1c15d5b0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:20.449843 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a777a49-2da9-4f60-86c3-ff1c15d5b0ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:20.450234 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a777a49-2da9-4f60-86c3-ff1c15d5b0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:20.450582 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a777a49-2da9-4f60-86c3-ff1c15d5b0ae admin admin] PATH_INFO: `/v3/projects/20eeb634e6f7400daa0042e31e4d28a0/users/1ee683384d3e472581a5bfbfebdebee6/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:20.452867 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a777a49-2da9-4f60-86c3-ff1c15d5b0ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=20eeb634e6f7400daa0042e31e4d28a0, user_id=1ee683384d3e472581a5bfbfebdebee6, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:20.455981 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a777a49-2da9-4f60-86c3-ff1c15d5b0ae admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:20.460449 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-d75b4d06-ba2f-407a-bd13-83c1ec2ea637 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:20.461680 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d75b4d06-ba2f-407a-bd13-83c1ec2ea637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:20.468885 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 754/1502] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:20 2022] PUT /identity/v3/projects/20eeb634e6f7400daa0042e31e4d28a0/users/1ee683384d3e472581a5bfbfebdebee6/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:20.469782 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a777a49-2da9-4f60-86c3-ff1c15d5b0ae admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:20.472220 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-6a777a49-2da9-4f60-86c3-ff1c15d5b0ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:20.559320 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 749/1503] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:20.560231 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b4d06-ba2f-407a-bd13-83c1ec2ea637 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:20.570855 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a777a49-2da9-4f60-86c3-ff1c15d5b0ae admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:20.574848 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b4d06-ba2f-407a-bd13-83c1ec2ea637 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:20.578533 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacce45c-f1a1-40cf-97a6-4b6be623b004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:20.579063 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0d49b-706a-4468-805d-fcfcdb674347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:20.579645 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacce45c-f1a1-40cf-97a6-4b6be623b004 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:20.579749 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0d49b-706a-4468-805d-fcfcdb674347 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:20.579994 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0d49b-706a-4468-805d-fcfcdb674347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:20.580301 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0d49b-706a-4468-805d-fcfcdb674347 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:20.580579 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacce45c-f1a1-40cf-97a6-4b6be623b004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:20.580946 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b0d49b-706a-4468-805d-fcfcdb674347 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:11:20.581244 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b0d49b-706a-4468-805d-fcfcdb674347 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:20.581499 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacce45c-f1a1-40cf-97a6-4b6be623b004 admin admin] PATH_INFO: `/v3/projects/ab751f2339bf4dcc8f740d2a775da7ea/users/410ca55b31ca4ca49baff54f1845fbf0/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:20.583172 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b0d49b-706a-4468-805d-fcfcdb674347 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:20.604412 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 750/1504] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:11:20.604550 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacce45c-f1a1-40cf-97a6-4b6be623b004 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab751f2339bf4dcc8f740d2a775da7ea, user_id=410ca55b31ca4ca49baff54f1845fbf0, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:20.608240 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a0309-031c-4b9d-987d-8a81bd95beeb None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:20.608240 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a0309-031c-4b9d-987d-8a81bd95beeb None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:20.608240 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a0309-031c-4b9d-987d-8a81bd95beeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:20.608818 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacce45c-f1a1-40cf-97a6-4b6be623b004 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:20.645855 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-730a0309-031c-4b9d-987d-8a81bd95beeb None None] MFA Rules not processed for user `1ee683384d3e472581a5bfbfebdebee6`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:20.648419 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-730a0309-031c-4b9d-987d-8a81bd95beeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:20.704393 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 755/1505] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:20 2022] PUT /identity/v3/projects/ab751f2339bf4dcc8f740d2a775da7ea/users/410ca55b31ca4ca49baff54f1845fbf0/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:20.709645 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacce45c-f1a1-40cf-97a6-4b6be623b004 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:20.709645 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-eacce45c-f1a1-40cf-97a6-4b6be623b004 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:20.741856 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 751/1506] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:20 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:20.741856 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a0309-031c-4b9d-987d-8a81bd95beeb None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:20.752402 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a0309-031c-4b9d-987d-8a81bd95beeb None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:20.784322 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacce45c-f1a1-40cf-97a6-4b6be623b004 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:20.788801 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56191eab-fb55-455d-b6d0-f9b826e2aebe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:20.789667 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56191eab-fb55-455d-b6d0-f9b826e2aebe service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:20.790016 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56191eab-fb55-455d-b6d0-f9b826e2aebe service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:20.790493 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56191eab-fb55-455d-b6d0-f9b826e2aebe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:20.836821 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d9b06-14be-4311-bd9f-41907a8ba4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:20.837450 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d9b06-14be-4311-bd9f-41907a8ba4ec admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:20.837729 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d9b06-14be-4311-bd9f-41907a8ba4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:20.838063 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d9b06-14be-4311-bd9f-41907a8ba4ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:20.838849 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d9b06-14be-4311-bd9f-41907a8ba4ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:20.841009 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d9b06-14be-4311-bd9f-41907a8ba4ec admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:20.908902 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56191eab-fb55-455d-b6d0-f9b826e2aebe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:20.910629 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56191eab-fb55-455d-b6d0-f9b826e2aebe service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:20.923360 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 756/1507] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:20.929262 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde46807-c661-46bb-951b-34908e9cced4 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:20.929550 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde46807-c661-46bb-951b-34908e9cced4 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:20.929821 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde46807-c661-46bb-951b-34908e9cced4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:20.960110 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-dde46807-c661-46bb-951b-34908e9cced4 None None] MFA Rules not processed for user `410ca55b31ca4ca49baff54f1845fbf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:20.961346 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-dde46807-c661-46bb-951b-34908e9cced4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:21.002925 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 752/1508] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:11:20 2022] POST /identity/v3/projects => generated 387 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:21.003760 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d9b06-14be-4311-bd9f-41907a8ba4ec admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:21.009201 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d23d9b06-14be-4311-bd9f-41907a8ba4ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:21.048814 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 757/1509] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:20 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:21.049627 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde46807-c661-46bb-951b-34908e9cced4 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:21.060753 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde46807-c661-46bb-951b-34908e9cced4 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:21.082147 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d9b06-14be-4311-bd9f-41907a8ba4ec admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:21.086521 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba0865-4537-4d2e-a7cf-faaf75b84dcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:21.087209 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba0865-4537-4d2e-a7cf-faaf75b84dcf service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:21.087556 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba0865-4537-4d2e-a7cf-faaf75b84dcf service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:21.087835 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba0865-4537-4d2e-a7cf-faaf75b84dcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:21.137165 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:21.149816 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb04d99-d8cf-4f99-bce7-237ae08263fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:21.149816 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb04d99-d8cf-4f99-bce7-237ae08263fb admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:21.149816 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb04d99-d8cf-4f99-bce7-237ae08263fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:21.149816 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb04d99-d8cf-4f99-bce7-237ae08263fb admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:21.150878 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb04d99-d8cf-4f99-bce7-237ae08263fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:21.153245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb04d99-d8cf-4f99-bce7-237ae08263fb admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:21.190022 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba0865-4537-4d2e-a7cf-faaf75b84dcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:21.191857 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba0865-4537-4d2e-a7cf-faaf75b84dcf service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:21.213674 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 753/1510] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:21 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:21.214458 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba0865-4537-4d2e-a7cf-faaf75b84dcf service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:21.237781 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba0865-4537-4d2e-a7cf-faaf75b84dcf service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:21.256137 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe7be6-bce2-4226-b660-0595c077089b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:21.256137 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe7be6-bce2-4226-b660-0595c077089b admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:21.256137 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe7be6-bce2-4226-b660-0595c077089b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:21.256137 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe7be6-bce2-4226-b660-0595c077089b admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:21.256619 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe7be6-bce2-4226-b660-0595c077089b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:21.259956 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe7be6-bce2-4226-b660-0595c077089b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:21.331375 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 758/1511] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:11:21 2022] POST /identity/v3/users => generated 294 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:21.333122 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb04d99-d8cf-4f99-bce7-237ae08263fb admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:21.346359 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb04d99-d8cf-4f99-bce7-237ae08263fb admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:21.351809 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64c585-0fac-4087-8af2-8ee9f0dcf7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:21.352468 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64c585-0fac-4087-8af2-8ee9f0dcf7c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:21.352756 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64c585-0fac-4087-8af2-8ee9f0dcf7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:21.353042 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64c585-0fac-4087-8af2-8ee9f0dcf7c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:21.354193 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df64c585-0fac-4087-8af2-8ee9f0dcf7c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:21.356275 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df64c585-0fac-4087-8af2-8ee9f0dcf7c0 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:21.368472 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 759/1512] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:11:21.372428 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64c585-0fac-4087-8af2-8ee9f0dcf7c0 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:21.381870 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64c585-0fac-4087-8af2-8ee9f0dcf7c0 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:21.386739 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d0c6d-a324-454b-84b9-8b3819f90d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:21.387337 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d0c6d-a324-454b-84b9-8b3819f90d2e admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:21.389475 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d0c6d-a324-454b-84b9-8b3819f90d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:21.389475 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d0c6d-a324-454b-84b9-8b3819f90d2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:21.389475 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d0c6d-a324-454b-84b9-8b3819f90d2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:21.390261 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d0c6d-a324-454b-84b9-8b3819f90d2e admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:21.399925 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 760/1513] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:11:21.403682 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d0c6d-a324-454b-84b9-8b3819f90d2e admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:21.413429 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d0c6d-a324-454b-84b9-8b3819f90d2e admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:21.418007 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69027ee1-574c-4cf9-919a-d58be9301a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:21.418605 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69027ee1-574c-4cf9-919a-d58be9301a19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:21.418884 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69027ee1-574c-4cf9-919a-d58be9301a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:21.419157 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69027ee1-574c-4cf9-919a-d58be9301a19 admin admin] PATH_INFO: `/v3/projects/b5c741eb5378489681e9f0f858a5f00c/users/d8983923cad14a20805e8c416110e1f3/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:21.433703 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69027ee1-574c-4cf9-919a-d58be9301a19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5c741eb5378489681e9f0f858a5f00c, user_id=d8983923cad14a20805e8c416110e1f3, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:21.436328 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69027ee1-574c-4cf9-919a-d58be9301a19 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:21.453775 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 754/1514] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:11:21 2022] POST /identity/v3/projects => generated 409 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:21.457812 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe7be6-bce2-4226-b660-0595c077089b admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:21.521889 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe7be6-bce2-4226-b660-0595c077089b admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:21.526595 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d5cec-ec77-4137-85bb-e0e912bdea4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:21.527199 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d5cec-ec77-4137-85bb-e0e912bdea4e admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:21.527480 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d5cec-ec77-4137-85bb-e0e912bdea4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:21.527752 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d5cec-ec77-4137-85bb-e0e912bdea4e admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:21.528426 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d5cec-ec77-4137-85bb-e0e912bdea4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:21.530391 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d5cec-ec77-4137-85bb-e0e912bdea4e admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:21.546977 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 761/1515] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:21 2022] PUT /identity/v3/projects/b5c741eb5378489681e9f0f858a5f00c/users/d8983923cad14a20805e8c416110e1f3/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:11:21.547841 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69027ee1-574c-4cf9-919a-d58be9301a19 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:21.550833 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-69027ee1-574c-4cf9-919a-d58be9301a19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:21.632662 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69027ee1-574c-4cf9-919a-d58be9301a19 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:21.637991 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a41287-4961-4da5-9975-d6e38fccbd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:21.638655 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a41287-4961-4da5-9975-d6e38fccbd8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:21.638941 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a41287-4961-4da5-9975-d6e38fccbd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:21.639221 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a41287-4961-4da5-9975-d6e38fccbd8c admin admin] PATH_INFO: `/v3/projects/a582294ed8404ac2bd0ac0ad53de54ac` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:21.640393 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a41287-4961-4da5-9975-d6e38fccbd8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a582294ed8404ac2bd0ac0ad53de54ac)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:21.642339 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a41287-4961-4da5-9975-d6e38fccbd8c admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:21.670484 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 755/1516] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:11:21 2022] POST /identity/v3/users => generated 311 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:11:21.671148 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f4442-806b-4ee1-a865-f0e6da45b2d7 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:21.671585 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f4442-806b-4ee1-a865-f0e6da45b2d7 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:21.671936 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f4442-806b-4ee1-a865-f0e6da45b2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:21.700424 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-2f0f4442-806b-4ee1-a865-f0e6da45b2d7 None None] MFA Rules not processed for user `d8983923cad14a20805e8c416110e1f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:21.701653 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2f0f4442-806b-4ee1-a865-f0e6da45b2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:21.768041 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 756/1517] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:21.768909 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f4442-806b-4ee1-a865-f0e6da45b2d7 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:21.811422 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-96a41287-4961-4da5-9975-d6e38fccbd8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a582294ed8404ac2bd0ac0ad53de54ac', 'request_id': 'req-96a41287-4961-4da5-9975-d6e38fccbd8c'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:21.823585 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f4442-806b-4ee1-a865-f0e6da45b2d7 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:21.876888 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1d4f8-ed7f-42d0-999f-b221f84668b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:21.877535 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1d4f8-ed7f-42d0-999f-b221f84668b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:21.877814 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1d4f8-ed7f-42d0-999f-b221f84668b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:21.878088 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1d4f8-ed7f-42d0-999f-b221f84668b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:21.880010 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b0c1d4f8-ed7f-42d0-999f-b221f84668b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:21.886711 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-96a41287-4961-4da5-9975-d6e38fccbd8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a582294ed8404ac2bd0ac0ad53de54ac', 'request_id': 'req-96a41287-4961-4da5-9975-d6e38fccbd8c'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:21.895322 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-96a41287-4961-4da5-9975-d6e38fccbd8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a582294ed8404ac2bd0ac0ad53de54ac', 'request_id': 'req-96a41287-4961-4da5-9975-d6e38fccbd8c'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:21.905401 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-96a41287-4961-4da5-9975-d6e38fccbd8c admin admin] The token cache is being invalidate because project a582294ed8404ac2bd0ac0ad53de54ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:11:21.905690 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-96a41287-4961-4da5-9975-d6e38fccbd8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:21.906409 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-96a41287-4961-4da5-9975-d6e38fccbd8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:21.911598 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 762/1518] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:11:21 2022] DELETE /identity/v3/projects/a582294ed8404ac2bd0ac0ad53de54ac => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:11:21.911598 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a41287-4961-4da5-9975-d6e38fccbd8c admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:21.911598 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-96a41287-4961-4da5-9975-d6e38fccbd8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:21.956625 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c1d4f8-ed7f-42d0-999f-b221f84668b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:21.958135 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c1d4f8-ed7f-42d0-999f-b221f84668b4 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:21.970478 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 757/1519] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:21 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:21.981116 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1d4f8-ed7f-42d0-999f-b221f84668b4 service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:22.011658 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a41287-4961-4da5-9975-d6e38fccbd8c admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:22.018287 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a56505-c86a-450d-af5e-89616dcf2721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:22.018287 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a56505-c86a-450d-af5e-89616dcf2721 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:22.018287 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a56505-c86a-450d-af5e-89616dcf2721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:22.018946 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a56505-c86a-450d-af5e-89616dcf2721 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:22.019747 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a56505-c86a-450d-af5e-89616dcf2721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:22.021552 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a56505-c86a-450d-af5e-89616dcf2721 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:22.041346 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 763/1520] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:22.041346 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dad163-439c-47f0-8d3d-4b0972c83d0b None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:22.041346 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dad163-439c-47f0-8d3d-4b0972c83d0b None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:22.041346 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dad163-439c-47f0-8d3d-4b0972c83d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:22.065861 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-41dad163-439c-47f0-8d3d-4b0972c83d0b None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:22.067339 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-41dad163-439c-47f0-8d3d-4b0972c83d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:22.078411 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 764/1521] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:22.079392 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dad163-439c-47f0-8d3d-4b0972c83d0b None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:22.098059 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dad163-439c-47f0-8d3d-4b0972c83d0b None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:22.098799 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1d4f8-ed7f-42d0-999f-b221f84668b4 service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:22.104734 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10df36c-ce2e-4f8b-9761-4cb2cc8d61f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:22.105722 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10df36c-ce2e-4f8b-9761-4cb2cc8d61f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:22.105853 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed277e-ef4c-4ffe-b329-0b6464cadfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:22.106315 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10df36c-ce2e-4f8b-9761-4cb2cc8d61f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:22.106640 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed277e-ef4c-4ffe-b329-0b6464cadfa8 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:22.106876 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10df36c-ce2e-4f8b-9761-4cb2cc8d61f8 admin admin] PATH_INFO: `/v3/projects/dc5c72ede9714a0fbbe02765427ad73d/users/f59a1b7b96374f1c873eccd8f3051d25/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:22.107472 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed277e-ef4c-4ffe-b329-0b6464cadfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:22.107856 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed277e-ef4c-4ffe-b329-0b6464cadfa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:22.108633 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed277e-ef4c-4ffe-b329-0b6464cadfa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:22.111855 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed277e-ef4c-4ffe-b329-0b6464cadfa8 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:22.128132 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10df36c-ce2e-4f8b-9761-4cb2cc8d61f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc5c72ede9714a0fbbe02765427ad73d, user_id=f59a1b7b96374f1c873eccd8f3051d25, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:22.132152 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10df36c-ce2e-4f8b-9761-4cb2cc8d61f8 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:22.236715 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 758/1522] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:11:21 2022] POST /identity/v3/projects => generated 387 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:22.236715 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6764741-c9b1-4d3b-a62f-17caadcd6ee7 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:22.236715 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6764741-c9b1-4d3b-a62f-17caadcd6ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:22.237242 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6764741-c9b1-4d3b-a62f-17caadcd6ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:22.259003 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-d6764741-c9b1-4d3b-a62f-17caadcd6ee7 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:22.260305 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d6764741-c9b1-4d3b-a62f-17caadcd6ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:22.285982 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 765/1523] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:22 2022] PUT /identity/v3/projects/dc5c72ede9714a0fbbe02765427ad73d/users/f59a1b7b96374f1c873eccd8f3051d25/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:22.288318 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10df36c-ce2e-4f8b-9761-4cb2cc8d61f8 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:22.290246 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-d10df36c-ce2e-4f8b-9761-4cb2cc8d61f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:22.330947 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 759/1524] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:22.334307 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6764741-c9b1-4d3b-a62f-17caadcd6ee7 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:22.350313 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6764741-c9b1-4d3b-a62f-17caadcd6ee7 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:22.355455 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e785231-6113-45de-8036-2c6401e53491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:22.359306 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e785231-6113-45de-8036-2c6401e53491 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:22.359306 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e785231-6113-45de-8036-2c6401e53491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:22.359306 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e785231-6113-45de-8036-2c6401e53491 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:22.359306 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e785231-6113-45de-8036-2c6401e53491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:22.359306 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e785231-6113-45de-8036-2c6401e53491 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:22.372110 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 760/1525] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:22.372110 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e785231-6113-45de-8036-2c6401e53491 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:22.376701 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10df36c-ce2e-4f8b-9761-4cb2cc8d61f8 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:22.380655 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e785231-6113-45de-8036-2c6401e53491 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:22.383771 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2601c168-df6e-4c88-9fcc-68459240e210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:22.384792 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601c168-df6e-4c88-9fcc-68459240e210 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:22.385216 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601c168-df6e-4c88-9fcc-68459240e210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:22.385571 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5854d-1f5b-4585-8702-59a43d4e0ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:22.385791 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601c168-df6e-4c88-9fcc-68459240e210 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:22.386203 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5854d-1f5b-4585-8702-59a43d4e0ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:22.386482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5854d-1f5b-4585-8702-59a43d4e0ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:22.386753 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5854d-1f5b-4585-8702-59a43d4e0ad8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:22.387043 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2601c168-df6e-4c88-9fcc-68459240e210 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:22.387394 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5854d-1f5b-4585-8702-59a43d4e0ad8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:11:22.387691 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5854d-1f5b-4585-8702-59a43d4e0ad8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:22.389400 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5854d-1f5b-4585-8702-59a43d4e0ad8 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:22.393721 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2601c168-df6e-4c88-9fcc-68459240e210 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:22.405747 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 761/1526] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:11:22.406648 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5854d-1f5b-4585-8702-59a43d4e0ad8 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:22.418040 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5854d-1f5b-4585-8702-59a43d4e0ad8 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:22.422765 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891136c9-a57b-4aba-986d-80c5968c01df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:22.423419 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891136c9-a57b-4aba-986d-80c5968c01df admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:22.423723 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891136c9-a57b-4aba-986d-80c5968c01df admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:22.423969 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891136c9-a57b-4aba-986d-80c5968c01df admin admin] PATH_INFO: `/v3/projects/dc5c72ede9714a0fbbe02765427ad73d/users/f59a1b7b96374f1c873eccd8f3051d25/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:22.425890 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891136c9-a57b-4aba-986d-80c5968c01df admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc5c72ede9714a0fbbe02765427ad73d, user_id=f59a1b7b96374f1c873eccd8f3051d25, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:22.428641 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891136c9-a57b-4aba-986d-80c5968c01df admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:22.438996 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 762/1527] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:22 2022] PUT /identity/v3/projects/dc5c72ede9714a0fbbe02765427ad73d/users/f59a1b7b96374f1c873eccd8f3051d25/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:22.439817 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891136c9-a57b-4aba-986d-80c5968c01df admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:22.500520 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 766/1528] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:11:22 2022] POST /identity/v3/users => generated 300 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:22.500520 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7018502-3996-4d51-bef7-f7486a325441 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:22.500815 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7018502-3996-4d51-bef7-f7486a325441 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:22.501089 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7018502-3996-4d51-bef7-f7486a325441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:22.509112 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891136c9-a57b-4aba-986d-80c5968c01df admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:22.513949 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6d7bf-cc4b-4a8d-a4c4-b7e2a0020a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:22.514555 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6d7bf-cc4b-4a8d-a4c4-b7e2a0020a69 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:22.514833 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6d7bf-cc4b-4a8d-a4c4-b7e2a0020a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:22.515101 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6d7bf-cc4b-4a8d-a4c4-b7e2a0020a69 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:22.515731 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff6d7bf-cc4b-4a8d-a4c4-b7e2a0020a69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:22.517945 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff6d7bf-cc4b-4a8d-a4c4-b7e2a0020a69 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:22.537528 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-d7018502-3996-4d51-bef7-f7486a325441 None None] MFA Rules not processed for user `f59a1b7b96374f1c873eccd8f3051d25`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:22.538787 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-d7018502-3996-4d51-bef7-f7486a325441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:22.608664 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 767/1529] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:22 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:22.609501 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7018502-3996-4d51-bef7-f7486a325441 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:22.622984 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7018502-3996-4d51-bef7-f7486a325441 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:22.627753 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b1e39-b3f4-47fe-a250-a6df75564aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:22.628376 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b1e39-b3f4-47fe-a250-a6df75564aad admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:22.628652 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b1e39-b3f4-47fe-a250-a6df75564aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:22.628921 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b1e39-b3f4-47fe-a250-a6df75564aad admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:22.629556 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b1e39-b3f4-47fe-a250-a6df75564aad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:22.631202 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b1e39-b3f4-47fe-a250-a6df75564aad admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:22.642635 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 768/1530] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:22.643800 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b1e39-b3f4-47fe-a250-a6df75564aad admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:22.647387 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-e01b1e39-b3f4-47fe-a250-a6df75564aad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:22.649888 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 763/1531] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:11:22 2022] POST /identity/v3/projects => generated 383 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:22.655780 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6d7bf-cc4b-4a8d-a4c4-b7e2a0020a69 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:22.705431 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:22.718836 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b1e39-b3f4-47fe-a250-a6df75564aad admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:22.784455 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6d7bf-cc4b-4a8d-a4c4-b7e2a0020a69 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:22.798890 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669aec3-5ec8-45f3-8878-fa54d5f1933b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:22.799518 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea364d4-8751-47b9-8619-c5c014030d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:22.800396 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea364d4-8751-47b9-8619-c5c014030d57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:22.800512 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669aec3-5ec8-45f3-8878-fa54d5f1933b service cinder] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:22.800694 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669aec3-5ec8-45f3-8878-fa54d5f1933b service cinder] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:22.800974 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669aec3-5ec8-45f3-8878-fa54d5f1933b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:22.804304 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea364d4-8751-47b9-8619-c5c014030d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:22.804304 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea364d4-8751-47b9-8619-c5c014030d57 admin admin] PATH_INFO: `/v3/projects/735bee4eca2d4c32842804e34361f702/users/7a9b97466b74491fabfbc727e90a5ac7/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:22.835877 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea364d4-8751-47b9-8619-c5c014030d57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=735bee4eca2d4c32842804e34361f702, user_id=7a9b97466b74491fabfbc727e90a5ac7, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:22.839688 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea364d4-8751-47b9-8619-c5c014030d57 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:22.887513 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669aec3-5ec8-45f3-8878-fa54d5f1933b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:22.891948 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669aec3-5ec8-45f3-8878-fa54d5f1933b service cinder] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:22.903061 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 769/1532] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:22 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:22.904278 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669aec3-5ec8-45f3-8878-fa54d5f1933b service cinder] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:22.916543 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669aec3-5ec8-45f3-8878-fa54d5f1933b service cinder] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:22.925100 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67470892-b623-47f3-88e6-a133826ef70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:22.926009 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67470892-b623-47f3-88e6-a133826ef70c admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:22.926423 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67470892-b623-47f3-88e6-a133826ef70c admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:22.926767 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67470892-b623-47f3-88e6-a133826ef70c admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:22.927546 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67470892-b623-47f3-88e6-a133826ef70c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:22.929828 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67470892-b623-47f3-88e6-a133826ef70c admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:22.948041 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 764/1533] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:22 2022] PUT /identity/v3/projects/735bee4eca2d4c32842804e34361f702/users/7a9b97466b74491fabfbc727e90a5ac7/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:22.953113 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea364d4-8751-47b9-8619-c5c014030d57 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:23.041365 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 770/1534] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:11:22 2022] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:23.045377 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67470892-b623-47f3-88e6-a133826ef70c admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:23.062963 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67470892-b623-47f3-88e6-a133826ef70c admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:23.070082 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea364d4-8751-47b9-8619-c5c014030d57 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:23.073601 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b45bb-79ef-4223-b499-5e0fdcf304dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:23.075600 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b45bb-79ef-4223-b499-5e0fdcf304dd admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:23.075600 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b45bb-79ef-4223-b499-5e0fdcf304dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:23.075600 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b45bb-79ef-4223-b499-5e0fdcf304dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:23.075989 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b45bb-79ef-4223-b499-5e0fdcf304dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:23.077618 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b45bb-79ef-4223-b499-5e0fdcf304dd admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:23.085409 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee491be1-7027-4c7f-8fa7-b7b52b9545c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:23.086370 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee491be1-7027-4c7f-8fa7-b7b52b9545c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:23.086370 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee491be1-7027-4c7f-8fa7-b7b52b9545c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:23.086588 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee491be1-7027-4c7f-8fa7-b7b52b9545c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:23.087286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee491be1-7027-4c7f-8fa7-b7b52b9545c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:23.088958 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee491be1-7027-4c7f-8fa7-b7b52b9545c5 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:23.123256 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 771/1535] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:23.128346 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b45bb-79ef-4223-b499-5e0fdcf304dd admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:23.128501 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 765/1536] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:23.135606 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee491be1-7027-4c7f-8fa7-b7b52b9545c5 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:23.138101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b45bb-79ef-4223-b499-5e0fdcf304dd admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:23.145649 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a7948f-3870-40fa-9c73-02bfe0073c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:23.146370 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7948f-3870-40fa-9c73-02bfe0073c0b admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:23.146714 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7948f-3870-40fa-9c73-02bfe0073c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:23.147058 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7948f-3870-40fa-9c73-02bfe0073c0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:23.147842 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a7948f-3870-40fa-9c73-02bfe0073c0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:23.149545 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a7948f-3870-40fa-9c73-02bfe0073c0b admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:23.150660 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee491be1-7027-4c7f-8fa7-b7b52b9545c5 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:23.156008 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369e73b-b542-4c0f-af6f-fea1d9c66375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:23.160956 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369e73b-b542-4c0f-af6f-fea1d9c66375 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:23.160956 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369e73b-b542-4c0f-af6f-fea1d9c66375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:23.160956 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369e73b-b542-4c0f-af6f-fea1d9c66375 admin admin] PATH_INFO: `/v3/projects/735bee4eca2d4c32842804e34361f702/users/7a9b97466b74491fabfbc727e90a5ac7/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:23.160956 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5369e73b-b542-4c0f-af6f-fea1d9c66375 admin admin] RBAC: Authorizing `identity:create_grant(project_id=735bee4eca2d4c32842804e34361f702, user_id=7a9b97466b74491fabfbc727e90a5ac7, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:23.161965 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 772/1537] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:11:23.162074 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5369e73b-b542-4c0f-af6f-fea1d9c66375 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:23.166565 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a7948f-3870-40fa-9c73-02bfe0073c0b admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:23.176996 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 766/1538] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:23 2022] PUT /identity/v3/projects/735bee4eca2d4c32842804e34361f702/users/7a9b97466b74491fabfbc727e90a5ac7/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:23.183098 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a7948f-3870-40fa-9c73-02bfe0073c0b admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:23.187562 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1460d6-fb64-4bbd-8fc4-00f3ba0df60b None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:23.188016 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1460d6-fb64-4bbd-8fc4-00f3ba0df60b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:23.188496 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1460d6-fb64-4bbd-8fc4-00f3ba0df60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:23.223789 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-cd1460d6-fb64-4bbd-8fc4-00f3ba0df60b None None] MFA Rules not processed for user `7a9b97466b74491fabfbc727e90a5ac7`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:23.225291 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-cd1460d6-fb64-4bbd-8fc4-00f3ba0df60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:23.252222 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8c663-8460-435f-83b0-5aa907089aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:23.253077 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8c663-8460-435f-83b0-5aa907089aa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:23.253414 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8c663-8460-435f-83b0-5aa907089aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:23.253752 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8c663-8460-435f-83b0-5aa907089aa6 admin admin] PATH_INFO: `/v3/projects/d1df1ca8909c4d9ea2274e8632f26b28/users/f80966ffce2f4e0c8b407458716fb0d9/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:23.270106 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8c663-8460-435f-83b0-5aa907089aa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1df1ca8909c4d9ea2274e8632f26b28, user_id=f80966ffce2f4e0c8b407458716fb0d9, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:23.273027 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8c663-8460-435f-83b0-5aa907089aa6 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:23.313584 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 767/1539] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:23 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:23.339419 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1460d6-fb64-4bbd-8fc4-00f3ba0df60b None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:23.394393 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1460d6-fb64-4bbd-8fc4-00f3ba0df60b None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:23.398020 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833423aa-674e-4a07-b6fa-9840fa03a12b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:23.398626 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833423aa-674e-4a07-b6fa-9840fa03a12b service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:23.398907 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833423aa-674e-4a07-b6fa-9840fa03a12b service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:23.399254 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833423aa-674e-4a07-b6fa-9840fa03a12b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:23.407953 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833423aa-674e-4a07-b6fa-9840fa03a12b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:23.409500 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833423aa-674e-4a07-b6fa-9840fa03a12b service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:23.418884 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 768/1540] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:23 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:23.455143 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833423aa-674e-4a07-b6fa-9840fa03a12b service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:23.466011 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 773/1541] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:23 2022] PUT /identity/v3/projects/d1df1ca8909c4d9ea2274e8632f26b28/users/f80966ffce2f4e0c8b407458716fb0d9/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:23.467668 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833423aa-674e-4a07-b6fa-9840fa03a12b service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:23.476830 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120dd4a-a42c-49de-a671-0490e0ce876b None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:23.477570 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120dd4a-a42c-49de-a671-0490e0ce876b None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:23.478031 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120dd4a-a42c-49de-a671-0490e0ce876b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:23.517720 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-0120dd4a-a42c-49de-a671-0490e0ce876b None None] MFA Rules not processed for user `f80966ffce2f4e0c8b407458716fb0d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:23.519282 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-0120dd4a-a42c-49de-a671-0490e0ce876b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:23.528726 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49478268-5bbd-4379-994f-212c00cf5d06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:23.529366 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49478268-5bbd-4379-994f-212c00cf5d06 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:23.529651 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49478268-5bbd-4379-994f-212c00cf5d06 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:23.529924 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49478268-5bbd-4379-994f-212c00cf5d06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:23.531752 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-49478268-5bbd-4379-994f-212c00cf5d06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:23.602985 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 774/1542] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:23.606932 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120dd4a-a42c-49de-a671-0490e0ce876b None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:23.611466 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49478268-5bbd-4379-994f-212c00cf5d06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:23.613177 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49478268-5bbd-4379-994f-212c00cf5d06 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:23.625735 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 769/1543] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:23 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:11:23.671296 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120dd4a-a42c-49de-a671-0490e0ce876b None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:23.675945 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d96d60-f166-4648-bcb9-80b76b0ce715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:23.676579 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d96d60-f166-4648-bcb9-80b76b0ce715 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:23.676857 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d96d60-f166-4648-bcb9-80b76b0ce715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:23.677126 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d96d60-f166-4648-bcb9-80b76b0ce715 admin admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:23.678395 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d96d60-f166-4648-bcb9-80b76b0ce715 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:23.680347 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d96d60-f166-4648-bcb9-80b76b0ce715 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:23.830494 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 775/1544] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:11:23 2022] POST /identity/v3/projects => generated 383 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:23.834535 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49478268-5bbd-4379-994f-212c00cf5d06 service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:23.845332 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49478268-5bbd-4379-994f-212c00cf5d06 service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:23.905576 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7529da4-dbcd-4956-9452-3d8c720bedc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:23.906111 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7529da4-dbcd-4956-9452-3d8c720bedc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:23.906391 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7529da4-dbcd-4956-9452-3d8c720bedc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:23.906664 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7529da4-dbcd-4956-9452-3d8c720bedc1 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:23.907328 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7529da4-dbcd-4956-9452-3d8c720bedc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:23.909281 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7529da4-dbcd-4956-9452-3d8c720bedc1 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:24.033714 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 770/1545] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:11:23 2022] POST /identity/v3/users => generated 292 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:11:24.038326 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d96d60-f166-4648-bcb9-80b76b0ce715 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:24.048564 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d96d60-f166-4648-bcb9-80b76b0ce715 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:24.053238 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ac8ff-b779-45ff-891c-9cf1e6d9cc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:24.053838 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ac8ff-b779-45ff-891c-9cf1e6d9cc2a admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:24.054120 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ac8ff-b779-45ff-891c-9cf1e6d9cc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:24.054397 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ac8ff-b779-45ff-891c-9cf1e6d9cc2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:24.055104 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7ac8ff-b779-45ff-891c-9cf1e6d9cc2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:24.056761 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7ac8ff-b779-45ff-891c-9cf1e6d9cc2a admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:24.066526 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 776/1546] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:11:24.070528 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7529da4-dbcd-4956-9452-3d8c720bedc1 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:24.081238 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7529da4-dbcd-4956-9452-3d8c720bedc1 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:24.086402 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52225f84-19e4-4b06-a1a9-8a62104d81d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:24.088245 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52225f84-19e4-4b06-a1a9-8a62104d81d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:24.088245 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52225f84-19e4-4b06-a1a9-8a62104d81d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:24.088245 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52225f84-19e4-4b06-a1a9-8a62104d81d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:24.088245 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52225f84-19e4-4b06-a1a9-8a62104d81d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:24.089846 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52225f84-19e4-4b06-a1a9-8a62104d81d2 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:24.104332 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 771/1547] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:24.110008 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ac8ff-b779-45ff-891c-9cf1e6d9cc2a admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:24.121405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ac8ff-b779-45ff-891c-9cf1e6d9cc2a admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:24.126720 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa1338-95f8-4e66-af38-5ae6e6ba111f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:24.127468 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa1338-95f8-4e66-af38-5ae6e6ba111f admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:24.127827 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa1338-95f8-4e66-af38-5ae6e6ba111f admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:24.128244 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa1338-95f8-4e66-af38-5ae6e6ba111f admin admin] PATH_INFO: `/v3/projects/5145652d787e40518a9aff1397524613/users/fd0bb90b37b34d2aba3233f61d3cc4b7/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:24.145340 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa1338-95f8-4e66-af38-5ae6e6ba111f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5145652d787e40518a9aff1397524613, user_id=fd0bb90b37b34d2aba3233f61d3cc4b7, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:24.148951 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa1338-95f8-4e66-af38-5ae6e6ba111f admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:24.244106 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 777/1548] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:24 2022] PUT /identity/v3/projects/5145652d787e40518a9aff1397524613/users/fd0bb90b37b34d2aba3233f61d3cc4b7/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:24.257565 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f109833-1eea-458c-b963-cbc9ad71e7a5 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:24.257859 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f109833-1eea-458c-b963-cbc9ad71e7a5 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:24.258144 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f109833-1eea-458c-b963-cbc9ad71e7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:24.286377 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-4f109833-1eea-458c-b963-cbc9ad71e7a5 None None] MFA Rules not processed for user `fd0bb90b37b34d2aba3233f61d3cc4b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:24.288167 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4f109833-1eea-458c-b963-cbc9ad71e7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:24.355064 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 772/1549] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:24.359587 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa1338-95f8-4e66-af38-5ae6e6ba111f admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:24.457302 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa1338-95f8-4e66-af38-5ae6e6ba111f admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:24.465023 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f109833-1eea-458c-b963-cbc9ad71e7a5 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:24.478486 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f109833-1eea-458c-b963-cbc9ad71e7a5 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:24.482426 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dfad99-098a-4c6a-9da8-6588935e9d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:24.483060 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfad99-098a-4c6a-9da8-6588935e9d30 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:24.484884 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfad99-098a-4c6a-9da8-6588935e9d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:24.485288 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfad99-098a-4c6a-9da8-6588935e9d30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:24.485815 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dfad99-098a-4c6a-9da8-6588935e9d30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:24.488659 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dfad99-098a-4c6a-9da8-6588935e9d30 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:24.492517 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25298f0-21f5-4f72-a625-19c389a18412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:24.493392 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25298f0-21f5-4f72-a625-19c389a18412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:24.493743 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25298f0-21f5-4f72-a625-19c389a18412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:24.494088 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25298f0-21f5-4f72-a625-19c389a18412 admin admin] PATH_INFO: `/v3/users/d8983923cad14a20805e8c416110e1f3` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:24.495416 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25298f0-21f5-4f72-a625-19c389a18412 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8983923cad14a20805e8c416110e1f3)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:24.497957 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25298f0-21f5-4f72-a625-19c389a18412 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:24.646299 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 778/1550] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:11:24 2022] POST /identity/v3/projects => generated 385 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:24.650476 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dfad99-098a-4c6a-9da8-6588935e9d30 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:24.747306 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dfad99-098a-4c6a-9da8-6588935e9d30 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:24.752877 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019e74b-2c31-4b9f-b6b6-6f568e558e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:24.753533 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019e74b-2c31-4b9f-b6b6-6f568e558e28 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:24.753984 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019e74b-2c31-4b9f-b6b6-6f568e558e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:24.754263 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019e74b-2c31-4b9f-b6b6-6f568e558e28 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:24.755351 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019e74b-2c31-4b9f-b6b6-6f568e558e28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:24.757432 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019e74b-2c31-4b9f-b6b6-6f568e558e28 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:24.785300 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c25298f0-21f5-4f72-a625-19c389a18412 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8983923cad14a20805e8c416110e1f3'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:24.893014 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c25298f0-21f5-4f72-a625-19c389a18412 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8983923cad14a20805e8c416110e1f3'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:24.901030 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 779/1551] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:11:24 2022] POST /identity/v3/users => generated 299 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:24.904891 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019e74b-2c31-4b9f-b6b6-6f568e558e28 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:24.909217 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c25298f0-21f5-4f72-a625-19c389a18412 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8983923cad14a20805e8c416110e1f3'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:24.915782 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019e74b-2c31-4b9f-b6b6-6f568e558e28 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:24.917671 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c25298f0-21f5-4f72-a625-19c389a18412 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8983923cad14a20805e8c416110e1f3'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:24.918443 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c25298f0-21f5-4f72-a625-19c389a18412 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8983923cad14a20805e8c416110e1f3'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:24.920738 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d2445-d6db-49c4-a3e4-6b870d14a15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:24.921420 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d2445-d6db-49c4-a3e4-6b870d14a15b admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:24.921875 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d2445-d6db-49c4-a3e4-6b870d14a15b admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:24.922218 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d2445-d6db-49c4-a3e4-6b870d14a15b admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:24.922939 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d2445-d6db-49c4-a3e4-6b870d14a15b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:24.924665 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d2445-d6db-49c4-a3e4-6b870d14a15b admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:24.925028 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 773/1552] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:11:24 2022] DELETE /identity/v3/users/d8983923cad14a20805e8c416110e1f3 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:11:24.930062 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3dcc4f-50be-46cc-86bf-0fe14fe32bf6 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:24.930356 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3dcc4f-50be-46cc-86bf-0fe14fe32bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:24.930643 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3dcc4f-50be-46cc-86bf-0fe14fe32bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:24.936342 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 780/1553] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:24.940316 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d2445-d6db-49c4-a3e4-6b870d14a15b admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:24.942066 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-576d2445-d6db-49c4-a3e4-6b870d14a15b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:24.949689 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-bb3dcc4f-50be-46cc-86bf-0fe14fe32bf6 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:24.950883 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-bb3dcc4f-50be-46cc-86bf-0fe14fe32bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:24.960573 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d2445-d6db-49c4-a3e4-6b870d14a15b admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:25.020422 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc8c1e-a2f5-4759-a95c-c6ce59d490af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:25.021025 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc8c1e-a2f5-4759-a95c-c6ce59d490af admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:25.021829 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc8c1e-a2f5-4759-a95c-c6ce59d490af admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:25.022107 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc8c1e-a2f5-4759-a95c-c6ce59d490af admin admin] PATH_INFO: `/v3/projects/7bd8f14c51a14ae5a9b4681b3c48ef99/users/1c45eec12ade4bcb97ff7c8353b82d7f/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:25.023852 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 774/1554] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:25.033631 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3dcc4f-50be-46cc-86bf-0fe14fe32bf6 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:25.035020 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-bb3dcc4f-50be-46cc-86bf-0fe14fe32bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:25.036581 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc8c1e-a2f5-4759-a95c-c6ce59d490af admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bd8f14c51a14ae5a9b4681b3c48ef99, user_id=1c45eec12ade4bcb97ff7c8353b82d7f, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:25.039244 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc8c1e-a2f5-4759-a95c-c6ce59d490af admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:25.091966 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3dcc4f-50be-46cc-86bf-0fe14fe32bf6 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:25.096197 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9475f8-e792-41da-896f-7dd605991e92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:25.096828 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9475f8-e792-41da-896f-7dd605991e92 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:25.097104 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9475f8-e792-41da-896f-7dd605991e92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:25.097377 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9475f8-e792-41da-896f-7dd605991e92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:25.109135 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9475f8-e792-41da-896f-7dd605991e92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:25.113426 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9475f8-e792-41da-896f-7dd605991e92 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:25.127788 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 781/1555] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:24 2022] PUT /identity/v3/projects/7bd8f14c51a14ae5a9b4681b3c48ef99/users/1c45eec12ade4bcb97ff7c8353b82d7f/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:11:25.128427 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 775/1556] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:11:25.133498 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc8c1e-a2f5-4759-a95c-c6ce59d490af admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:25.210399 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc8c1e-a2f5-4759-a95c-c6ce59d490af admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:25.217672 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e87ba5-8520-4e36-9283-84795b3593ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:25.218517 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e87ba5-8520-4e36-9283-84795b3593ac admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:25.218802 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e87ba5-8520-4e36-9283-84795b3593ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:25.219078 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e87ba5-8520-4e36-9283-84795b3593ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:25.219734 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e87ba5-8520-4e36-9283-84795b3593ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:25.221520 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e87ba5-8520-4e36-9283-84795b3593ac admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:25.225138 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:25.241852 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 782/1557] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:25.246208 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9475f8-e792-41da-896f-7dd605991e92 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:25.257271 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9475f8-e792-41da-896f-7dd605991e92 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:25.264109 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb2843-1470-4262-b56d-1f4c8a0522cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:25.271545 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb2843-1470-4262-b56d-1f4c8a0522cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:25.271545 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb2843-1470-4262-b56d-1f4c8a0522cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:25.271545 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb2843-1470-4262-b56d-1f4c8a0522cb admin admin] PATH_INFO: `/v3/projects/7bd8f14c51a14ae5a9b4681b3c48ef99/users/1c45eec12ade4bcb97ff7c8353b82d7f/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:25.271545 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb2843-1470-4262-b56d-1f4c8a0522cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bd8f14c51a14ae5a9b4681b3c48ef99, user_id=1c45eec12ade4bcb97ff7c8353b82d7f, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:25.271545 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb2843-1470-4262-b56d-1f4c8a0522cb admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:25.284106 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 776/1558] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:25 2022] PUT /identity/v3/projects/7bd8f14c51a14ae5a9b4681b3c48ef99/users/1c45eec12ade4bcb97ff7c8353b82d7f/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:25.294597 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb7df7-123c-4296-bc59-a7fa30012c0c None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:25.294987 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb7df7-123c-4296-bc59-a7fa30012c0c None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:25.295294 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb7df7-123c-4296-bc59-a7fa30012c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:25.325797 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-a8cb7df7-123c-4296-bc59-a7fa30012c0c None None] MFA Rules not processed for user `1c45eec12ade4bcb97ff7c8353b82d7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:25.331731 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-a8cb7df7-123c-4296-bc59-a7fa30012c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:25.401162 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 783/1559] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:25 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:25.413470 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb2843-1470-4262-b56d-1f4c8a0522cb admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:25.415181 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-79bb2843-1470-4262-b56d-1f4c8a0522cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:25.478679 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb2843-1470-4262-b56d-1f4c8a0522cb admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:25.483435 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f875cd1-e361-45d9-aa3b-21bd0c410762 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:25.484147 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f875cd1-e361-45d9-aa3b-21bd0c410762 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:25.484428 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f875cd1-e361-45d9-aa3b-21bd0c410762 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:25.484704 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f875cd1-e361-45d9-aa3b-21bd0c410762 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:25.487009 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5f875cd1-e361-45d9-aa3b-21bd0c410762 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:25.561910 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f875cd1-e361-45d9-aa3b-21bd0c410762 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:25.563499 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f875cd1-e361-45d9-aa3b-21bd0c410762 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:25.573977 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 777/1560] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:11:25.602306 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:25.750318 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb7df7-123c-4296-bc59-a7fa30012c0c None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:25.751779 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-a8cb7df7-123c-4296-bc59-a7fa30012c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:25.820149 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb7df7-123c-4296-bc59-a7fa30012c0c None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:25.824573 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33e44d-1dc3-4a31-8a7d-0fafc089e0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:25.825233 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33e44d-1dc3-4a31-8a7d-0fafc089e0cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:25.825511 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33e44d-1dc3-4a31-8a7d-0fafc089e0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:25.825805 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33e44d-1dc3-4a31-8a7d-0fafc089e0cb admin admin] PATH_INFO: `/v3/projects/b5c741eb5378489681e9f0f858a5f00c` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:25.827194 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e33e44d-1dc3-4a31-8a7d-0fafc089e0cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5c741eb5378489681e9f0f858a5f00c)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:25.830719 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e33e44d-1dc3-4a31-8a7d-0fafc089e0cb admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:26.008641 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-3e33e44d-1dc3-4a31-8a7d-0fafc089e0cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5c741eb5378489681e9f0f858a5f00c', 'request_id': 'req-3e33e44d-1dc3-4a31-8a7d-0fafc089e0cb'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:26.080727 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-3e33e44d-1dc3-4a31-8a7d-0fafc089e0cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5c741eb5378489681e9f0f858a5f00c', 'request_id': 'req-3e33e44d-1dc3-4a31-8a7d-0fafc089e0cb'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:26.088266 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-3e33e44d-1dc3-4a31-8a7d-0fafc089e0cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5c741eb5378489681e9f0f858a5f00c', 'request_id': 'req-3e33e44d-1dc3-4a31-8a7d-0fafc089e0cb'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:26.101229 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-3e33e44d-1dc3-4a31-8a7d-0fafc089e0cb admin admin] The token cache is being invalidate because project b5c741eb5378489681e9f0f858a5f00c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:11:26.101521 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-3e33e44d-1dc3-4a31-8a7d-0fafc089e0cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:26.102227 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-3e33e44d-1dc3-4a31-8a7d-0fafc089e0cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:26.103947 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 784/1561] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:11:25 2022] DELETE /identity/v3/projects/b5c741eb5378489681e9f0f858a5f00c => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:26.107873 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f875cd1-e361-45d9-aa3b-21bd0c410762 service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:26.119130 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f875cd1-e361-45d9-aa3b-21bd0c410762 service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:26.175510 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f0345-2279-4c1e-8672-120fdceba727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:26.176183 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f0345-2279-4c1e-8672-120fdceba727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:26.176565 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f0345-2279-4c1e-8672-120fdceba727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:26.176865 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f0345-2279-4c1e-8672-120fdceba727 admin admin] PATH_INFO: `/v3/users/7a9b97466b74491fabfbc727e90a5ac7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:26.178132 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f0345-2279-4c1e-8672-120fdceba727 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a9b97466b74491fabfbc727e90a5ac7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:26.180079 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f0345-2279-4c1e-8672-120fdceba727 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:26.555830 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c60f0345-2279-4c1e-8672-120fdceba727 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a9b97466b74491fabfbc727e90a5ac7'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:26.665572 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c60f0345-2279-4c1e-8672-120fdceba727 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a9b97466b74491fabfbc727e90a5ac7'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:26.697563 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c60f0345-2279-4c1e-8672-120fdceba727 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a9b97466b74491fabfbc727e90a5ac7'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:26.709457 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c60f0345-2279-4c1e-8672-120fdceba727 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a9b97466b74491fabfbc727e90a5ac7'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:26.710532 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c60f0345-2279-4c1e-8672-120fdceba727 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a9b97466b74491fabfbc727e90a5ac7'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:26.740513 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 778/1562] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:11:26 2022] DELETE /identity/v3/users/7a9b97466b74491fabfbc727e90a5ac7 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:27.187217 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33e44d-1dc3-4a31-8a7d-0fafc089e0cb admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:27.190393 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-3e33e44d-1dc3-4a31-8a7d-0fafc089e0cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:27.216275 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33e44d-1dc3-4a31-8a7d-0fafc089e0cb admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:27.283204 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d2f47-8a88-4fb2-96b9-df4556233bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:27.284113 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d2f47-8a88-4fb2-96b9-df4556233bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:27.284552 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d2f47-8a88-4fb2-96b9-df4556233bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:27.285014 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d2f47-8a88-4fb2-96b9-df4556233bbf admin admin] PATH_INFO: `/v3/projects/735bee4eca2d4c32842804e34361f702` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:27.286497 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d2f47-8a88-4fb2-96b9-df4556233bbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=735bee4eca2d4c32842804e34361f702)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:27.289246 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d2f47-8a88-4fb2-96b9-df4556233bbf admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:27.441807 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-675d2f47-8a88-4fb2-96b9-df4556233bbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '735bee4eca2d4c32842804e34361f702', 'request_id': 'req-675d2f47-8a88-4fb2-96b9-df4556233bbf'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:27.549329 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-675d2f47-8a88-4fb2-96b9-df4556233bbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '735bee4eca2d4c32842804e34361f702', 'request_id': 'req-675d2f47-8a88-4fb2-96b9-df4556233bbf'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:27.557450 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-675d2f47-8a88-4fb2-96b9-df4556233bbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '735bee4eca2d4c32842804e34361f702', 'request_id': 'req-675d2f47-8a88-4fb2-96b9-df4556233bbf'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:27.573084 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-675d2f47-8a88-4fb2-96b9-df4556233bbf admin admin] The token cache is being invalidate because project 735bee4eca2d4c32842804e34361f702 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:11:27.573466 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-675d2f47-8a88-4fb2-96b9-df4556233bbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:27.574201 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-675d2f47-8a88-4fb2-96b9-df4556233bbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:27.579344 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 785/1563] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:11:27 2022] DELETE /identity/v3/projects/735bee4eca2d4c32842804e34361f702 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:27.580810 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65ecd0-2e71-406d-9380-bca9503c7347 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:27.581276 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65ecd0-2e71-406d-9380-bca9503c7347 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:27.581380 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65ecd0-2e71-406d-9380-bca9503c7347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:27.602077 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-bf65ecd0-2e71-406d-9380-bca9503c7347 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:27.603294 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-bf65ecd0-2e71-406d-9380-bca9503c7347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:27.665852 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 779/1564] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:27.674800 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb91a5b-dac7-4ee0-8c32-060bc8a7d6b1 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:27.675119 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb91a5b-dac7-4ee0-8c32-060bc8a7d6b1 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:27.675562 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb91a5b-dac7-4ee0-8c32-060bc8a7d6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:27.697634 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-afb91a5b-dac7-4ee0-8c32-060bc8a7d6b1 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:27.698930 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-afb91a5b-dac7-4ee0-8c32-060bc8a7d6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:27.707653 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 786/1565] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:27.712003 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65ecd0-2e71-406d-9380-bca9503c7347 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:27.726720 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65ecd0-2e71-406d-9380-bca9503c7347 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:27.733742 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92788710-ffa7-404b-8b1b-386ae63c3ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:27.734394 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92788710-ffa7-404b-8b1b-386ae63c3ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:27.734676 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92788710-ffa7-404b-8b1b-386ae63c3ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:27.734953 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92788710-ffa7-404b-8b1b-386ae63c3ca4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:27.736200 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92788710-ffa7-404b-8b1b-386ae63c3ca4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:11:27.736511 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92788710-ffa7-404b-8b1b-386ae63c3ca4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:27.739062 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92788710-ffa7-404b-8b1b-386ae63c3ca4 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:27.761318 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 780/1566] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:11:27.764385 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb91a5b-dac7-4ee0-8c32-060bc8a7d6b1 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:27.775069 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb91a5b-dac7-4ee0-8c32-060bc8a7d6b1 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:27.783295 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1eedfc-080b-4666-85a8-65c35a6c2451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:27.783923 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1eedfc-080b-4666-85a8-65c35a6c2451 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:27.784251 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1eedfc-080b-4666-85a8-65c35a6c2451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:27.784512 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1eedfc-080b-4666-85a8-65c35a6c2451 admin admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:27.785158 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1eedfc-080b-4666-85a8-65c35a6c2451 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:27.787133 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1eedfc-080b-4666-85a8-65c35a6c2451 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:27.928114 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 787/1567] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:11:27 2022] POST /identity/v3/projects => generated 387 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:27.931990 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92788710-ffa7-404b-8b1b-386ae63c3ca4 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:27.947520 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92788710-ffa7-404b-8b1b-386ae63c3ca4 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:28.009994 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8d445-0890-4161-8ea9-5a2d2b706f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:28.010627 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8d445-0890-4161-8ea9-5a2d2b706f8c admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:28.010912 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8d445-0890-4161-8ea9-5a2d2b706f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:28.011184 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8d445-0890-4161-8ea9-5a2d2b706f8c admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:28.011815 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8d445-0890-4161-8ea9-5a2d2b706f8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:28.013843 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8d445-0890-4161-8ea9-5a2d2b706f8c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:28.063191 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1eedfc-080b-4666-85a8-65c35a6c2451 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:28.065216 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-0d1eedfc-080b-4666-85a8-65c35a6c2451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:28.086815 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:28.127729 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1eedfc-080b-4666-85a8-65c35a6c2451 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:28.131343 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb0077-0368-41d0-a747-795ee7aac3a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:28.131951 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb0077-0368-41d0-a747-795ee7aac3a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:28.132277 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb0077-0368-41d0-a747-795ee7aac3a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:28.134847 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb0077-0368-41d0-a747-795ee7aac3a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:28.134847 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-eeeb0077-0368-41d0-a747-795ee7aac3a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:28.199392 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb0077-0368-41d0-a747-795ee7aac3a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:28.201018 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb0077-0368-41d0-a747-795ee7aac3a5 service cinder] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:28.206750 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 781/1568] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:11:27 2022] POST /identity/v3/users => generated 294 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:28.207982 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8d445-0890-4161-8ea9-5a2d2b706f8c admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:28.211868 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 788/1569] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:11:28.219886 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8d445-0890-4161-8ea9-5a2d2b706f8c admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:28.227542 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74717263-cf54-487c-9426-ce84036fa234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:28.228350 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74717263-cf54-487c-9426-ce84036fa234 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:28.229604 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74717263-cf54-487c-9426-ce84036fa234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:28.229604 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74717263-cf54-487c-9426-ce84036fa234 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:28.229873 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74717263-cf54-487c-9426-ce84036fa234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:28.232315 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74717263-cf54-487c-9426-ce84036fa234 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:28.252040 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 782/1570] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:28.253264 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb0077-0368-41d0-a747-795ee7aac3a5 service cinder] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:28.270527 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb0077-0368-41d0-a747-795ee7aac3a5 service cinder] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:28.283679 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4302f-3369-4b6d-9d6d-4d3b395dbf5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:28.290517 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4302f-3369-4b6d-9d6d-4d3b395dbf5d admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:28.291026 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4302f-3369-4b6d-9d6d-4d3b395dbf5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:28.291448 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4302f-3369-4b6d-9d6d-4d3b395dbf5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:28.292444 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f4302f-3369-4b6d-9d6d-4d3b395dbf5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:28.294202 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f4302f-3369-4b6d-9d6d-4d3b395dbf5d admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:28.307849 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 789/1571] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:11:28.312650 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74717263-cf54-487c-9426-ce84036fa234 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:28.325554 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74717263-cf54-487c-9426-ce84036fa234 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:28.351348 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667655ee-4212-4e1f-8a44-df6e20ae0bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:28.352096 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667655ee-4212-4e1f-8a44-df6e20ae0bcd admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:28.352384 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667655ee-4212-4e1f-8a44-df6e20ae0bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:28.352666 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667655ee-4212-4e1f-8a44-df6e20ae0bcd admin admin] PATH_INFO: `/v3/projects/d8bd71bdd2354ca0b3f88f7036c0a72b/users/92911734654d43648772d6cd56ebc9d7/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:28.386512 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667655ee-4212-4e1f-8a44-df6e20ae0bcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8bd71bdd2354ca0b3f88f7036c0a72b, user_id=92911734654d43648772d6cd56ebc9d7, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:28.389745 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667655ee-4212-4e1f-8a44-df6e20ae0bcd admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:28.503531 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 783/1572] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:28 2022] PUT /identity/v3/projects/d8bd71bdd2354ca0b3f88f7036c0a72b/users/92911734654d43648772d6cd56ebc9d7/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:11:28.507009 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee7b82-f251-48e0-905e-6174f6b6f8be None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:28.507009 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee7b82-f251-48e0-905e-6174f6b6f8be None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:28.507009 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee7b82-f251-48e0-905e-6174f6b6f8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:28.541323 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-49ee7b82-f251-48e0-905e-6174f6b6f8be None None] MFA Rules not processed for user `92911734654d43648772d6cd56ebc9d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:28.542612 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-49ee7b82-f251-48e0-905e-6174f6b6f8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:28.610840 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 790/1573] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:28.616284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667655ee-4212-4e1f-8a44-df6e20ae0bcd admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:28.685387 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667655ee-4212-4e1f-8a44-df6e20ae0bcd admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:28.690222 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090606d-4199-4ff5-a606-eda4992168d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:28.690845 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090606d-4199-4ff5-a606-eda4992168d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:28.691126 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090606d-4199-4ff5-a606-eda4992168d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:28.691402 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090606d-4199-4ff5-a606-eda4992168d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:28.692080 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090606d-4199-4ff5-a606-eda4992168d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:28.694048 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090606d-4199-4ff5-a606-eda4992168d1 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:28.854359 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 784/1574] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:11:28 2022] POST /identity/v3/projects => generated 385 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:28.858477 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee7b82-f251-48e0-905e-6174f6b6f8be None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:28.870189 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee7b82-f251-48e0-905e-6174f6b6f8be None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:28.933224 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef33da-5a5b-4b78-88bb-d7ca3a845166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:28.933856 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef33da-5a5b-4b78-88bb-d7ca3a845166 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:28.934144 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef33da-5a5b-4b78-88bb-d7ca3a845166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:28.934420 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef33da-5a5b-4b78-88bb-d7ca3a845166 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:28.935098 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef33da-5a5b-4b78-88bb-d7ca3a845166 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:28.937356 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef33da-5a5b-4b78-88bb-d7ca3a845166 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:29.105974 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 791/1575] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:11:28 2022] POST /identity/v3/users => generated 299 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:29.107322 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090606d-4199-4ff5-a606-eda4992168d1 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:29.120667 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090606d-4199-4ff5-a606-eda4992168d1 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:29.125182 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9948cd-4430-43f2-807b-3fefb48ab9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:29.125823 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9948cd-4430-43f2-807b-3fefb48ab9af admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:29.126388 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9948cd-4430-43f2-807b-3fefb48ab9af admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:29.126667 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9948cd-4430-43f2-807b-3fefb48ab9af admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:29.127338 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9948cd-4430-43f2-807b-3fefb48ab9af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:29.129013 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9948cd-4430-43f2-807b-3fefb48ab9af admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:29.140134 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 785/1576] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:29.144668 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef33da-5a5b-4b78-88bb-d7ca3a845166 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:29.155720 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef33da-5a5b-4b78-88bb-d7ca3a845166 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:29.160425 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ed87a-84df-431f-9ba4-188a9af78ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:29.161097 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ed87a-84df-431f-9ba4-188a9af78ae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:29.161382 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ed87a-84df-431f-9ba4-188a9af78ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:29.161690 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ed87a-84df-431f-9ba4-188a9af78ae5 admin admin] PATH_INFO: `/v3/projects/435f8994835445ae91f7e47309574836/users/224f88b8e40d487f90957f31bdb6418f/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:29.179043 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ed87a-84df-431f-9ba4-188a9af78ae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=435f8994835445ae91f7e47309574836, user_id=224f88b8e40d487f90957f31bdb6418f, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:29.181726 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ed87a-84df-431f-9ba4-188a9af78ae5 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:29.264593 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:29.316259 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 792/1577] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:29 2022] PUT /identity/v3/projects/435f8994835445ae91f7e47309574836/users/224f88b8e40d487f90957f31bdb6418f/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:29.319991 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9948cd-4430-43f2-807b-3fefb48ab9af admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:29.337136 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9948cd-4430-43f2-807b-3fefb48ab9af admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:29.397166 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0f8f6-6621-4061-ba7e-6c19be366cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:29.397784 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0f8f6-6621-4061-ba7e-6c19be366cbd admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:29.398091 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0f8f6-6621-4061-ba7e-6c19be366cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:29.398367 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0f8f6-6621-4061-ba7e-6c19be366cbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:29.399007 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0f8f6-6621-4061-ba7e-6c19be366cbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:29.400837 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0f8f6-6621-4061-ba7e-6c19be366cbd admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:29.411075 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 786/1578] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:29.416214 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ed87a-84df-431f-9ba4-188a9af78ae5 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:29.426786 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ed87a-84df-431f-9ba4-188a9af78ae5 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:29.432639 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a01bcc-9a8e-48d7-9b41-e4ca53f6167b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:29.433329 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a01bcc-9a8e-48d7-9b41-e4ca53f6167b admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:29.433584 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a01bcc-9a8e-48d7-9b41-e4ca53f6167b admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:29.434041 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a01bcc-9a8e-48d7-9b41-e4ca53f6167b admin admin] PATH_INFO: `/v3/projects/435f8994835445ae91f7e47309574836/users/224f88b8e40d487f90957f31bdb6418f/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:29.436904 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a01bcc-9a8e-48d7-9b41-e4ca53f6167b admin admin] RBAC: Authorizing `identity:create_grant(project_id=435f8994835445ae91f7e47309574836, user_id=224f88b8e40d487f90957f31bdb6418f, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:29.439408 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a01bcc-9a8e-48d7-9b41-e4ca53f6167b admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:29.451567 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 793/1579] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:29 2022] PUT /identity/v3/projects/435f8994835445ae91f7e47309574836/users/224f88b8e40d487f90957f31bdb6418f/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:29.462131 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e49339-f16c-4151-b5bf-3ded744d761f None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:29.463240 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e49339-f16c-4151-b5bf-3ded744d761f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:29.463589 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e49339-f16c-4151-b5bf-3ded744d761f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:29.499584 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-e4e49339-f16c-4151-b5bf-3ded744d761f None None] MFA Rules not processed for user `224f88b8e40d487f90957f31bdb6418f`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:29.500873 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e4e49339-f16c-4151-b5bf-3ded744d761f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:29.572468 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 787/1580] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:29 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:30.105516 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a01bcc-9a8e-48d7-9b41-e4ca53f6167b admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:30.165120 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a01bcc-9a8e-48d7-9b41-e4ca53f6167b admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:30.169290 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f9ec7-d716-463c-9614-17391ecf3b95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:30.170429 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f9ec7-d716-463c-9614-17391ecf3b95 service cinder] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:30.171070 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f9ec7-d716-463c-9614-17391ecf3b95 service cinder] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:30.171070 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f9ec7-d716-463c-9614-17391ecf3b95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:30.184259 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f9ec7-d716-463c-9614-17391ecf3b95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:30.187386 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f9ec7-d716-463c-9614-17391ecf3b95 service cinder] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:30.196740 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 794/1581] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:30 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:30.583972 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e49339-f16c-4151-b5bf-3ded744d761f None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:30.585530 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e4e49339-f16c-4151-b5bf-3ded744d761f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:30.700199 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f9ec7-d716-463c-9614-17391ecf3b95 service cinder] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:30.701856 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-b60f9ec7-d716-463c-9614-17391ecf3b95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:30.714833 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f9ec7-d716-463c-9614-17391ecf3b95 service cinder] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:30.719255 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7e5bb-d2e2-4ddf-a20d-63dfb9d92b54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:30.720139 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7e5bb-d2e2-4ddf-a20d-63dfb9d92b54 service cinder] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:30.720591 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7e5bb-d2e2-4ddf-a20d-63dfb9d92b54 service cinder] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:30.720863 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7e5bb-d2e2-4ddf-a20d-63dfb9d92b54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:30.722982 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-fdc7e5bb-d2e2-4ddf-a20d-63dfb9d92b54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:30.723874 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e49339-f16c-4151-b5bf-3ded744d761f None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:30.730746 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d58505-a1e1-44ec-aa4f-ac2d6b75dcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:30.731526 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d58505-a1e1-44ec-aa4f-ac2d6b75dcb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:30.732016 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d58505-a1e1-44ec-aa4f-ac2d6b75dcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:30.732447 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d58505-a1e1-44ec-aa4f-ac2d6b75dcb4 admin admin] PATH_INFO: `/v3/users/d12855a5aa7b44618513f1a7f18e66a3` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:30.733682 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d58505-a1e1-44ec-aa4f-ac2d6b75dcb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d12855a5aa7b44618513f1a7f18e66a3)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:30.736420 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d58505-a1e1-44ec-aa4f-ac2d6b75dcb4 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:30.810654 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc7e5bb-d2e2-4ddf-a20d-63dfb9d92b54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:30.812267 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc7e5bb-d2e2-4ddf-a20d-63dfb9d92b54 service cinder] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:30.823167 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 795/1582] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:30 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:11:31.124906 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f3d58505-a1e1-44ec-aa4f-ac2d6b75dcb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd12855a5aa7b44618513f1a7f18e66a3'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:31.230152 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f3d58505-a1e1-44ec-aa4f-ac2d6b75dcb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd12855a5aa7b44618513f1a7f18e66a3'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:31.256308 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f3d58505-a1e1-44ec-aa4f-ac2d6b75dcb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd12855a5aa7b44618513f1a7f18e66a3'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:31.266276 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f3d58505-a1e1-44ec-aa4f-ac2d6b75dcb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd12855a5aa7b44618513f1a7f18e66a3'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:31.267039 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f3d58505-a1e1-44ec-aa4f-ac2d6b75dcb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd12855a5aa7b44618513f1a7f18e66a3'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:31.275570 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 788/1583] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:11:30 2022] DELETE /identity/v3/users/d12855a5aa7b44618513f1a7f18e66a3 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:31.289455 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5404a1-b432-429d-9eeb-a8b21c636c2a None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:31.290270 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5404a1-b432-429d-9eeb-a8b21c636c2a None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:31.291040 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5404a1-b432-429d-9eeb-a8b21c636c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:31.311685 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-db5404a1-b432-429d-9eeb-a8b21c636c2a None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:31.312911 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-db5404a1-b432-429d-9eeb-a8b21c636c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:31.387890 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 796/1584] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:31.398450 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d58505-a1e1-44ec-aa4f-ac2d6b75dcb4 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:31.399930 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f3d58505-a1e1-44ec-aa4f-ac2d6b75dcb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:31.459119 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d58505-a1e1-44ec-aa4f-ac2d6b75dcb4 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:31.462844 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d375d8e-b9c6-4ea8-b6d6-456a3c9b9f7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:31.463770 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d375d8e-b9c6-4ea8-b6d6-456a3c9b9f7d service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:31.468583 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d375d8e-b9c6-4ea8-b6d6-456a3c9b9f7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:31.468908 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d375d8e-b9c6-4ea8-b6d6-456a3c9b9f7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:31.479286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d375d8e-b9c6-4ea8-b6d6-456a3c9b9f7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:31.480803 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d375d8e-b9c6-4ea8-b6d6-456a3c9b9f7d service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:31.496541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 789/1585] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:31.932927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:31.970997 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5404a1-b432-429d-9eeb-a8b21c636c2a None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:31.972517 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-db5404a1-b432-429d-9eeb-a8b21c636c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:31.987299 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5404a1-b432-429d-9eeb-a8b21c636c2a None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:32.003840 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645fb9cb-d472-4719-9201-9ef44100b84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:32.004788 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645fb9cb-d472-4719-9201-9ef44100b84b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:32.005791 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645fb9cb-d472-4719-9201-9ef44100b84b admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:32.006072 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645fb9cb-d472-4719-9201-9ef44100b84b admin admin] PATH_INFO: `/v3/projects/5a22609002534e7bad6ad60df4831535` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:32.007512 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645fb9cb-d472-4719-9201-9ef44100b84b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a22609002534e7bad6ad60df4831535)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:32.009906 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645fb9cb-d472-4719-9201-9ef44100b84b admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:32.073550 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d375d8e-b9c6-4ea8-b6d6-456a3c9b9f7d service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:32.075967 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5d375d8e-b9c6-4ea8-b6d6-456a3c9b9f7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:32.095778 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d375d8e-b9c6-4ea8-b6d6-456a3c9b9f7d service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:32.105589 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd1739-97a9-4f80-834b-49fc905f56cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:32.106419 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd1739-97a9-4f80-834b-49fc905f56cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:32.106682 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd1739-97a9-4f80-834b-49fc905f56cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:32.106955 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd1739-97a9-4f80-834b-49fc905f56cc admin admin] PATH_INFO: `/v3/users/92911734654d43648772d6cd56ebc9d7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:32.108144 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd1739-97a9-4f80-834b-49fc905f56cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=92911734654d43648772d6cd56ebc9d7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:32.110080 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd1739-97a9-4f80-834b-49fc905f56cc admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:32.195631 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-645fb9cb-d472-4719-9201-9ef44100b84b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a22609002534e7bad6ad60df4831535', 'request_id': 'req-645fb9cb-d472-4719-9201-9ef44100b84b'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:32.356639 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-645fb9cb-d472-4719-9201-9ef44100b84b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a22609002534e7bad6ad60df4831535', 'request_id': 'req-645fb9cb-d472-4719-9201-9ef44100b84b'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:32.368744 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-645fb9cb-d472-4719-9201-9ef44100b84b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a22609002534e7bad6ad60df4831535', 'request_id': 'req-645fb9cb-d472-4719-9201-9ef44100b84b'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:32.374827 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-67fd1739-97a9-4f80-834b-49fc905f56cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92911734654d43648772d6cd56ebc9d7'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:32.387164 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-645fb9cb-d472-4719-9201-9ef44100b84b admin admin] The token cache is being invalidate because project 5a22609002534e7bad6ad60df4831535 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:11:32.387534 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-645fb9cb-d472-4719-9201-9ef44100b84b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:32.388252 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-645fb9cb-d472-4719-9201-9ef44100b84b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:32.389858 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 797/1586] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:11:31 2022] DELETE /identity/v3/projects/5a22609002534e7bad6ad60df4831535 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:11:32.394290 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645fb9cb-d472-4719-9201-9ef44100b84b admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:32.395673 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-645fb9cb-d472-4719-9201-9ef44100b84b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:32.465796 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645fb9cb-d472-4719-9201-9ef44100b84b admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:32.470758 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858d3d2-3d89-4e0e-9e10-f0913082e687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:32.471442 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858d3d2-3d89-4e0e-9e10-f0913082e687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:32.471812 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858d3d2-3d89-4e0e-9e10-f0913082e687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:32.472155 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858d3d2-3d89-4e0e-9e10-f0913082e687 admin admin] PATH_INFO: `/v3/users/1ee683384d3e472581a5bfbfebdebee6` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:32.473306 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a858d3d2-3d89-4e0e-9e10-f0913082e687 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ee683384d3e472581a5bfbfebdebee6)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:32.475309 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a858d3d2-3d89-4e0e-9e10-f0913082e687 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:32.508092 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-67fd1739-97a9-4f80-834b-49fc905f56cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92911734654d43648772d6cd56ebc9d7'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:32.525280 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-67fd1739-97a9-4f80-834b-49fc905f56cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92911734654d43648772d6cd56ebc9d7'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:32.532292 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-67fd1739-97a9-4f80-834b-49fc905f56cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92911734654d43648772d6cd56ebc9d7'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:32.533027 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-67fd1739-97a9-4f80-834b-49fc905f56cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92911734654d43648772d6cd56ebc9d7'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:32.539908 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 790/1587] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:11:32 2022] DELETE /identity/v3/users/92911734654d43648772d6cd56ebc9d7 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:11:32.544308 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b685ab-50ed-40d5-bd1d-efa4d40beb96 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:32.568738 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b685ab-50ed-40d5-bd1d-efa4d40beb96 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:32.568738 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b685ab-50ed-40d5-bd1d-efa4d40beb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:32.568738 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-31b685ab-50ed-40d5-bd1d-efa4d40beb96 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:32.568738 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-31b685ab-50ed-40d5-bd1d-efa4d40beb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:32.622526 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 791/1588] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:11:32.632237 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b685ab-50ed-40d5-bd1d-efa4d40beb96 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:32.633544 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-31b685ab-50ed-40d5-bd1d-efa4d40beb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:32.698592 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b685ab-50ed-40d5-bd1d-efa4d40beb96 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:32.699013 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-a858d3d2-3d89-4e0e-9e10-f0913082e687 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ee683384d3e472581a5bfbfebdebee6'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:32.702556 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2280499-19b4-4dd3-bf61-4776ef7d581c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:32.703168 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2280499-19b4-4dd3-bf61-4776ef7d581c service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:32.703465 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2280499-19b4-4dd3-bf61-4776ef7d581c service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:32.703718 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2280499-19b4-4dd3-bf61-4776ef7d581c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:32.712822 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2280499-19b4-4dd3-bf61-4776ef7d581c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:32.714370 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2280499-19b4-4dd3-bf61-4776ef7d581c service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:32.725311 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 792/1589] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:11:32.803138 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-a858d3d2-3d89-4e0e-9e10-f0913082e687 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ee683384d3e472581a5bfbfebdebee6'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:32.828333 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:32.829075 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-a858d3d2-3d89-4e0e-9e10-f0913082e687 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ee683384d3e472581a5bfbfebdebee6'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:32.829982 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-a858d3d2-3d89-4e0e-9e10-f0913082e687 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ee683384d3e472581a5bfbfebdebee6'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:32.838413 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-a858d3d2-3d89-4e0e-9e10-f0913082e687 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ee683384d3e472581a5bfbfebdebee6'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:32.845442 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 798/1590] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:11:32 2022] DELETE /identity/v3/users/1ee683384d3e472581a5bfbfebdebee6 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:32.849621 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2280499-19b4-4dd3-bf61-4776ef7d581c service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:32.851009 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f2280499-19b4-4dd3-bf61-4776ef7d581c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:32.866544 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2280499-19b4-4dd3-bf61-4776ef7d581c service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:32.935925 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20918cd4-98c2-4cb4-ac8c-6b82bdce8726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:32.937133 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20918cd4-98c2-4cb4-ac8c-6b82bdce8726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:32.937246 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20918cd4-98c2-4cb4-ac8c-6b82bdce8726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:32.937595 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20918cd4-98c2-4cb4-ac8c-6b82bdce8726 admin admin] PATH_INFO: `/v3/users/410ca55b31ca4ca49baff54f1845fbf0` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:32.939949 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20918cd4-98c2-4cb4-ac8c-6b82bdce8726 admin admin] RBAC: Authorizing `identity:delete_user(user_id=410ca55b31ca4ca49baff54f1845fbf0)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:32.941970 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20918cd4-98c2-4cb4-ac8c-6b82bdce8726 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:33.153434 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-20918cd4-98c2-4cb4-ac8c-6b82bdce8726 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '410ca55b31ca4ca49baff54f1845fbf0'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:33.281188 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-20918cd4-98c2-4cb4-ac8c-6b82bdce8726 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '410ca55b31ca4ca49baff54f1845fbf0'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:33.295544 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-20918cd4-98c2-4cb4-ac8c-6b82bdce8726 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '410ca55b31ca4ca49baff54f1845fbf0'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:33.306002 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-20918cd4-98c2-4cb4-ac8c-6b82bdce8726 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '410ca55b31ca4ca49baff54f1845fbf0'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:33.306810 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-20918cd4-98c2-4cb4-ac8c-6b82bdce8726 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '410ca55b31ca4ca49baff54f1845fbf0'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:33.314328 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 793/1591] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:11:32 2022] DELETE /identity/v3/users/410ca55b31ca4ca49baff54f1845fbf0 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:33.321599 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858d3d2-3d89-4e0e-9e10-f0913082e687 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:33.323474 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-a858d3d2-3d89-4e0e-9e10-f0913082e687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:33.326232 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c590c19-5925-4672-a97a-8e0b72fe60e2 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:33.327773 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c590c19-5925-4672-a97a-8e0b72fe60e2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:33.329200 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c590c19-5925-4672-a97a-8e0b72fe60e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:33.352958 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858d3d2-3d89-4e0e-9e10-f0913082e687 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:33.367069 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-3c590c19-5925-4672-a97a-8e0b72fe60e2 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:33.369969 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3c590c19-5925-4672-a97a-8e0b72fe60e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:33.453407 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e54af0-a600-4bca-a206-b0d433de9632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:33.454104 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e54af0-a600-4bca-a206-b0d433de9632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:33.467626 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e54af0-a600-4bca-a206-b0d433de9632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:33.467626 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e54af0-a600-4bca-a206-b0d433de9632 admin admin] PATH_INFO: `/v3/projects/d8bd71bdd2354ca0b3f88f7036c0a72b` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:33.467626 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e54af0-a600-4bca-a206-b0d433de9632 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8bd71bdd2354ca0b3f88f7036c0a72b)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:33.467626 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e54af0-a600-4bca-a206-b0d433de9632 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:33.468107 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 794/1592] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:33.468107 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c590c19-5925-4672-a97a-8e0b72fe60e2 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:33.469502 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3c590c19-5925-4672-a97a-8e0b72fe60e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:33.482138 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c590c19-5925-4672-a97a-8e0b72fe60e2 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:33.487186 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8a0e4-7c8c-484f-8a6f-c85f2a2beb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:33.487825 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8a0e4-7c8c-484f-8a6f-c85f2a2beb69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:33.488200 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8a0e4-7c8c-484f-8a6f-c85f2a2beb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:33.488503 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8a0e4-7c8c-484f-8a6f-c85f2a2beb69 admin admin] PATH_INFO: `/v3/projects/20eeb634e6f7400daa0042e31e4d28a0` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:33.490458 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e8a0e4-7c8c-484f-8a6f-c85f2a2beb69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20eeb634e6f7400daa0042e31e4d28a0)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:33.491705 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e8a0e4-7c8c-484f-8a6f-c85f2a2beb69 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:33.601763 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-d1e54af0-a600-4bca-a206-b0d433de9632 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8bd71bdd2354ca0b3f88f7036c0a72b', 'request_id': 'req-d1e54af0-a600-4bca-a206-b0d433de9632'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:33.637725 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-76e8a0e4-7c8c-484f-8a6f-c85f2a2beb69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20eeb634e6f7400daa0042e31e4d28a0', 'request_id': 'req-76e8a0e4-7c8c-484f-8a6f-c85f2a2beb69'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:33.644088 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-76e8a0e4-7c8c-484f-8a6f-c85f2a2beb69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20eeb634e6f7400daa0042e31e4d28a0', 'request_id': 'req-76e8a0e4-7c8c-484f-8a6f-c85f2a2beb69'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:33.669888 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-d1e54af0-a600-4bca-a206-b0d433de9632 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8bd71bdd2354ca0b3f88f7036c0a72b', 'request_id': 'req-d1e54af0-a600-4bca-a206-b0d433de9632'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:33.677276 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-d1e54af0-a600-4bca-a206-b0d433de9632 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8bd71bdd2354ca0b3f88f7036c0a72b', 'request_id': 'req-d1e54af0-a600-4bca-a206-b0d433de9632'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:33.689350 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-d1e54af0-a600-4bca-a206-b0d433de9632 admin admin] The token cache is being invalidate because project d8bd71bdd2354ca0b3f88f7036c0a72b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:11:33.689636 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-d1e54af0-a600-4bca-a206-b0d433de9632 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:33.690257 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-d1e54af0-a600-4bca-a206-b0d433de9632 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:33.691923 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 799/1593] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:11:33 2022] DELETE /identity/v3/projects/d8bd71bdd2354ca0b3f88f7036c0a72b => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:33.695482 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e54af0-a600-4bca-a206-b0d433de9632 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:33.695482 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-d1e54af0-a600-4bca-a206-b0d433de9632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:33.702434 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:33.743879 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-76e8a0e4-7c8c-484f-8a6f-c85f2a2beb69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20eeb634e6f7400daa0042e31e4d28a0', 'request_id': 'req-76e8a0e4-7c8c-484f-8a6f-c85f2a2beb69'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:33.752399 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e54af0-a600-4bca-a206-b0d433de9632 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:33.755145 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-76e8a0e4-7c8c-484f-8a6f-c85f2a2beb69 admin admin] The token cache is being invalidate because project 20eeb634e6f7400daa0042e31e4d28a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:11:33.755439 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-76e8a0e4-7c8c-484f-8a6f-c85f2a2beb69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:33.756659 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-76e8a0e4-7c8c-484f-8a6f-c85f2a2beb69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:33.758177 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 795/1594] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:11:33 2022] DELETE /identity/v3/projects/20eeb634e6f7400daa0042e31e4d28a0 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:33.761552 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8a0e4-7c8c-484f-8a6f-c85f2a2beb69 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:33.761552 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-76e8a0e4-7c8c-484f-8a6f-c85f2a2beb69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:33.804188 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857b14d-46c6-472a-a25e-e9ee4a6cfc56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:33.804800 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857b14d-46c6-472a-a25e-e9ee4a6cfc56 service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:33.805081 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857b14d-46c6-472a-a25e-e9ee4a6cfc56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:33.805476 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857b14d-46c6-472a-a25e-e9ee4a6cfc56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:33.807121 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-9857b14d-46c6-472a-a25e-e9ee4a6cfc56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:33.824722 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8a0e4-7c8c-484f-8a6f-c85f2a2beb69 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:33.830115 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d67239-6c96-443b-a0d4-b011893a348a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:33.830743 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d67239-6c96-443b-a0d4-b011893a348a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:33.831064 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d67239-6c96-443b-a0d4-b011893a348a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:33.831340 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d67239-6c96-443b-a0d4-b011893a348a admin admin] PATH_INFO: `/v3/users/224f88b8e40d487f90957f31bdb6418f` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:33.832525 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d67239-6c96-443b-a0d4-b011893a348a admin admin] RBAC: Authorizing `identity:delete_user(user_id=224f88b8e40d487f90957f31bdb6418f)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:33.834538 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d67239-6c96-443b-a0d4-b011893a348a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:33.873117 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9857b14d-46c6-472a-a25e-e9ee4a6cfc56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:33.874539 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9857b14d-46c6-472a-a25e-e9ee4a6cfc56 service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:33.884471 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 800/1595] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:33.885834 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8324a3-3c3f-48bf-b854-fc1fb1edf091 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:33.886119 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8324a3-3c3f-48bf-b854-fc1fb1edf091 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:33.886388 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8324a3-3c3f-48bf-b854-fc1fb1edf091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:33.906677 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-ac8324a3-3c3f-48bf-b854-fc1fb1edf091 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:33.907893 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-ac8324a3-3c3f-48bf-b854-fc1fb1edf091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:33.916494 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 801/1596] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:33.924132 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41a6b9-d8ef-42e9-adae-a8a0dd197a7c None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:33.924371 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41a6b9-d8ef-42e9-adae-a8a0dd197a7c None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:33.924687 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41a6b9-d8ef-42e9-adae-a8a0dd197a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:33.945006 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-5c41a6b9-d8ef-42e9-adae-a8a0dd197a7c None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:33.946211 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-5c41a6b9-d8ef-42e9-adae-a8a0dd197a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:33.955319 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 802/1597] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:11:33.963096 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41a6b9-d8ef-42e9-adae-a8a0dd197a7c None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:33.976734 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41a6b9-d8ef-42e9-adae-a8a0dd197a7c None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:33.981737 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0619a9d-a0c3-425f-8d81-64d15c0b7c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:33.982348 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0619a9d-a0c3-425f-8d81-64d15c0b7c6e admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:33.982627 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0619a9d-a0c3-425f-8d81-64d15c0b7c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:33.982898 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0619a9d-a0c3-425f-8d81-64d15c0b7c6e admin admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:33.983555 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0619a9d-a0c3-425f-8d81-64d15c0b7c6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:11:33.983859 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0619a9d-a0c3-425f-8d81-64d15c0b7c6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:33.985491 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0619a9d-a0c3-425f-8d81-64d15c0b7c6e admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:33.997248 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 803/1598] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 11:11:34.001376 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0619a9d-a0c3-425f-8d81-64d15c0b7c6e admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:34.011231 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0619a9d-a0c3-425f-8d81-64d15c0b7c6e admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:34.015762 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bba46-d789-44e8-bd7e-bc4301617ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:34.016363 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bba46-d789-44e8-bd7e-bc4301617ee2 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:34.016641 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bba46-d789-44e8-bd7e-bc4301617ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:34.016919 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bba46-d789-44e8-bd7e-bc4301617ee2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:34.017531 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453bba46-d789-44e8-bd7e-bc4301617ee2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:34.019395 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453bba46-d789-44e8-bd7e-bc4301617ee2 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:34.130427 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-60d67239-6c96-443b-a0d4-b011893a348a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '224f88b8e40d487f90957f31bdb6418f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:34.159842 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 804/1599] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:11:34 2022] POST /identity/v3/projects => generated 381 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:11:34.159842 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bba46-d789-44e8-bd7e-bc4301617ee2 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:34.228473 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-60d67239-6c96-443b-a0d4-b011893a348a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '224f88b8e40d487f90957f31bdb6418f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:34.237005 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bba46-d789-44e8-bd7e-bc4301617ee2 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:34.243137 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77fe83-2bb2-4012-bc7a-0313e9b3c0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:34.243758 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77fe83-2bb2-4012-bc7a-0313e9b3c0c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:34.244141 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77fe83-2bb2-4012-bc7a-0313e9b3c0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:34.244425 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77fe83-2bb2-4012-bc7a-0313e9b3c0c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:34.245068 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b77fe83-2bb2-4012-bc7a-0313e9b3c0c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:34.245831 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-60d67239-6c96-443b-a0d4-b011893a348a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '224f88b8e40d487f90957f31bdb6418f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:34.247267 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b77fe83-2bb2-4012-bc7a-0313e9b3c0c6 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:34.255449 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-60d67239-6c96-443b-a0d4-b011893a348a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '224f88b8e40d487f90957f31bdb6418f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:34.257108 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-60d67239-6c96-443b-a0d4-b011893a348a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '224f88b8e40d487f90957f31bdb6418f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:34.266291 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 796/1600] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:11:33 2022] DELETE /identity/v3/users/224f88b8e40d487f90957f31bdb6418f => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:34.461528 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 805/1601] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:11:34 2022] POST /identity/v3/users => generated 291 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:34.463682 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77fe83-2bb2-4012-bc7a-0313e9b3c0c6 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:34.464082 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d67239-6c96-443b-a0d4-b011893a348a admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:34.465940 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-8b77fe83-2bb2-4012-bc7a-0313e9b3c0c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:34.466622 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-60d67239-6c96-443b-a0d4-b011893a348a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:34.539614 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77fe83-2bb2-4012-bc7a-0313e9b3c0c6 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:34.573178 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d67239-6c96-443b-a0d4-b011893a348a admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:34.583118 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08baa743-4b0c-43f7-8067-beca30e4d407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:34.583818 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08baa743-4b0c-43f7-8067-beca30e4d407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:34.584133 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08baa743-4b0c-43f7-8067-beca30e4d407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:34.584413 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08baa743-4b0c-43f7-8067-beca30e4d407 admin admin] PATH_INFO: `/v3/projects/ab751f2339bf4dcc8f740d2a775da7ea` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:34.585714 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08baa743-4b0c-43f7-8067-beca30e4d407 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab751f2339bf4dcc8f740d2a775da7ea)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:34.587707 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08baa743-4b0c-43f7-8067-beca30e4d407 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:34.641275 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be8555-bb30-497c-8d4c-8d41f00e8fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:34.641893 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be8555-bb30-497c-8d4c-8d41f00e8fff admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:34.642178 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be8555-bb30-497c-8d4c-8d41f00e8fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:34.642457 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be8555-bb30-497c-8d4c-8d41f00e8fff admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:34.643109 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be8555-bb30-497c-8d4c-8d41f00e8fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:34.644761 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be8555-bb30-497c-8d4c-8d41f00e8fff admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:34.655302 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 806/1602] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:34.659108 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be8555-bb30-497c-8d4c-8d41f00e8fff admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:34.668760 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be8555-bb30-497c-8d4c-8d41f00e8fff admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:34.673269 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f54375-e7bb-44b1-b67c-5f19413809e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:34.673874 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f54375-e7bb-44b1-b67c-5f19413809e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:34.674155 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f54375-e7bb-44b1-b67c-5f19413809e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:34.674433 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f54375-e7bb-44b1-b67c-5f19413809e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:34.675055 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f54375-e7bb-44b1-b67c-5f19413809e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:34.676684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f54375-e7bb-44b1-b67c-5f19413809e3 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:34.687348 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 807/1603] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:11:34.691383 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f54375-e7bb-44b1-b67c-5f19413809e3 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:34.701546 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f54375-e7bb-44b1-b67c-5f19413809e3 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:34.707853 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f7546-6917-40d9-83cf-86e3d3ce67df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:34.708558 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f7546-6917-40d9-83cf-86e3d3ce67df admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:34.708875 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f7546-6917-40d9-83cf-86e3d3ce67df admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:34.709144 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f7546-6917-40d9-83cf-86e3d3ce67df admin admin] PATH_INFO: `/v3/projects/610b17527a5a420494edc4b8cfff4559/users/0652ea7bfed0413796c65f58c1b2c5b8/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:34.725820 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f7546-6917-40d9-83cf-86e3d3ce67df admin admin] RBAC: Authorizing `identity:create_grant(project_id=610b17527a5a420494edc4b8cfff4559, user_id=0652ea7bfed0413796c65f58c1b2c5b8, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:34.728719 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f7546-6917-40d9-83cf-86e3d3ce67df admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:34.883767 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 808/1604] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:34 2022] PUT /identity/v3/projects/610b17527a5a420494edc4b8cfff4559/users/0652ea7bfed0413796c65f58c1b2c5b8/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:11:34.885436 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99f279-91c8-4f50-a080-70ac0257adeb None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:34.885771 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99f279-91c8-4f50-a080-70ac0257adeb None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:34.886004 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99f279-91c8-4f50-a080-70ac0257adeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:34.887668 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-08baa743-4b0c-43f7-8067-beca30e4d407 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab751f2339bf4dcc8f740d2a775da7ea', 'request_id': 'req-08baa743-4b0c-43f7-8067-beca30e4d407'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:34.895327 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:34.899492 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-08baa743-4b0c-43f7-8067-beca30e4d407 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab751f2339bf4dcc8f740d2a775da7ea', 'request_id': 'req-08baa743-4b0c-43f7-8067-beca30e4d407'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:34.920903 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-7b99f279-91c8-4f50-a080-70ac0257adeb None None] MFA Rules not processed for user `0652ea7bfed0413796c65f58c1b2c5b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:34.922123 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-7b99f279-91c8-4f50-a080-70ac0257adeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:34.979226 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-08baa743-4b0c-43f7-8067-beca30e4d407 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab751f2339bf4dcc8f740d2a775da7ea', 'request_id': 'req-08baa743-4b0c-43f7-8067-beca30e4d407'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:34.993123 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-08baa743-4b0c-43f7-8067-beca30e4d407 admin admin] The token cache is being invalidate because project ab751f2339bf4dcc8f740d2a775da7ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:11:34.993422 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-08baa743-4b0c-43f7-8067-beca30e4d407 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:34.994143 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-08baa743-4b0c-43f7-8067-beca30e4d407 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:34.996466 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 797/1605] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:11:34 2022] DELETE /identity/v3/projects/ab751f2339bf4dcc8f740d2a775da7ea => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:34.997013 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08baa743-4b0c-43f7-8067-beca30e4d407 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:34.999114 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-08baa743-4b0c-43f7-8067-beca30e4d407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:35.010037 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 809/1606] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:35.011959 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99f279-91c8-4f50-a080-70ac0257adeb None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:35.097802 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99f279-91c8-4f50-a080-70ac0257adeb None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:35.105073 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67646c31-ba84-4b1c-b0a9-5100aee6881a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:35.105891 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67646c31-ba84-4b1c-b0a9-5100aee6881a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:35.106289 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67646c31-ba84-4b1c-b0a9-5100aee6881a admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:35.107697 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67646c31-ba84-4b1c-b0a9-5100aee6881a admin admin] PATH_INFO: `/v3/users/f59a1b7b96374f1c873eccd8f3051d25` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:35.109022 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67646c31-ba84-4b1c-b0a9-5100aee6881a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f59a1b7b96374f1c873eccd8f3051d25)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:35.111394 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67646c31-ba84-4b1c-b0a9-5100aee6881a admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:35.118162 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08baa743-4b0c-43f7-8067-beca30e4d407 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:35.131299 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f6190-4b5c-45df-a0d8-378c47514769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:35.131969 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f6190-4b5c-45df-a0d8-378c47514769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:35.132273 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f6190-4b5c-45df-a0d8-378c47514769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:35.132546 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f6190-4b5c-45df-a0d8-378c47514769 admin admin] PATH_INFO: `/v3/projects/435f8994835445ae91f7e47309574836` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:35.137508 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f6190-4b5c-45df-a0d8-378c47514769 admin admin] RBAC: Authorizing `identity:delete_project(project_id=435f8994835445ae91f7e47309574836)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:35.139430 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f6190-4b5c-45df-a0d8-378c47514769 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:35.439344 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-67646c31-ba84-4b1c-b0a9-5100aee6881a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f59a1b7b96374f1c873eccd8f3051d25'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:35.457477 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b49f6190-4b5c-45df-a0d8-378c47514769 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '435f8994835445ae91f7e47309574836', 'request_id': 'req-b49f6190-4b5c-45df-a0d8-378c47514769'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:35.465773 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b49f6190-4b5c-45df-a0d8-378c47514769 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '435f8994835445ae91f7e47309574836', 'request_id': 'req-b49f6190-4b5c-45df-a0d8-378c47514769'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:35.614309 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-67646c31-ba84-4b1c-b0a9-5100aee6881a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f59a1b7b96374f1c873eccd8f3051d25'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:35.627906 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-67646c31-ba84-4b1c-b0a9-5100aee6881a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f59a1b7b96374f1c873eccd8f3051d25'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:35.628684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-67646c31-ba84-4b1c-b0a9-5100aee6881a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f59a1b7b96374f1c873eccd8f3051d25'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:35.635578 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-67646c31-ba84-4b1c-b0a9-5100aee6881a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f59a1b7b96374f1c873eccd8f3051d25'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:35.641657 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 810/1607] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:11:35 2022] DELETE /identity/v3/users/f59a1b7b96374f1c873eccd8f3051d25 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:35.644730 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67646c31-ba84-4b1c-b0a9-5100aee6881a admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:35.645576 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-67646c31-ba84-4b1c-b0a9-5100aee6881a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:35.715432 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b49f6190-4b5c-45df-a0d8-378c47514769 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '435f8994835445ae91f7e47309574836', 'request_id': 'req-b49f6190-4b5c-45df-a0d8-378c47514769'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:35.719103 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67646c31-ba84-4b1c-b0a9-5100aee6881a admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:35.726118 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181acd1-9a32-4362-b73b-749a7485a661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:35.727515 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181acd1-9a32-4362-b73b-749a7485a661 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:35.727969 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181acd1-9a32-4362-b73b-749a7485a661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:35.728576 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181acd1-9a32-4362-b73b-749a7485a661 admin admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:35.729036 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b49f6190-4b5c-45df-a0d8-378c47514769 admin admin] The token cache is being invalidate because project 435f8994835445ae91f7e47309574836 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:11:35.729419 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b49f6190-4b5c-45df-a0d8-378c47514769 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:35.729830 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181acd1-9a32-4362-b73b-749a7485a661 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:35.730233 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b49f6190-4b5c-45df-a0d8-378c47514769 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:35.732222 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 798/1608] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:11:34 2022] DELETE /identity/v3/projects/435f8994835445ae91f7e47309574836 => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:35.732463 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181acd1-9a32-4362-b73b-749a7485a661 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:35.737697 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8826316-ea5f-4797-bcd5-a00f9fb35f76 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:35.738147 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8826316-ea5f-4797-bcd5-a00f9fb35f76 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:35.738561 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8826316-ea5f-4797-bcd5-a00f9fb35f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:35.764228 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-b8826316-ea5f-4797-bcd5-a00f9fb35f76 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:35.765476 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b8826316-ea5f-4797-bcd5-a00f9fb35f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:35.776177 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 799/1609] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:11:35.782194 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85330b-e405-42fb-9af9-4d63753f55c0 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:35.782503 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85330b-e405-42fb-9af9-4d63753f55c0 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:35.782795 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85330b-e405-42fb-9af9-4d63753f55c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:35.804779 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-ca85330b-e405-42fb-9af9-4d63753f55c0 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:35.805980 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ca85330b-e405-42fb-9af9-4d63753f55c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:35.816094 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 800/1610] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:11:35.817988 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85330b-e405-42fb-9af9-4d63753f55c0 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:35.827004 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85330b-e405-42fb-9af9-4d63753f55c0 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:35.831973 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf5241-608c-4945-98b1-85de769a614e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:35.834846 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf5241-608c-4945-98b1-85de769a614e admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:35.836306 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf5241-608c-4945-98b1-85de769a614e admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:35.836892 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf5241-608c-4945-98b1-85de769a614e admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:35.837675 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf5241-608c-4945-98b1-85de769a614e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:11:35.839843 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf5241-608c-4945-98b1-85de769a614e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:35.839843 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf5241-608c-4945-98b1-85de769a614e admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:35.841179 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 811/1611] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:11:35 2022] POST /identity/v3/projects => generated 383 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:35.845624 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181acd1-9a32-4362-b73b-749a7485a661 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:35.847613 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-9181acd1-9a32-4362-b73b-749a7485a661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:35.857688 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 801/1612] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 11:11:35.857935 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf5241-608c-4945-98b1-85de769a614e admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:35.870038 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf5241-608c-4945-98b1-85de769a614e admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:35.945212 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181acd1-9a32-4362-b73b-749a7485a661 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:35.952380 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51af79e-4a31-4a01-b5b9-ab43d171e29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:35.953032 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51af79e-4a31-4a01-b5b9-ab43d171e29f admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:35.953389 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51af79e-4a31-4a01-b5b9-ab43d171e29f admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:35.953651 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51af79e-4a31-4a01-b5b9-ab43d171e29f admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:35.954301 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51af79e-4a31-4a01-b5b9-ab43d171e29f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:35.957093 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51af79e-4a31-4a01-b5b9-ab43d171e29f admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:35.984964 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046dadb-99a8-440f-b6dc-50f0926d42e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:35.985653 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046dadb-99a8-440f-b6dc-50f0926d42e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:35.986959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046dadb-99a8-440f-b6dc-50f0926d42e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:35.988084 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046dadb-99a8-440f-b6dc-50f0926d42e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:35.988826 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046dadb-99a8-440f-b6dc-50f0926d42e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:35.992084 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046dadb-99a8-440f-b6dc-50f0926d42e6 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:36.055197 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 812/1613] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:11:35 2022] POST /identity/v3/users => generated 298 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:36.058795 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51af79e-4a31-4a01-b5b9-ab43d171e29f admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:36.070867 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51af79e-4a31-4a01-b5b9-ab43d171e29f admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:36.075724 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc77ccd-a82e-456b-ab0b-0667bb097aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:36.076479 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc77ccd-a82e-456b-ab0b-0667bb097aec admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:36.076835 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc77ccd-a82e-456b-ab0b-0667bb097aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:36.077184 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc77ccd-a82e-456b-ab0b-0667bb097aec admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:36.077904 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc77ccd-a82e-456b-ab0b-0667bb097aec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:36.079732 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc77ccd-a82e-456b-ab0b-0667bb097aec admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:36.091433 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 813/1614] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:11:36.095745 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc77ccd-a82e-456b-ab0b-0667bb097aec admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:36.106199 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc77ccd-a82e-456b-ab0b-0667bb097aec admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:36.110895 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102077f-188f-48f5-a9df-948f44a3a899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:36.111541 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102077f-188f-48f5-a9df-948f44a3a899 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:36.111822 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102077f-188f-48f5-a9df-948f44a3a899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:36.112146 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102077f-188f-48f5-a9df-948f44a3a899 admin admin] PATH_INFO: `/v3/projects/3a87ff965c9a4f748ea276404d40a218/users/37c01f4702604ef780cd68aacd53bef4/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:36.126882 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7102077f-188f-48f5-a9df-948f44a3a899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a87ff965c9a4f748ea276404d40a218, user_id=37c01f4702604ef780cd68aacd53bef4, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:36.129538 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7102077f-188f-48f5-a9df-948f44a3a899 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:36.145524 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 802/1615] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:11:35 2022] POST /identity/v3/projects => generated 373 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:11:36.150059 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046dadb-99a8-440f-b6dc-50f0926d42e6 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:36.240643 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046dadb-99a8-440f-b6dc-50f0926d42e6 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:36.251293 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af3535-6009-4931-b228-451dc39ad451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:36.251927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af3535-6009-4931-b228-451dc39ad451 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:36.252404 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af3535-6009-4931-b228-451dc39ad451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:36.252714 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af3535-6009-4931-b228-451dc39ad451 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:36.253767 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64af3535-6009-4931-b228-451dc39ad451 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:36.257574 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64af3535-6009-4931-b228-451dc39ad451 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:36.261354 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:36.264854 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 814/1616] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:36 2022] PUT /identity/v3/projects/3a87ff965c9a4f748ea276404d40a218/users/37c01f4702604ef780cd68aacd53bef4/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:11:36.265899 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102077f-188f-48f5-a9df-948f44a3a899 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:36.269052 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-7102077f-188f-48f5-a9df-948f44a3a899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:36.334956 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102077f-188f-48f5-a9df-948f44a3a899 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:36.340120 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258828dc-2f84-4d41-bd85-0a8ecb9eb77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:36.340852 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258828dc-2f84-4d41-bd85-0a8ecb9eb77f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:36.341140 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258828dc-2f84-4d41-bd85-0a8ecb9eb77f admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:36.341405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258828dc-2f84-4d41-bd85-0a8ecb9eb77f admin admin] PATH_INFO: `/v3/projects/dc5c72ede9714a0fbbe02765427ad73d` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:36.344628 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258828dc-2f84-4d41-bd85-0a8ecb9eb77f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc5c72ede9714a0fbbe02765427ad73d)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:36.346782 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258828dc-2f84-4d41-bd85-0a8ecb9eb77f admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:36.385036 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 803/1617] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:11:36 2022] POST /identity/v3/users => generated 287 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:11:36.386141 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af3535-6009-4931-b228-451dc39ad451 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:36.387707 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-64af3535-6009-4931-b228-451dc39ad451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:36.400871 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af3535-6009-4931-b228-451dc39ad451 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:36.405686 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5584a7-e3be-4975-a520-2ee21530eda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:36.406372 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5584a7-e3be-4975-a520-2ee21530eda6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:36.406662 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5584a7-e3be-4975-a520-2ee21530eda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:36.406943 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5584a7-e3be-4975-a520-2ee21530eda6 admin admin] PATH_INFO: `/v3/users/f80966ffce2f4e0c8b407458716fb0d9` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:36.408114 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5584a7-e3be-4975-a520-2ee21530eda6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f80966ffce2f4e0c8b407458716fb0d9)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:36.410101 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5584a7-e3be-4975-a520-2ee21530eda6 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:36.569327 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-258828dc-2f84-4d41-bd85-0a8ecb9eb77f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc5c72ede9714a0fbbe02765427ad73d', 'request_id': 'req-258828dc-2f84-4d41-bd85-0a8ecb9eb77f'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:36.669789 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-258828dc-2f84-4d41-bd85-0a8ecb9eb77f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc5c72ede9714a0fbbe02765427ad73d', 'request_id': 'req-258828dc-2f84-4d41-bd85-0a8ecb9eb77f'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:36.677876 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-258828dc-2f84-4d41-bd85-0a8ecb9eb77f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc5c72ede9714a0fbbe02765427ad73d', 'request_id': 'req-258828dc-2f84-4d41-bd85-0a8ecb9eb77f'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:36.685623 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1d5584a7-e3be-4975-a520-2ee21530eda6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f80966ffce2f4e0c8b407458716fb0d9'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:36.690732 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-258828dc-2f84-4d41-bd85-0a8ecb9eb77f admin admin] The token cache is being invalidate because project dc5c72ede9714a0fbbe02765427ad73d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:11:36.690732 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-258828dc-2f84-4d41-bd85-0a8ecb9eb77f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:36.690732 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-258828dc-2f84-4d41-bd85-0a8ecb9eb77f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:36.691873 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 815/1618] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:11:36 2022] DELETE /identity/v3/projects/dc5c72ede9714a0fbbe02765427ad73d => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:36.692701 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258828dc-2f84-4d41-bd85-0a8ecb9eb77f admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:36.694001 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-258828dc-2f84-4d41-bd85-0a8ecb9eb77f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:36.757575 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258828dc-2f84-4d41-bd85-0a8ecb9eb77f admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:36.762257 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe597b-27d7-4a57-bb86-a300917fd671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:36.762871 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe597b-27d7-4a57-bb86-a300917fd671 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:36.763150 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe597b-27d7-4a57-bb86-a300917fd671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:36.763448 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe597b-27d7-4a57-bb86-a300917fd671 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:36.764121 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe597b-27d7-4a57-bb86-a300917fd671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:36.765708 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe597b-27d7-4a57-bb86-a300917fd671 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:36.777487 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 816/1619] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:36.777487 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe597b-27d7-4a57-bb86-a300917fd671 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:36.779144 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-b2fe597b-27d7-4a57-bb86-a300917fd671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:36.792546 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe597b-27d7-4a57-bb86-a300917fd671 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:36.797175 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cabd5eb-da87-46b0-9fb8-024427587acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:36.801668 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabd5eb-da87-46b0-9fb8-024427587acf admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:36.801668 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabd5eb-da87-46b0-9fb8-024427587acf admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:36.801668 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabd5eb-da87-46b0-9fb8-024427587acf admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:36.801668 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cabd5eb-da87-46b0-9fb8-024427587acf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:36.801668 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cabd5eb-da87-46b0-9fb8-024427587acf admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:36.806575 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1d5584a7-e3be-4975-a520-2ee21530eda6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f80966ffce2f4e0c8b407458716fb0d9'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:36.810339 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 817/1620] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:36.810983 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cabd5eb-da87-46b0-9fb8-024427587acf admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:36.812600 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-7cabd5eb-da87-46b0-9fb8-024427587acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:36.822734 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1d5584a7-e3be-4975-a520-2ee21530eda6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f80966ffce2f4e0c8b407458716fb0d9'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:36.825100 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cabd5eb-da87-46b0-9fb8-024427587acf admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:36.829584 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5982d83-fb2b-4812-b751-801c03307214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:36.829836 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1d5584a7-e3be-4975-a520-2ee21530eda6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f80966ffce2f4e0c8b407458716fb0d9'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:36.830186 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5982d83-fb2b-4812-b751-801c03307214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:36.830365 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1d5584a7-e3be-4975-a520-2ee21530eda6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f80966ffce2f4e0c8b407458716fb0d9'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:36.830460 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5982d83-fb2b-4812-b751-801c03307214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:36.830726 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5982d83-fb2b-4812-b751-801c03307214 admin admin] PATH_INFO: `/v3/users/e66949cd31ae4d96b5540cd9fab4ba0e` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:36.831833 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5982d83-fb2b-4812-b751-801c03307214 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e66949cd31ae4d96b5540cd9fab4ba0e)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:36.834260 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5982d83-fb2b-4812-b751-801c03307214 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:36.836894 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 804/1621] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:11:36 2022] DELETE /identity/v3/users/f80966ffce2f4e0c8b407458716fb0d9 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:36.838242 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08feaf0-5d4c-4931-bd90-2d250b1de22a None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:36.838534 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08feaf0-5d4c-4931-bd90-2d250b1de22a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:36.842613 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08feaf0-5d4c-4931-bd90-2d250b1de22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:36.861460 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-c08feaf0-5d4c-4931-bd90-2d250b1de22a None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:36.862680 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c08feaf0-5d4c-4931-bd90-2d250b1de22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:36.920929 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 805/1622] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:36.921793 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08feaf0-5d4c-4931-bd90-2d250b1de22a None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:36.923091 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c08feaf0-5d4c-4931-bd90-2d250b1de22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:36.934607 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08feaf0-5d4c-4931-bd90-2d250b1de22a None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:36.939248 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba5f2e-cc88-474d-b17b-ba9c538f533c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:36.945955 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba5f2e-cc88-474d-b17b-ba9c538f533c admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:36.945955 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba5f2e-cc88-474d-b17b-ba9c538f533c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:36.945955 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba5f2e-cc88-474d-b17b-ba9c538f533c admin admin] PATH_INFO: `/v3/projects/3a87ff965c9a4f748ea276404d40a218/users/37c01f4702604ef780cd68aacd53bef4/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:36.945955 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba5f2e-cc88-474d-b17b-ba9c538f533c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a87ff965c9a4f748ea276404d40a218, user_id=37c01f4702604ef780cd68aacd53bef4, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:36.945955 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba5f2e-cc88-474d-b17b-ba9c538f533c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:36.955360 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 806/1623] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:36 2022] PUT /identity/v3/projects/3a87ff965c9a4f748ea276404d40a218/users/37c01f4702604ef780cd68aacd53bef4/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:36.956182 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba5f2e-cc88-474d-b17b-ba9c538f533c admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:36.957706 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-91ba5f2e-cc88-474d-b17b-ba9c538f533c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:37.027202 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba5f2e-cc88-474d-b17b-ba9c538f533c admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:37.031928 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ce2f3-6f71-430b-bb1f-738dd6b73f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:37.032575 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ce2f3-6f71-430b-bb1f-738dd6b73f95 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:37.032858 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ce2f3-6f71-430b-bb1f-738dd6b73f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:37.033134 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ce2f3-6f71-430b-bb1f-738dd6b73f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:37.033780 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ce2f3-6f71-430b-bb1f-738dd6b73f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:37.035399 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ce2f3-6f71-430b-bb1f-738dd6b73f95 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:37.045746 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 807/1624] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:37.046767 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675113a-64fa-4e6f-abc3-eef1f246e39c None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:37.047059 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675113a-64fa-4e6f-abc3-eef1f246e39c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:37.047342 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675113a-64fa-4e6f-abc3-eef1f246e39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:37.064191 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-c5982d83-fb2b-4812-b751-801c03307214 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e66949cd31ae4d96b5540cd9fab4ba0e'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:37.069262 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-e675113a-64fa-4e6f-abc3-eef1f246e39c None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:37.070497 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e675113a-64fa-4e6f-abc3-eef1f246e39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:37.078321 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 808/1625] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:37.079606 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458e95c-468e-43a4-916e-92ec397dea2b None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:37.079896 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458e95c-468e-43a4-916e-92ec397dea2b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:37.080218 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458e95c-468e-43a4-916e-92ec397dea2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:37.101267 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-2458e95c-468e-43a4-916e-92ec397dea2b None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:37.102464 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2458e95c-468e-43a4-916e-92ec397dea2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:37.111098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 809/1626] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:37.112362 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaabbf4-3748-492d-a35e-f8106b628db6 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:37.112651 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaabbf4-3748-492d-a35e-f8106b628db6 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:37.112927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaabbf4-3748-492d-a35e-f8106b628db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:37.142790 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-feaabbf4-3748-492d-a35e-f8106b628db6 None None] MFA Rules not processed for user `37c01f4702604ef780cd68aacd53bef4`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:37.144842 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-feaabbf4-3748-492d-a35e-f8106b628db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:37.184470 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-c5982d83-fb2b-4812-b751-801c03307214 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e66949cd31ae4d96b5540cd9fab4ba0e'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:37.200750 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-c5982d83-fb2b-4812-b751-801c03307214 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e66949cd31ae4d96b5540cd9fab4ba0e'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:37.201574 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-c5982d83-fb2b-4812-b751-801c03307214 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e66949cd31ae4d96b5540cd9fab4ba0e'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:37.210389 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-c5982d83-fb2b-4812-b751-801c03307214 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e66949cd31ae4d96b5540cd9fab4ba0e'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:37.215122 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:DELETE=10,keystone:SELECT=85,keystone:INSERT=5 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:37.219614 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 810/1627] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:37 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:37.220542 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaabbf4-3748-492d-a35e-f8106b628db6 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:37.226433 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 818/1628] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:11:36 2022] DELETE /identity/v3/users/e66949cd31ae4d96b5540cd9fab4ba0e => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:37.227430 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5982d83-fb2b-4812-b751-801c03307214 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:37.230294 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-c5982d83-fb2b-4812-b751-801c03307214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:37.236687 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaabbf4-3748-492d-a35e-f8106b628db6 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:37.291423 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5982d83-fb2b-4812-b751-801c03307214 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:37.295404 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d0bae-4eff-42ad-aa40-0a373d5e0187 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:37.296019 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d0bae-4eff-42ad-aa40-0a373d5e0187 service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:37.296399 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d0bae-4eff-42ad-aa40-0a373d5e0187 service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:37.296733 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d0bae-4eff-42ad-aa40-0a373d5e0187 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:37.298527 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-412d0bae-4eff-42ad-aa40-0a373d5e0187 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:37.299530 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d58b2-5ca6-4dee-b02b-4167f0479661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:37.300242 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d58b2-5ca6-4dee-b02b-4167f0479661 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:37.300521 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d58b2-5ca6-4dee-b02b-4167f0479661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:37.300794 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d58b2-5ca6-4dee-b02b-4167f0479661 admin admin] PATH_INFO: `/v3/projects/fba044d242a5412db5f598d5fb0856e0/users/aab60a59067c4bcf8d643e5f3364917d/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:37.312580 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412d0bae-4eff-42ad-aa40-0a373d5e0187 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:37.314091 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412d0bae-4eff-42ad-aa40-0a373d5e0187 service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:37.315412 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d58b2-5ca6-4dee-b02b-4167f0479661 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fba044d242a5412db5f598d5fb0856e0, user_id=aab60a59067c4bcf8d643e5f3364917d, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:37.318711 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d58b2-5ca6-4dee-b02b-4167f0479661 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:37.324928 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 819/1629] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:37.325816 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d0bae-4eff-42ad-aa40-0a373d5e0187 service neutron] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:37.327321 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-412d0bae-4eff-42ad-aa40-0a373d5e0187 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:37.339634 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d0bae-4eff-42ad-aa40-0a373d5e0187 service neutron] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:37.346769 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373cd236-f66c-4c0c-85fc-8a77475a55aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:37.347415 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cd236-f66c-4c0c-85fc-8a77475a55aa admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:37.347684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cd236-f66c-4c0c-85fc-8a77475a55aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:37.347950 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cd236-f66c-4c0c-85fc-8a77475a55aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:37.348642 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373cd236-f66c-4c0c-85fc-8a77475a55aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:11:37.348952 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373cd236-f66c-4c0c-85fc-8a77475a55aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:37.351092 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373cd236-f66c-4c0c-85fc-8a77475a55aa admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:37.364356 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 820/1630] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:11:37.364356 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994390b-18f2-4599-9a81-ecc88a60d01d None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:37.364640 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994390b-18f2-4599-9a81-ecc88a60d01d None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:37.364928 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994390b-18f2-4599-9a81-ecc88a60d01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:37.388030 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-7994390b-18f2-4599-9a81-ecc88a60d01d None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:37.389314 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-7994390b-18f2-4599-9a81-ecc88a60d01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:37.397926 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 821/1631] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:37.398699 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7994390b-18f2-4599-9a81-ecc88a60d01d None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:37.399990 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-7994390b-18f2-4599-9a81-ecc88a60d01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:37.458604 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7994390b-18f2-4599-9a81-ecc88a60d01d None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:37.462231 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c422ae-5e03-479e-8533-b546f54d4d3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:37.463110 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c422ae-5e03-479e-8533-b546f54d4d3b service cinder] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:37.463391 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c422ae-5e03-479e-8533-b546f54d4d3b service cinder] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:37.463659 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c422ae-5e03-479e-8533-b546f54d4d3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:37.465454 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-e9c422ae-5e03-479e-8533-b546f54d4d3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:37.470270 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 811/1632] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:37 2022] PUT /identity/v3/projects/fba044d242a5412db5f598d5fb0856e0/users/aab60a59067c4bcf8d643e5f3364917d/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:37.471149 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d58b2-5ca6-4dee-b02b-4167f0479661 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:37.538973 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c422ae-5e03-479e-8533-b546f54d4d3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:37.540603 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c422ae-5e03-479e-8533-b546f54d4d3b service cinder] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:37.547560 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d58b2-5ca6-4dee-b02b-4167f0479661 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:37.554162 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb828caf-d89e-464f-a83e-180d48ed76de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:37.554795 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb828caf-d89e-464f-a83e-180d48ed76de admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:37.555094 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb828caf-d89e-464f-a83e-180d48ed76de admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:37.555459 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb828caf-d89e-464f-a83e-180d48ed76de admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:37.556278 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb828caf-d89e-464f-a83e-180d48ed76de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:37.557580 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 822/1633] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:37 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:37.558527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb828caf-d89e-464f-a83e-180d48ed76de admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:37.559200 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c422ae-5e03-479e-8533-b546f54d4d3b service cinder] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:37.561979 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-e9c422ae-5e03-479e-8533-b546f54d4d3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:37.575431 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c422ae-5e03-479e-8533-b546f54d4d3b service cinder] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:37.636379 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5efd56-ecc2-42f1-ab4c-58ddcc95472c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:37.637057 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5efd56-ecc2-42f1-ab4c-58ddcc95472c service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:37.637337 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5efd56-ecc2-42f1-ab4c-58ddcc95472c service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:37.637719 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5efd56-ecc2-42f1-ab4c-58ddcc95472c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:37.648377 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 812/1634] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:11:37 2022] POST /identity/v3/projects => generated 385 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:37.650830 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5efd56-ecc2-42f1-ab4c-58ddcc95472c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:37.651738 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7564cd-b409-4083-9bf6-1cad1c3ac36b None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:37.652043 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7564cd-b409-4083-9bf6-1cad1c3ac36b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:37.652785 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5efd56-ecc2-42f1-ab4c-58ddcc95472c service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:37.653783 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7564cd-b409-4083-9bf6-1cad1c3ac36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:37.673695 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 823/1635] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:37.676870 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5efd56-ecc2-42f1-ab4c-58ddcc95472c service neutron] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:37.691095 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-9a7564cd-b409-4083-9bf6-1cad1c3ac36b None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:37.691095 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9a7564cd-b409-4083-9bf6-1cad1c3ac36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:37.706995 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5efd56-ecc2-42f1-ab4c-58ddcc95472c service neutron] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:37.782164 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 813/1636] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:37.782943 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7564cd-b409-4083-9bf6-1cad1c3ac36b None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:37.784356 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9a7564cd-b409-4083-9bf6-1cad1c3ac36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:37.786182 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b4fe9-9c8d-421f-b3e7-0f8d07f5b40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:37.787353 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b4fe9-9c8d-421f-b3e7-0f8d07f5b40a admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:37.790234 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b4fe9-9c8d-421f-b3e7-0f8d07f5b40a admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:37.791009 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b4fe9-9c8d-421f-b3e7-0f8d07f5b40a admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:37.791788 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b4fe9-9c8d-421f-b3e7-0f8d07f5b40a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:37.794809 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b4fe9-9c8d-421f-b3e7-0f8d07f5b40a admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:37.860709 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7564cd-b409-4083-9bf6-1cad1c3ac36b None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:37.869703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a0de4-c3af-4dc5-8177-5f7687f59264 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:37.870313 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a0de4-c3af-4dc5-8177-5f7687f59264 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:37.870584 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a0de4-c3af-4dc5-8177-5f7687f59264 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:37.870933 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a0de4-c3af-4dc5-8177-5f7687f59264 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:37.873623 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-557a0de4-c3af-4dc5-8177-5f7687f59264 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:37.919197 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 824/1637] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:11:37 2022] POST /identity/v3/users => generated 293 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:37.919197 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b4fe9-9c8d-421f-b3e7-0f8d07f5b40a admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:37.919197 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-5d1b4fe9-9c8d-421f-b3e7-0f8d07f5b40a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:37.931298 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b4fe9-9c8d-421f-b3e7-0f8d07f5b40a admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:37.946557 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557a0de4-c3af-4dc5-8177-5f7687f59264 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:37.946557 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557a0de4-c3af-4dc5-8177-5f7687f59264 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:37.946730 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eec87a-859a-4c9a-a9b7-de38df934035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:37.946730 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eec87a-859a-4c9a-a9b7-de38df934035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:37.947212 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eec87a-859a-4c9a-a9b7-de38df934035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:37.947481 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eec87a-859a-4c9a-a9b7-de38df934035 admin admin] PATH_INFO: `/v3/projects/d1df1ca8909c4d9ea2274e8632f26b28` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:37.949638 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eec87a-859a-4c9a-a9b7-de38df934035 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1df1ca8909c4d9ea2274e8632f26b28)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:37.951743 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eec87a-859a-4c9a-a9b7-de38df934035 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:37.956143 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 814/1638] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:37.956819 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a0de4-c3af-4dc5-8177-5f7687f59264 service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:38.057881 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a0de4-c3af-4dc5-8177-5f7687f59264 service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:38.062180 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad8c09-48cc-4f76-aae0-1c940188440c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:38.062944 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad8c09-48cc-4f76-aae0-1c940188440c service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:38.063126 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad8c09-48cc-4f76-aae0-1c940188440c service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:38.063385 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad8c09-48cc-4f76-aae0-1c940188440c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:38.077317 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad8c09-48cc-4f76-aae0-1c940188440c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:38.078802 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad8c09-48cc-4f76-aae0-1c940188440c service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:38.090856 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 815/1639] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:38.091677 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad8c09-48cc-4f76-aae0-1c940188440c service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:38.098335 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-22eec87a-859a-4c9a-a9b7-de38df934035 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1df1ca8909c4d9ea2274e8632f26b28', 'request_id': 'req-22eec87a-859a-4c9a-a9b7-de38df934035'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:38.112519 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad8c09-48cc-4f76-aae0-1c940188440c service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:38.175796 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b9636-d033-45c5-99cb-82670d82f4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:38.176358 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b9636-d033-45c5-99cb-82670d82f4c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:38.176642 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b9636-d033-45c5-99cb-82670d82f4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:38.176916 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b9636-d033-45c5-99cb-82670d82f4c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:38.177581 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949b9636-d033-45c5-99cb-82670d82f4c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:38.179227 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949b9636-d033-45c5-99cb-82670d82f4c4 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:38.188724 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 816/1640] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:38.192557 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b9636-d033-45c5-99cb-82670d82f4c4 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:38.201728 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b9636-d033-45c5-99cb-82670d82f4c4 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:38.206309 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043afe5e-23d8-435a-8bfe-6492d19d12aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:38.206859 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043afe5e-23d8-435a-8bfe-6492d19d12aa admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:38.207144 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043afe5e-23d8-435a-8bfe-6492d19d12aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:38.207457 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043afe5e-23d8-435a-8bfe-6492d19d12aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:38.208121 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043afe5e-23d8-435a-8bfe-6492d19d12aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:38.210142 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043afe5e-23d8-435a-8bfe-6492d19d12aa admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:38.219844 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 817/1641] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:11:38.223661 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043afe5e-23d8-435a-8bfe-6492d19d12aa admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:38.233379 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043afe5e-23d8-435a-8bfe-6492d19d12aa admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:38.238025 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42daa925-8ea7-44f2-86d4-c58840b785b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:38.238642 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42daa925-8ea7-44f2-86d4-c58840b785b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:38.238926 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42daa925-8ea7-44f2-86d4-c58840b785b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:38.239205 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42daa925-8ea7-44f2-86d4-c58840b785b6 admin admin] PATH_INFO: `/v3/projects/fb419b629f794f2ead00add69aa73649/users/7be55338629448b3ba287007ba468ff6/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:38.254449 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42daa925-8ea7-44f2-86d4-c58840b785b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb419b629f794f2ead00add69aa73649, user_id=7be55338629448b3ba287007ba468ff6, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:38.257357 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42daa925-8ea7-44f2-86d4-c58840b785b6 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:38.305013 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-22eec87a-859a-4c9a-a9b7-de38df934035 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1df1ca8909c4d9ea2274e8632f26b28', 'request_id': 'req-22eec87a-859a-4c9a-a9b7-de38df934035'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:38.324593 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-22eec87a-859a-4c9a-a9b7-de38df934035 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1df1ca8909c4d9ea2274e8632f26b28', 'request_id': 'req-22eec87a-859a-4c9a-a9b7-de38df934035'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:38.339235 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-22eec87a-859a-4c9a-a9b7-de38df934035 admin admin] The token cache is being invalidate because project d1df1ca8909c4d9ea2274e8632f26b28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:11:38.339235 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-22eec87a-859a-4c9a-a9b7-de38df934035 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:38.339547 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-22eec87a-859a-4c9a-a9b7-de38df934035 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:38.345208 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 825/1642] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:11:37 2022] DELETE /identity/v3/projects/d1df1ca8909c4d9ea2274e8632f26b28 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:38.345208 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eec87a-859a-4c9a-a9b7-de38df934035 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:38.346780 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-22eec87a-859a-4c9a-a9b7-de38df934035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:38.370685 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eec87a-859a-4c9a-a9b7-de38df934035 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:38.376761 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967e381-471f-4b7b-8cd4-d5d18b405c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:38.378040 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967e381-471f-4b7b-8cd4-d5d18b405c90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:38.378040 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967e381-471f-4b7b-8cd4-d5d18b405c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:38.378338 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967e381-471f-4b7b-8cd4-d5d18b405c90 admin admin] PATH_INFO: `/v3/projects/f4758e603ad246ce810a7915315abe94` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:38.379950 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967e381-471f-4b7b-8cd4-d5d18b405c90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4758e603ad246ce810a7915315abe94)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:38.382385 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967e381-471f-4b7b-8cd4-d5d18b405c90 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:38.385478 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 818/1643] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:38 2022] PUT /identity/v3/projects/fb419b629f794f2ead00add69aa73649/users/7be55338629448b3ba287007ba468ff6/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:11:38.385478 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42daa925-8ea7-44f2-86d4-c58840b785b6 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:38.386466 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-42daa925-8ea7-44f2-86d4-c58840b785b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:38.468493 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42daa925-8ea7-44f2-86d4-c58840b785b6 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:38.473351 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed0edf-2c8d-4958-8d28-250009e4ba0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:38.474035 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed0edf-2c8d-4958-8d28-250009e4ba0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:38.474316 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed0edf-2c8d-4958-8d28-250009e4ba0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:38.475173 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed0edf-2c8d-4958-8d28-250009e4ba0b admin admin] PATH_INFO: `/v3/users/fd0bb90b37b34d2aba3233f61d3cc4b7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:38.476451 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed0edf-2c8d-4958-8d28-250009e4ba0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd0bb90b37b34d2aba3233f61d3cc4b7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:38.478392 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed0edf-2c8d-4958-8d28-250009e4ba0b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:38.602359 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-e967e381-471f-4b7b-8cd4-d5d18b405c90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4758e603ad246ce810a7915315abe94', 'request_id': 'req-e967e381-471f-4b7b-8cd4-d5d18b405c90'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:38.735056 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:38.766638 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-e967e381-471f-4b7b-8cd4-d5d18b405c90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4758e603ad246ce810a7915315abe94', 'request_id': 'req-e967e381-471f-4b7b-8cd4-d5d18b405c90'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:38.774444 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-e967e381-471f-4b7b-8cd4-d5d18b405c90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4758e603ad246ce810a7915315abe94', 'request_id': 'req-e967e381-471f-4b7b-8cd4-d5d18b405c90'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:38.785168 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-e967e381-471f-4b7b-8cd4-d5d18b405c90 admin admin] The token cache is being invalidate because project f4758e603ad246ce810a7915315abe94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:11:38.785540 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-e967e381-471f-4b7b-8cd4-d5d18b405c90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:38.786269 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-e967e381-471f-4b7b-8cd4-d5d18b405c90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:38.787841 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 826/1644] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:11:38 2022] DELETE /identity/v3/projects/f4758e603ad246ce810a7915315abe94 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:38.789166 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170094df-2c37-429a-b083-ad3a258c9b9e None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:38.789458 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170094df-2c37-429a-b083-ad3a258c9b9e None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:38.789736 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170094df-2c37-429a-b083-ad3a258c9b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:38.817760 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-170094df-2c37-429a-b083-ad3a258c9b9e None None] MFA Rules not processed for user `7be55338629448b3ba287007ba468ff6`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:38.819514 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-170094df-2c37-429a-b083-ad3a258c9b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:38.896610 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 827/1645] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:38.896610 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170094df-2c37-429a-b083-ad3a258c9b9e None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:38.896610 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-170094df-2c37-429a-b083-ad3a258c9b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:38.906886 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f9ed0edf-2c8d-4958-8d28-250009e4ba0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd0bb90b37b34d2aba3233f61d3cc4b7'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:38.964661 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170094df-2c37-429a-b083-ad3a258c9b9e None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:38.969523 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bdd04-7395-4efc-a485-8c031269809f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:38.970191 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bdd04-7395-4efc-a485-8c031269809f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:38.970463 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bdd04-7395-4efc-a485-8c031269809f admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:38.970822 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bdd04-7395-4efc-a485-8c031269809f admin admin] PATH_INFO: `/v3/users/33891d048c644b3f83d111fcb467effd` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:38.971951 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656bdd04-7395-4efc-a485-8c031269809f admin admin] RBAC: Authorizing `identity:delete_user(user_id=33891d048c644b3f83d111fcb467effd)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:38.973911 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656bdd04-7395-4efc-a485-8c031269809f admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:38.985925 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f9ed0edf-2c8d-4958-8d28-250009e4ba0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd0bb90b37b34d2aba3233f61d3cc4b7'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:39.031515 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f9ed0edf-2c8d-4958-8d28-250009e4ba0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd0bb90b37b34d2aba3233f61d3cc4b7'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:39.036289 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f9ed0edf-2c8d-4958-8d28-250009e4ba0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd0bb90b37b34d2aba3233f61d3cc4b7'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:39.037064 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f9ed0edf-2c8d-4958-8d28-250009e4ba0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd0bb90b37b34d2aba3233f61d3cc4b7'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:39.043552 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 819/1646] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:11:38 2022] DELETE /identity/v3/users/fd0bb90b37b34d2aba3233f61d3cc4b7 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:39.048733 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed0edf-2c8d-4958-8d28-250009e4ba0b admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:39.051502 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f9ed0edf-2c8d-4958-8d28-250009e4ba0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:39.143940 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed0edf-2c8d-4958-8d28-250009e4ba0b admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:39.148993 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282650b9-3276-4b91-a9e1-8d67b3896c16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:39.149866 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282650b9-3276-4b91-a9e1-8d67b3896c16 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:39.150871 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282650b9-3276-4b91-a9e1-8d67b3896c16 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:39.151196 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282650b9-3276-4b91-a9e1-8d67b3896c16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:39.153329 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-282650b9-3276-4b91-a9e1-8d67b3896c16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:39.218586 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282650b9-3276-4b91-a9e1-8d67b3896c16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:39.220041 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282650b9-3276-4b91-a9e1-8d67b3896c16 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:39.221465 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-656bdd04-7395-4efc-a485-8c031269809f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33891d048c644b3f83d111fcb467effd'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:39.230103 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 820/1647] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:39.251032 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282650b9-3276-4b91-a9e1-8d67b3896c16 service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:39.252525 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-282650b9-3276-4b91-a9e1-8d67b3896c16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:39.336462 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282650b9-3276-4b91-a9e1-8d67b3896c16 service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:39.344227 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752c0d3-e92d-4fb9-bfc4-265c2d32e651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:39.345144 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752c0d3-e92d-4fb9-bfc4-265c2d32e651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:39.345607 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752c0d3-e92d-4fb9-bfc4-265c2d32e651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:39.346204 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752c0d3-e92d-4fb9-bfc4-265c2d32e651 admin admin] PATH_INFO: `/v3/users/7be55338629448b3ba287007ba468ff6` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:39.347842 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752c0d3-e92d-4fb9-bfc4-265c2d32e651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7be55338629448b3ba287007ba468ff6)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:39.351290 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752c0d3-e92d-4fb9-bfc4-265c2d32e651 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:39.377944 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-656bdd04-7395-4efc-a485-8c031269809f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33891d048c644b3f83d111fcb467effd'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:39.395440 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-656bdd04-7395-4efc-a485-8c031269809f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33891d048c644b3f83d111fcb467effd'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:39.397228 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-656bdd04-7395-4efc-a485-8c031269809f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33891d048c644b3f83d111fcb467effd'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:39.409296 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-656bdd04-7395-4efc-a485-8c031269809f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33891d048c644b3f83d111fcb467effd'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:39.427590 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 828/1648] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:11:38 2022] DELETE /identity/v3/users/33891d048c644b3f83d111fcb467effd => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:39.629688 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bdd04-7395-4efc-a485-8c031269809f admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:39.632229 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-656bdd04-7395-4efc-a485-8c031269809f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:39.640652 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f752c0d3-e92d-4fb9-bfc4-265c2d32e651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7be55338629448b3ba287007ba468ff6'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:39.727942 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f752c0d3-e92d-4fb9-bfc4-265c2d32e651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7be55338629448b3ba287007ba468ff6'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:39.729898 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bdd04-7395-4efc-a485-8c031269809f admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:39.737141 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2031f35-b26f-4f68-8bcb-a94c55d50bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:39.738338 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2031f35-b26f-4f68-8bcb-a94c55d50bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:39.738692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2031f35-b26f-4f68-8bcb-a94c55d50bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:39.739047 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2031f35-b26f-4f68-8bcb-a94c55d50bf8 admin admin] PATH_INFO: `/v3/projects/5145652d787e40518a9aff1397524613` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:39.741173 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2031f35-b26f-4f68-8bcb-a94c55d50bf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5145652d787e40518a9aff1397524613)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:39.743289 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2031f35-b26f-4f68-8bcb-a94c55d50bf8 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:39.754072 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f752c0d3-e92d-4fb9-bfc4-265c2d32e651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7be55338629448b3ba287007ba468ff6'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:39.754573 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:39.764432 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f752c0d3-e92d-4fb9-bfc4-265c2d32e651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7be55338629448b3ba287007ba468ff6'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:39.765508 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f752c0d3-e92d-4fb9-bfc4-265c2d32e651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7be55338629448b3ba287007ba468ff6'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:39.778162 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 821/1649] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:11:39 2022] DELETE /identity/v3/users/7be55338629448b3ba287007ba468ff6 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:11:39.780118 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bdda5-c750-47ef-946a-7bc1cc8b9274 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:39.780607 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bdda5-c750-47ef-946a-7bc1cc8b9274 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:39.781128 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bdda5-c750-47ef-946a-7bc1cc8b9274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:39.806902 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-5f2bdda5-c750-47ef-946a-7bc1cc8b9274 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:39.808169 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5f2bdda5-c750-47ef-946a-7bc1cc8b9274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:39.925034 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-e2031f35-b26f-4f68-8bcb-a94c55d50bf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5145652d787e40518a9aff1397524613', 'request_id': 'req-e2031f35-b26f-4f68-8bcb-a94c55d50bf8'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:39.933392 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 822/1650] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:39.941656 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4cbf80-1a93-4aae-a5f0-ff73404bdf8b None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:39.942911 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4cbf80-1a93-4aae-a5f0-ff73404bdf8b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:39.943450 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4cbf80-1a93-4aae-a5f0-ff73404bdf8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:39.995844 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-3a4cbf80-1a93-4aae-a5f0-ff73404bdf8b None None] MFA Rules not processed for user `aab60a59067c4bcf8d643e5f3364917d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:39.997385 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3a4cbf80-1a93-4aae-a5f0-ff73404bdf8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:40.013520 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-e2031f35-b26f-4f68-8bcb-a94c55d50bf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5145652d787e40518a9aff1397524613', 'request_id': 'req-e2031f35-b26f-4f68-8bcb-a94c55d50bf8'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:40.029592 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-e2031f35-b26f-4f68-8bcb-a94c55d50bf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5145652d787e40518a9aff1397524613', 'request_id': 'req-e2031f35-b26f-4f68-8bcb-a94c55d50bf8'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:40.060367 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-e2031f35-b26f-4f68-8bcb-a94c55d50bf8 admin admin] The token cache is being invalidate because project 5145652d787e40518a9aff1397524613 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:11:40.063280 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-e2031f35-b26f-4f68-8bcb-a94c55d50bf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:40.063280 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-e2031f35-b26f-4f68-8bcb-a94c55d50bf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:40.063443 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 829/1651] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:11:39 2022] DELETE /identity/v3/projects/5145652d787e40518a9aff1397524613 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:11:40.064239 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2031f35-b26f-4f68-8bcb-a94c55d50bf8 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:40.067724 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-e2031f35-b26f-4f68-8bcb-a94c55d50bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:40.114920 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 823/1652] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:40.120390 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4cbf80-1a93-4aae-a5f0-ff73404bdf8b None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:40.135570 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3a4cbf80-1a93-4aae-a5f0-ff73404bdf8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:40.182697 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2031f35-b26f-4f68-8bcb-a94c55d50bf8 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:40.187950 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb6075-aa10-4846-8ea8-1d0374b9e46b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:40.188736 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb6075-aa10-4846-8ea8-1d0374b9e46b service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:40.189129 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb6075-aa10-4846-8ea8-1d0374b9e46b service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:40.189552 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb6075-aa10-4846-8ea8-1d0374b9e46b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:40.191465 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-f2bb6075-aa10-4846-8ea8-1d0374b9e46b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:40.244457 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4cbf80-1a93-4aae-a5f0-ff73404bdf8b None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:40.251727 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb124794-1927-4b1f-8bdd-c5f7077d493a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:40.263198 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb124794-1927-4b1f-8bdd-c5f7077d493a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:40.263198 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb124794-1927-4b1f-8bdd-c5f7077d493a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:40.263198 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb124794-1927-4b1f-8bdd-c5f7077d493a admin admin] PATH_INFO: `/v3/users/1c45eec12ade4bcb97ff7c8353b82d7f` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:40.263198 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb124794-1927-4b1f-8bdd-c5f7077d493a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c45eec12ade4bcb97ff7c8353b82d7f)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:40.263198 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb124794-1927-4b1f-8bdd-c5f7077d493a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:40.308625 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb6075-aa10-4846-8ea8-1d0374b9e46b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:40.310330 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb6075-aa10-4846-8ea8-1d0374b9e46b service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:40.321530 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 830/1653] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:40.322472 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb6075-aa10-4846-8ea8-1d0374b9e46b service neutron] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:40.323835 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-f2bb6075-aa10-4846-8ea8-1d0374b9e46b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:40.340105 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb6075-aa10-4846-8ea8-1d0374b9e46b service neutron] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:40.344113 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e3b2a-ab68-4034-ad89-778105575b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:40.346245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e3b2a-ab68-4034-ad89-778105575b3c admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:40.346245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e3b2a-ab68-4034-ad89-778105575b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:40.346245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e3b2a-ab68-4034-ad89-778105575b3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:40.346665 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e3b2a-ab68-4034-ad89-778105575b3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:40.348764 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e3b2a-ab68-4034-ad89-778105575b3c admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:40.561468 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 831/1654] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:11:40 2022] POST /identity/v3/projects => generated 371 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:40.561468 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e3b2a-ab68-4034-ad89-778105575b3c admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:40.563464 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-ee9e3b2a-ab68-4034-ad89-778105575b3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:40.632712 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e3b2a-ab68-4034-ad89-778105575b3c admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:40.638278 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c974bd-30ff-4f47-9f41-8517589c0fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:40.638975 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c974bd-30ff-4f47-9f41-8517589c0fdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:40.639276 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c974bd-30ff-4f47-9f41-8517589c0fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:40.639596 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c974bd-30ff-4f47-9f41-8517589c0fdf admin admin] PATH_INFO: `/v3/projects/2e3182c9e58d4cda905e571a9ab4d4cf` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:40.640764 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c974bd-30ff-4f47-9f41-8517589c0fdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e3182c9e58d4cda905e571a9ab4d4cf)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:40.643328 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c974bd-30ff-4f47-9f41-8517589c0fdf admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:40.674600 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-fb124794-1927-4b1f-8bdd-c5f7077d493a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c45eec12ade4bcb97ff7c8353b82d7f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:40.754100 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-22c974bd-30ff-4f47-9f41-8517589c0fdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e3182c9e58d4cda905e571a9ab4d4cf', 'request_id': 'req-22c974bd-30ff-4f47-9f41-8517589c0fdf'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:40.779132 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-fb124794-1927-4b1f-8bdd-c5f7077d493a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c45eec12ade4bcb97ff7c8353b82d7f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:40.796166 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-fb124794-1927-4b1f-8bdd-c5f7077d493a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c45eec12ade4bcb97ff7c8353b82d7f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:40.804403 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-fb124794-1927-4b1f-8bdd-c5f7077d493a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c45eec12ade4bcb97ff7c8353b82d7f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:40.805272 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-fb124794-1927-4b1f-8bdd-c5f7077d493a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c45eec12ade4bcb97ff7c8353b82d7f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:40.811477 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 824/1655] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:11:40 2022] DELETE /identity/v3/users/1c45eec12ade4bcb97ff7c8353b82d7f => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:40.813918 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb124794-1927-4b1f-8bdd-c5f7077d493a admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:40.816984 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-fb124794-1927-4b1f-8bdd-c5f7077d493a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:40.900949 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-22c974bd-30ff-4f47-9f41-8517589c0fdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e3182c9e58d4cda905e571a9ab4d4cf', 'request_id': 'req-22c974bd-30ff-4f47-9f41-8517589c0fdf'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:40.909866 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-22c974bd-30ff-4f47-9f41-8517589c0fdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e3182c9e58d4cda905e571a9ab4d4cf', 'request_id': 'req-22c974bd-30ff-4f47-9f41-8517589c0fdf'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:40.939272 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-22c974bd-30ff-4f47-9f41-8517589c0fdf admin admin] The token cache is being invalidate because project 2e3182c9e58d4cda905e571a9ab4d4cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:11:40.939931 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-22c974bd-30ff-4f47-9f41-8517589c0fdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:40.941435 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-22c974bd-30ff-4f47-9f41-8517589c0fdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:40.945516 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 832/1656] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:11:40 2022] DELETE /identity/v3/projects/2e3182c9e58d4cda905e571a9ab4d4cf => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:40.950416 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6a3d8-0a1f-49a0-a2f3-b3f1a3985b3f None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:40.950711 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6a3d8-0a1f-49a0-a2f3-b3f1a3985b3f None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:40.950992 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6a3d8-0a1f-49a0-a2f3-b3f1a3985b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:40.956391 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb124794-1927-4b1f-8bdd-c5f7077d493a admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:40.962417 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04f6d4-56cb-474b-bd94-695064fa306f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:40.971192 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04f6d4-56cb-474b-bd94-695064fa306f admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:40.971192 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04f6d4-56cb-474b-bd94-695064fa306f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:40.971192 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04f6d4-56cb-474b-bd94-695064fa306f admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:40.971192 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04f6d4-56cb-474b-bd94-695064fa306f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:40.971192 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04f6d4-56cb-474b-bd94-695064fa306f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:40.984202 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-f7c6a3d8-0a1f-49a0-a2f3-b3f1a3985b3f None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:40.986039 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-f7c6a3d8-0a1f-49a0-a2f3-b3f1a3985b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:41.004449 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 833/1657] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:41.007788 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102c29c-b8f2-4a09-97f5-3fba15b54a02 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:41.008121 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102c29c-b8f2-4a09-97f5-3fba15b54a02 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:41.009075 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102c29c-b8f2-4a09-97f5-3fba15b54a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:41.032367 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-0102c29c-b8f2-4a09-97f5-3fba15b54a02 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:41.033636 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-0102c29c-b8f2-4a09-97f5-3fba15b54a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:41.044223 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 834/1658] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:41.048354 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102c29c-b8f2-4a09-97f5-3fba15b54a02 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:41.059041 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102c29c-b8f2-4a09-97f5-3fba15b54a02 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:41.064787 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a77103-042f-41a9-b820-6f4d814ec605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:41.065902 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a77103-042f-41a9-b820-6f4d814ec605 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:41.066191 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a77103-042f-41a9-b820-6f4d814ec605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:41.066468 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a77103-042f-41a9-b820-6f4d814ec605 admin admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:41.067126 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a77103-042f-41a9-b820-6f4d814ec605 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:11:41.067441 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a77103-042f-41a9-b820-6f4d814ec605 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:41.069968 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a77103-042f-41a9-b820-6f4d814ec605 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:41.089729 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 835/1659] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 11:11:41.090883 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a77103-042f-41a9-b820-6f4d814ec605 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:41.104203 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a77103-042f-41a9-b820-6f4d814ec605 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:41.264528 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d276241-0042-4c07-970d-eaf48f9029e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:41.264528 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d276241-0042-4c07-970d-eaf48f9029e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:41.264528 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d276241-0042-4c07-970d-eaf48f9029e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:41.264528 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d276241-0042-4c07-970d-eaf48f9029e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:41.265504 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d276241-0042-4c07-970d-eaf48f9029e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:41.265504 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d276241-0042-4c07-970d-eaf48f9029e9 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:41.319406 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 825/1660] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:11:40 2022] POST /identity/v3/users => generated 292 bytes in 482 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:41.321586 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04f6d4-56cb-474b-bd94-695064fa306f admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:41.323344 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9e04f6d4-56cb-474b-bd94-695064fa306f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:41.348047 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04f6d4-56cb-474b-bd94-695064fa306f admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:41.355401 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3215df1-c4df-4e6e-80ab-991c6c479cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:41.356517 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3215df1-c4df-4e6e-80ab-991c6c479cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:41.357158 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3215df1-c4df-4e6e-80ab-991c6c479cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:41.357735 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3215df1-c4df-4e6e-80ab-991c6c479cf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:41.358599 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3215df1-c4df-4e6e-80ab-991c6c479cf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:41.360531 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3215df1-c4df-4e6e-80ab-991c6c479cf8 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:41.372265 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 826/1661] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:41.380927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3215df1-c4df-4e6e-80ab-991c6c479cf8 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:41.387843 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3215df1-c4df-4e6e-80ab-991c6c479cf8 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:41.393392 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102a2f9-33cb-4ea6-88e8-892326c3bd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:41.394108 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102a2f9-33cb-4ea6-88e8-892326c3bd6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:41.394396 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102a2f9-33cb-4ea6-88e8-892326c3bd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:41.394675 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102a2f9-33cb-4ea6-88e8-892326c3bd6c admin admin] PATH_INFO: `/v3/projects/5a588994bbfb4758880595033b67c27b/users/366ce09322b94007a99567b219b73de0/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:41.410718 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9102a2f9-33cb-4ea6-88e8-892326c3bd6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a588994bbfb4758880595033b67c27b, user_id=366ce09322b94007a99567b219b73de0, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:41.414055 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9102a2f9-33cb-4ea6-88e8-892326c3bd6c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:41.652615 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 836/1662] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:11:41 2022] POST /identity/v3/projects => generated 371 bytes in 541 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:41.652615 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d276241-0042-4c07-970d-eaf48f9029e9 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:41.794698 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d276241-0042-4c07-970d-eaf48f9029e9 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:41.794698 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a0490-9bc5-43b7-a9e4-284804ffa4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:41.794698 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a0490-9bc5-43b7-a9e4-284804ffa4c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:41.794698 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a0490-9bc5-43b7-a9e4-284804ffa4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:41.795287 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a0490-9bc5-43b7-a9e4-284804ffa4c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:41.795287 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a0490-9bc5-43b7-a9e4-284804ffa4c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:41.795287 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a0490-9bc5-43b7-a9e4-284804ffa4c7 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:41.884679 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 827/1663] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:41 2022] PUT /identity/v3/projects/5a588994bbfb4758880595033b67c27b/users/366ce09322b94007a99567b219b73de0/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:11:41.889376 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102a2f9-33cb-4ea6-88e8-892326c3bd6c admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:41.891215 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9102a2f9-33cb-4ea6-88e8-892326c3bd6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:41.941106 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 837/1664] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:11:41 2022] POST /identity/v3/users => generated 286 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:11:41.942302 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a0490-9bc5-43b7-a9e4-284804ffa4c7 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:41.947957 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-6e8a0490-9bc5-43b7-a9e4-284804ffa4c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:41.968684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a0490-9bc5-43b7-a9e4-284804ffa4c7 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:41.978370 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102a2f9-33cb-4ea6-88e8-892326c3bd6c admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:41.984927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81160605-9b46-40d3-a6f0-1471ebab9472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:41.984927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81160605-9b46-40d3-a6f0-1471ebab9472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:41.984927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81160605-9b46-40d3-a6f0-1471ebab9472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:41.984927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81160605-9b46-40d3-a6f0-1471ebab9472 admin admin] PATH_INFO: `/v3/projects/fb419b629f794f2ead00add69aa73649` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:41.985357 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e520d75-a916-4bd2-8a6c-898472f94cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:41.985357 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e520d75-a916-4bd2-8a6c-898472f94cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:41.985357 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e520d75-a916-4bd2-8a6c-898472f94cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:41.985357 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e520d75-a916-4bd2-8a6c-898472f94cd9 admin admin] PATH_INFO: `/v3/users/0652ea7bfed0413796c65f58c1b2c5b8` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:41.985765 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81160605-9b46-40d3-a6f0-1471ebab9472 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb419b629f794f2ead00add69aa73649)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:41.986839 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e520d75-a916-4bd2-8a6c-898472f94cd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0652ea7bfed0413796c65f58c1b2c5b8)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:41.987614 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81160605-9b46-40d3-a6f0-1471ebab9472 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:41.988983 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e520d75-a916-4bd2-8a6c-898472f94cd9 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:42.155865 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:42.230200 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7e520d75-a916-4bd2-8a6c-898472f94cd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0652ea7bfed0413796c65f58c1b2c5b8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:42.235129 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-81160605-9b46-40d3-a6f0-1471ebab9472 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb419b629f794f2ead00add69aa73649', 'request_id': 'req-81160605-9b46-40d3-a6f0-1471ebab9472'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:42.339955 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7e520d75-a916-4bd2-8a6c-898472f94cd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0652ea7bfed0413796c65f58c1b2c5b8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:42.361670 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7e520d75-a916-4bd2-8a6c-898472f94cd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0652ea7bfed0413796c65f58c1b2c5b8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:42.370177 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7e520d75-a916-4bd2-8a6c-898472f94cd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0652ea7bfed0413796c65f58c1b2c5b8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:42.370997 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7e520d75-a916-4bd2-8a6c-898472f94cd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0652ea7bfed0413796c65f58c1b2c5b8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:42.377466 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 828/1665] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:11:41 2022] DELETE /identity/v3/users/0652ea7bfed0413796c65f58c1b2c5b8 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:42.388610 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e520d75-a916-4bd2-8a6c-898472f94cd9 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:42.388610 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7e520d75-a916-4bd2-8a6c-898472f94cd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:42.447242 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-81160605-9b46-40d3-a6f0-1471ebab9472 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb419b629f794f2ead00add69aa73649', 'request_id': 'req-81160605-9b46-40d3-a6f0-1471ebab9472'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:42.457093 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-81160605-9b46-40d3-a6f0-1471ebab9472 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb419b629f794f2ead00add69aa73649', 'request_id': 'req-81160605-9b46-40d3-a6f0-1471ebab9472'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:42.464928 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e520d75-a916-4bd2-8a6c-898472f94cd9 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:42.471428 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0078b-1c70-4a91-9d35-596f90125844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:42.472196 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0078b-1c70-4a91-9d35-596f90125844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:42.473352 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0078b-1c70-4a91-9d35-596f90125844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:42.473352 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0078b-1c70-4a91-9d35-596f90125844 admin admin] PATH_INFO: `/v3/projects/7bd8f14c51a14ae5a9b4681b3c48ef99` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:42.474280 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0078b-1c70-4a91-9d35-596f90125844 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bd8f14c51a14ae5a9b4681b3c48ef99)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:42.477021 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0078b-1c70-4a91-9d35-596f90125844 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:42.480251 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-81160605-9b46-40d3-a6f0-1471ebab9472 admin admin] The token cache is being invalidate because project fb419b629f794f2ead00add69aa73649 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:11:42.480251 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-81160605-9b46-40d3-a6f0-1471ebab9472 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:42.480625 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-81160605-9b46-40d3-a6f0-1471ebab9472 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:42.487072 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 838/1666] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:11:41 2022] DELETE /identity/v3/projects/fb419b629f794f2ead00add69aa73649 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:42.487072 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81160605-9b46-40d3-a6f0-1471ebab9472 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:42.487072 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-81160605-9b46-40d3-a6f0-1471ebab9472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:42.600814 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81160605-9b46-40d3-a6f0-1471ebab9472 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:42.606540 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-82d0078b-1c70-4a91-9d35-596f90125844 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bd8f14c51a14ae5a9b4681b3c48ef99', 'request_id': 'req-82d0078b-1c70-4a91-9d35-596f90125844'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:42.617374 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-82d0078b-1c70-4a91-9d35-596f90125844 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bd8f14c51a14ae5a9b4681b3c48ef99', 'request_id': 'req-82d0078b-1c70-4a91-9d35-596f90125844'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:42.674379 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6841398-a310-4d37-a929-7385f572a0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:42.675051 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6841398-a310-4d37-a929-7385f572a0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:42.675490 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6841398-a310-4d37-a929-7385f572a0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:42.675877 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6841398-a310-4d37-a929-7385f572a0a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:42.676856 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6841398-a310-4d37-a929-7385f572a0a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:42.679157 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6841398-a310-4d37-a929-7385f572a0a1 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:42.693306 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-82d0078b-1c70-4a91-9d35-596f90125844 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bd8f14c51a14ae5a9b4681b3c48ef99', 'request_id': 'req-82d0078b-1c70-4a91-9d35-596f90125844'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:42.695452 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 839/1667] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:42.697043 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6841398-a310-4d37-a929-7385f572a0a1 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:42.699298 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-b6841398-a310-4d37-a929-7385f572a0a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:42.707844 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-82d0078b-1c70-4a91-9d35-596f90125844 admin admin] The token cache is being invalidate because project 7bd8f14c51a14ae5a9b4681b3c48ef99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:11:42.708170 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-82d0078b-1c70-4a91-9d35-596f90125844 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:42.712185 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-82d0078b-1c70-4a91-9d35-596f90125844 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:42.718998 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 829/1668] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:11:42 2022] DELETE /identity/v3/projects/7bd8f14c51a14ae5a9b4681b3c48ef99 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:42.718998 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff78b93-3df6-4b92-a6af-bbf51ab1c637 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:42.718998 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff78b93-3df6-4b92-a6af-bbf51ab1c637 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:42.718998 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff78b93-3df6-4b92-a6af-bbf51ab1c637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:42.722639 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6841398-a310-4d37-a929-7385f572a0a1 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:42.740836 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a1f44-54ce-4ffe-a698-8b87b7370d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:42.741629 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a1f44-54ce-4ffe-a698-8b87b7370d12 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:42.742000 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a1f44-54ce-4ffe-a698-8b87b7370d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:42.742365 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a1f44-54ce-4ffe-a698-8b87b7370d12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:42.743293 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a1f44-54ce-4ffe-a698-8b87b7370d12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:42.746073 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a1f44-54ce-4ffe-a698-8b87b7370d12 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:42.749656 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-aff78b93-3df6-4b92-a6af-bbf51ab1c637 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:42.751550 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-aff78b93-3df6-4b92-a6af-bbf51ab1c637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:42.762767 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 830/1669] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:42.764571 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77acbc-7962-4d62-b3f5-bef4c62851e1 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:42.767976 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77acbc-7962-4d62-b3f5-bef4c62851e1 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:42.767976 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77acbc-7962-4d62-b3f5-bef4c62851e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:42.770979 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 840/1670] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:42.772674 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a1f44-54ce-4ffe-a698-8b87b7370d12 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:42.775089 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-828a1f44-54ce-4ffe-a698-8b87b7370d12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:42.795156 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a1f44-54ce-4ffe-a698-8b87b7370d12 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:42.802008 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-6a77acbc-7962-4d62-b3f5-bef4c62851e1 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:42.803797 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6a77acbc-7962-4d62-b3f5-bef4c62851e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:42.810171 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd1a08-4132-4883-8324-c7cf5837fc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:42.810871 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd1a08-4132-4883-8324-c7cf5837fc2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:42.811154 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd1a08-4132-4883-8324-c7cf5837fc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:42.811430 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd1a08-4132-4883-8324-c7cf5837fc2a admin admin] PATH_INFO: `/v3/projects/5a588994bbfb4758880595033b67c27b/users/366ce09322b94007a99567b219b73de0/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:42.814422 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dd1a08-4132-4883-8324-c7cf5837fc2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a588994bbfb4758880595033b67c27b, user_id=366ce09322b94007a99567b219b73de0, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:42.818992 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dd1a08-4132-4883-8324-c7cf5837fc2a admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:42.828760 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 831/1671] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:42.828760 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f5303-4f3d-42cf-a405-3339f134cfb0 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:42.828760 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f5303-4f3d-42cf-a405-3339f134cfb0 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:42.828760 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f5303-4f3d-42cf-a405-3339f134cfb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:42.846570 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 841/1672] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:42 2022] PUT /identity/v3/projects/5a588994bbfb4758880595033b67c27b/users/366ce09322b94007a99567b219b73de0/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:42.851225 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd1a08-4132-4883-8324-c7cf5837fc2a admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:42.854086 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-72dd1a08-4132-4883-8324-c7cf5837fc2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:42.870937 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-051f5303-4f3d-42cf-a405-3339f134cfb0 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:42.872221 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-051f5303-4f3d-42cf-a405-3339f134cfb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:42.883072 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:42.969627 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd1a08-4132-4883-8324-c7cf5837fc2a admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:42.975528 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc446cd-c99d-4aa8-b96f-d1a6afdedb49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:42.976816 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc446cd-c99d-4aa8-b96f-d1a6afdedb49 service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:42.977300 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc446cd-c99d-4aa8-b96f-d1a6afdedb49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:42.977882 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc446cd-c99d-4aa8-b96f-d1a6afdedb49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:42.987502 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 832/1673] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:42.987502 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f5303-4f3d-42cf-a405-3339f134cfb0 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:42.988307 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-051f5303-4f3d-42cf-a405-3339f134cfb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:42.998835 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc446cd-c99d-4aa8-b96f-d1a6afdedb49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:43.001780 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc446cd-c99d-4aa8-b96f-d1a6afdedb49 service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:43.012003 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f5303-4f3d-42cf-a405-3339f134cfb0 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:43.018635 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 842/1674] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:43.021161 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f61a3-416c-4a0f-9320-5780fbc57c36 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:43.021835 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f61a3-416c-4a0f-9320-5780fbc57c36 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:43.022369 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f61a3-416c-4a0f-9320-5780fbc57c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:43.031395 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c197fa6-1240-4820-ab2a-b1e502234c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:43.032049 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c197fa6-1240-4820-ab2a-b1e502234c27 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:43.032360 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c197fa6-1240-4820-ab2a-b1e502234c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:43.032696 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c197fa6-1240-4820-ab2a-b1e502234c27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:43.033332 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c197fa6-1240-4820-ab2a-b1e502234c27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:43.035428 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c197fa6-1240-4820-ab2a-b1e502234c27 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:43.049982 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-e22f61a3-416c-4a0f-9320-5780fbc57c36 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:43.052484 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-e22f61a3-416c-4a0f-9320-5780fbc57c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:43.061098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 833/1675] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:43.068875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931b475-aabe-462e-8463-2af985dc7f03 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:43.071806 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931b475-aabe-462e-8463-2af985dc7f03 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:43.071806 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931b475-aabe-462e-8463-2af985dc7f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:43.075975 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 843/1676] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:43.075975 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f61a3-416c-4a0f-9320-5780fbc57c36 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:43.089093 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f61a3-416c-4a0f-9320-5780fbc57c36 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:43.097648 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca01abb-6f76-4adb-8172-97263cfa46fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:43.098480 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca01abb-6f76-4adb-8172-97263cfa46fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:43.098834 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca01abb-6f76-4adb-8172-97263cfa46fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:43.099199 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca01abb-6f76-4adb-8172-97263cfa46fb admin admin] PATH_INFO: `/v3/projects/daba4ce7a36a49148977a5dc51651257/users/9d441e9bdf0f43509f976a5e0ab8c83b/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:43.129948 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-5931b475-aabe-462e-8463-2af985dc7f03 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:43.131216 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5931b475-aabe-462e-8463-2af985dc7f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:43.148603 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 834/1677] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:43.150448 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931b475-aabe-462e-8463-2af985dc7f03 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:43.172356 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931b475-aabe-462e-8463-2af985dc7f03 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:43.179619 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca01abb-6f76-4adb-8172-97263cfa46fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=daba4ce7a36a49148977a5dc51651257, user_id=9d441e9bdf0f43509f976a5e0ab8c83b, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:43.184830 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca01abb-6f76-4adb-8172-97263cfa46fb admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:43.194086 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fafe5e-0284-4e24-925a-806bffe69cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:43.194733 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fafe5e-0284-4e24-925a-806bffe69cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:43.195019 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fafe5e-0284-4e24-925a-806bffe69cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:43.197946 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fafe5e-0284-4e24-925a-806bffe69cd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:43.197946 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fafe5e-0284-4e24-925a-806bffe69cd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:11:43.197946 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fafe5e-0284-4e24-925a-806bffe69cd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:43.197946 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fafe5e-0284-4e24-925a-806bffe69cd9 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:43.233251 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 835/1678] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:11:43.234150 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fafe5e-0284-4e24-925a-806bffe69cd9 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:43.249429 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fafe5e-0284-4e24-925a-806bffe69cd9 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:43.263958 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e648a45-ed58-44a6-abc1-2e3eef2ef42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:43.265405 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e648a45-ed58-44a6-abc1-2e3eef2ef42c admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:43.265405 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e648a45-ed58-44a6-abc1-2e3eef2ef42c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:43.265609 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e648a45-ed58-44a6-abc1-2e3eef2ef42c admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:43.266324 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e648a45-ed58-44a6-abc1-2e3eef2ef42c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:11:43.266635 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e648a45-ed58-44a6-abc1-2e3eef2ef42c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:43.268584 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e648a45-ed58-44a6-abc1-2e3eef2ef42c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:43.284277 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 844/1679] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:43 2022] PUT /identity/v3/projects/daba4ce7a36a49148977a5dc51651257/users/9d441e9bdf0f43509f976a5e0ab8c83b/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:43.285376 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca01abb-6f76-4adb-8172-97263cfa46fb admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:43.285559 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 836/1680] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:11:43.290677 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e648a45-ed58-44a6-abc1-2e3eef2ef42c admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:43.311558 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e648a45-ed58-44a6-abc1-2e3eef2ef42c admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:43.403219 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26d408-360f-4f3e-8a4c-bf19572d184b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:43.404050 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26d408-360f-4f3e-8a4c-bf19572d184b admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:43.404731 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26d408-360f-4f3e-8a4c-bf19572d184b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:43.405162 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26d408-360f-4f3e-8a4c-bf19572d184b admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:43.405951 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de26d408-360f-4f3e-8a4c-bf19572d184b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:43.413686 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de26d408-360f-4f3e-8a4c-bf19572d184b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:43.418459 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca01abb-6f76-4adb-8172-97263cfa46fb admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:43.437839 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785fdf0-9d21-4921-921a-3f234f7e1263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:43.438490 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785fdf0-9d21-4921-921a-3f234f7e1263 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:43.438775 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785fdf0-9d21-4921-921a-3f234f7e1263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:43.439212 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785fdf0-9d21-4921-921a-3f234f7e1263 admin admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:43.443101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785fdf0-9d21-4921-921a-3f234f7e1263 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:43.443101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785fdf0-9d21-4921-921a-3f234f7e1263 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:43.528114 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 837/1681] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:11:43 2022] POST /identity/v3/projects => generated 385 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:11:43.529793 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c5027-8d60-4299-a1cd-11bf9e88f0cd None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:43.532243 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c5027-8d60-4299-a1cd-11bf9e88f0cd None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:43.532728 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c5027-8d60-4299-a1cd-11bf9e88f0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:43.551568 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 845/1682] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:11:43 2022] POST /identity/v3/projects => generated 375 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:43.553162 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785fdf0-9d21-4921-921a-3f234f7e1263 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:43.577735 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-c82c5027-8d60-4299-a1cd-11bf9e88f0cd None None] MFA Rules not processed for user `9d441e9bdf0f43509f976a5e0ab8c83b`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:43.579229 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c82c5027-8d60-4299-a1cd-11bf9e88f0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:43.633338 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785fdf0-9d21-4921-921a-3f234f7e1263 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:43.642538 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99365dc9-f13f-4f61-ad37-3b4d815e0c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:43.643445 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99365dc9-f13f-4f61-ad37-3b4d815e0c4f admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:43.644441 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99365dc9-f13f-4f61-ad37-3b4d815e0c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:43.644723 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99365dc9-f13f-4f61-ad37-3b4d815e0c4f admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:43.647203 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99365dc9-f13f-4f61-ad37-3b4d815e0c4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:43.651490 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99365dc9-f13f-4f61-ad37-3b4d815e0c4f admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:43.701481 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 838/1683] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:43.705069 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c5027-8d60-4299-a1cd-11bf9e88f0cd None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:43.716313 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c5027-8d60-4299-a1cd-11bf9e88f0cd None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:43.726033 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3cdc2-5bf6-4c15-8ae4-c58925e8b980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:43.726693 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3cdc2-5bf6-4c15-8ae4-c58925e8b980 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:43.727286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3cdc2-5bf6-4c15-8ae4-c58925e8b980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:43.727286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3cdc2-5bf6-4c15-8ae4-c58925e8b980 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:43.727942 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e3cdc2-5bf6-4c15-8ae4-c58925e8b980 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:43.730002 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e3cdc2-5bf6-4c15-8ae4-c58925e8b980 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:43.768199 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 846/1684] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:11:43 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:43.770086 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99365dc9-f13f-4f61-ad37-3b4d815e0c4f admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:43.785201 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99365dc9-f13f-4f61-ad37-3b4d815e0c4f admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:43.791815 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d87905-325a-48c3-bd99-800ed0183619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:43.792635 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d87905-325a-48c3-bd99-800ed0183619 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:43.792988 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d87905-325a-48c3-bd99-800ed0183619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:43.793328 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d87905-325a-48c3-bd99-800ed0183619 admin admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:43.794141 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d87905-325a-48c3-bd99-800ed0183619 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:43.796175 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d87905-325a-48c3-bd99-800ed0183619 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:43.874112 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 839/1685] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:11:43 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:43.875334 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3cdc2-5bf6-4c15-8ae4-c58925e8b980 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:43.895521 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3cdc2-5bf6-4c15-8ae4-c58925e8b980 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:43.901040 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3da9ce-5af6-41e6-a0bc-0e0932282f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:43.901674 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3da9ce-5af6-41e6-a0bc-0e0932282f01 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:43.901982 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3da9ce-5af6-41e6-a0bc-0e0932282f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:43.902228 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3da9ce-5af6-41e6-a0bc-0e0932282f01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:43.902869 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3da9ce-5af6-41e6-a0bc-0e0932282f01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:43.904531 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3da9ce-5af6-41e6-a0bc-0e0932282f01 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:43.919260 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 840/1686] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:43.919260 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3da9ce-5af6-41e6-a0bc-0e0932282f01 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:43.921592 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8a3da9ce-5af6-41e6-a0bc-0e0932282f01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:43.927416 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 847/1687] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:11:43 2022] POST /identity/v3/projects => generated 373 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:43.929174 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d87905-325a-48c3-bd99-800ed0183619 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:43.938039 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3da9ce-5af6-41e6-a0bc-0e0932282f01 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:44.001729 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b5a79-6f5d-4bab-9901-8e77dd0966d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:44.002565 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b5a79-6f5d-4bab-9901-8e77dd0966d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:44.003055 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b5a79-6f5d-4bab-9901-8e77dd0966d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:44.003862 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b5a79-6f5d-4bab-9901-8e77dd0966d6 admin admin] PATH_INFO: `/v3/projects/610b17527a5a420494edc4b8cfff4559` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:44.005097 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b5a79-6f5d-4bab-9901-8e77dd0966d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=610b17527a5a420494edc4b8cfff4559)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:44.007648 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b5a79-6f5d-4bab-9901-8e77dd0966d6 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:44.023135 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d87905-325a-48c3-bd99-800ed0183619 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:44.029782 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638075c-a29f-4107-959d-d60091ef50f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:44.030410 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638075c-a29f-4107-959d-d60091ef50f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:44.030695 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638075c-a29f-4107-959d-d60091ef50f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:44.030973 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638075c-a29f-4107-959d-d60091ef50f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:44.031655 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638075c-a29f-4107-959d-d60091ef50f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:44.033950 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638075c-a29f-4107-959d-d60091ef50f0 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:44.046229 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 848/1688] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:44.047420 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638075c-a29f-4107-959d-d60091ef50f0 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:44.059093 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638075c-a29f-4107-959d-d60091ef50f0 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:44.064076 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354959c4-50e4-4896-b1c5-8650a92dfcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:44.064698 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354959c4-50e4-4896-b1c5-8650a92dfcba admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:44.064982 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354959c4-50e4-4896-b1c5-8650a92dfcba admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:44.065271 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354959c4-50e4-4896-b1c5-8650a92dfcba admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:44.065893 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354959c4-50e4-4896-b1c5-8650a92dfcba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:44.067605 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354959c4-50e4-4896-b1c5-8650a92dfcba admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:44.081220 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 849/1689] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:44.081622 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354959c4-50e4-4896-b1c5-8650a92dfcba admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:44.094458 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354959c4-50e4-4896-b1c5-8650a92dfcba admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:44.099136 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e1939-f057-4994-b6ab-84c7759034a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:44.100326 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e1939-f057-4994-b6ab-84c7759034a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:44.100607 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e1939-f057-4994-b6ab-84c7759034a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:44.100884 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e1939-f057-4994-b6ab-84c7759034a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:44.101515 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e1939-f057-4994-b6ab-84c7759034a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:44.103515 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e1939-f057-4994-b6ab-84c7759034a6 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:44.166002 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f61b5a79-6f5d-4bab-9901-8e77dd0966d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '610b17527a5a420494edc4b8cfff4559', 'request_id': 'req-f61b5a79-6f5d-4bab-9901-8e77dd0966d6'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:44.172346 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f61b5a79-6f5d-4bab-9901-8e77dd0966d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '610b17527a5a420494edc4b8cfff4559', 'request_id': 'req-f61b5a79-6f5d-4bab-9901-8e77dd0966d6'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:44.210646 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 850/1690] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:11:44 2022] POST /identity/v3/users => generated 293 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:44.210646 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e1939-f057-4994-b6ab-84c7759034a6 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:44.219391 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e1939-f057-4994-b6ab-84c7759034a6 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:44.286746 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d8f8d-c353-4257-8c46-e722e5368acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:44.287959 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d8f8d-c353-4257-8c46-e722e5368acd admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:44.288302 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d8f8d-c353-4257-8c46-e722e5368acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:44.288577 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d8f8d-c353-4257-8c46-e722e5368acd admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:44.289220 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d8f8d-c353-4257-8c46-e722e5368acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:44.290815 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d8f8d-c353-4257-8c46-e722e5368acd admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:44.301032 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 851/1691] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:44.301898 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d8f8d-c353-4257-8c46-e722e5368acd admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:44.310114 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f61b5a79-6f5d-4bab-9901-8e77dd0966d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '610b17527a5a420494edc4b8cfff4559', 'request_id': 'req-f61b5a79-6f5d-4bab-9901-8e77dd0966d6'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:44.316982 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d8f8d-c353-4257-8c46-e722e5368acd admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:44.322231 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70ac19-08c8-435b-ab8f-6f76e0a77eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:44.322953 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f61b5a79-6f5d-4bab-9901-8e77dd0966d6 admin admin] The token cache is being invalidate because project 610b17527a5a420494edc4b8cfff4559 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:11:44.323251 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f61b5a79-6f5d-4bab-9901-8e77dd0966d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:44.323664 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70ac19-08c8-435b-ab8f-6f76e0a77eef admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:44.324187 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f61b5a79-6f5d-4bab-9901-8e77dd0966d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:44.324332 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70ac19-08c8-435b-ab8f-6f76e0a77eef admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:44.324677 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70ac19-08c8-435b-ab8f-6f76e0a77eef admin admin] PATH_INFO: `/v3/projects/ac3c33db2eb54da08166770ba98db9f4/users/d74fa267aec34ff8b8a607304ba37c1c/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:44.332089 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 841/1692] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:11:43 2022] DELETE /identity/v3/projects/610b17527a5a420494edc4b8cfff4559 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:44.335810 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b5a79-6f5d-4bab-9901-8e77dd0966d6 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:44.338112 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:44.339836 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f61b5a79-6f5d-4bab-9901-8e77dd0966d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:44.346747 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c70ac19-08c8-435b-ab8f-6f76e0a77eef admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac3c33db2eb54da08166770ba98db9f4, user_id=d74fa267aec34ff8b8a607304ba37c1c, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:44.349636 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c70ac19-08c8-435b-ab8f-6f76e0a77eef admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:44.356941 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b5a79-6f5d-4bab-9901-8e77dd0966d6 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:44.362306 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d390aad-c8c3-4e7b-9f9a-251f44607b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:44.362933 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d390aad-c8c3-4e7b-9f9a-251f44607b40 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:44.363244 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d390aad-c8c3-4e7b-9f9a-251f44607b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:44.363520 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d390aad-c8c3-4e7b-9f9a-251f44607b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:44.364202 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d390aad-c8c3-4e7b-9f9a-251f44607b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:44.365897 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d390aad-c8c3-4e7b-9f9a-251f44607b40 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:44.377282 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 842/1693] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:44.381071 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d390aad-c8c3-4e7b-9f9a-251f44607b40 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:44.382828 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5d390aad-c8c3-4e7b-9f9a-251f44607b40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:44.397956 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d390aad-c8c3-4e7b-9f9a-251f44607b40 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:44.403923 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09963c9-85cd-430b-89d9-9114e939fff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:44.404651 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09963c9-85cd-430b-89d9-9114e939fff2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:44.405127 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09963c9-85cd-430b-89d9-9114e939fff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:44.405411 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09963c9-85cd-430b-89d9-9114e939fff2 admin admin] PATH_INFO: `/v3/projects/c7937e7812444ca6a5ed22476e5e6a4c/users/7b905ab2ee71495ba7055e32299d3b45/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:44.425046 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09963c9-85cd-430b-89d9-9114e939fff2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7937e7812444ca6a5ed22476e5e6a4c, user_id=7b905ab2ee71495ba7055e32299d3b45, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:44.427806 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09963c9-85cd-430b-89d9-9114e939fff2 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:44.430779 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 852/1694] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:44 2022] PUT /identity/v3/projects/ac3c33db2eb54da08166770ba98db9f4/users/d74fa267aec34ff8b8a607304ba37c1c/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:44.431627 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70ac19-08c8-435b-ab8f-6f76e0a77eef admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:44.436721 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-2c70ac19-08c8-435b-ab8f-6f76e0a77eef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:44.504769 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:44.524196 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70ac19-08c8-435b-ab8f-6f76e0a77eef admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:44.530106 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5fdb4-c291-4780-8ac1-2200af5e31f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:44.530839 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5fdb4-c291-4780-8ac1-2200af5e31f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:44.531132 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5fdb4-c291-4780-8ac1-2200af5e31f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:44.531620 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5fdb4-c291-4780-8ac1-2200af5e31f3 admin admin] PATH_INFO: `/v3/users/37c01f4702604ef780cd68aacd53bef4` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:44.533355 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff5fdb4-c291-4780-8ac1-2200af5e31f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37c01f4702604ef780cd68aacd53bef4)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:44.535296 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff5fdb4-c291-4780-8ac1-2200af5e31f3 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:44.546398 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 843/1695] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:44 2022] PUT /identity/v3/projects/c7937e7812444ca6a5ed22476e5e6a4c/users/7b905ab2ee71495ba7055e32299d3b45/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:44.547892 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09963c9-85cd-430b-89d9-9114e939fff2 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:44.619760 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09963c9-85cd-430b-89d9-9114e939fff2 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:44.624919 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3459e-324a-4f26-9c5f-f00040660bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:44.625675 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3459e-324a-4f26-9c5f-f00040660bc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:44.625949 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3459e-324a-4f26-9c5f-f00040660bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:44.626536 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3459e-324a-4f26-9c5f-f00040660bc9 admin admin] PATH_INFO: `/v3/projects/d1790f80b4ec4c98a525fa350953c58d/users/20a838d274284e3eaf1cfb7a410fa61a/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:44.644023 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3459e-324a-4f26-9c5f-f00040660bc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1790f80b4ec4c98a525fa350953c58d, user_id=20a838d274284e3eaf1cfb7a410fa61a, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:44.646810 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3459e-324a-4f26-9c5f-f00040660bc9 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:44.786238 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 844/1696] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:44 2022] PUT /identity/v3/projects/d1790f80b4ec4c98a525fa350953c58d/users/20a838d274284e3eaf1cfb7a410fa61a/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:44.788000 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d21eb-f2bf-4c02-a984-8f7b2589c4ea None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:44.788326 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d21eb-f2bf-4c02-a984-8f7b2589c4ea None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:44.788600 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d21eb-f2bf-4c02-a984-8f7b2589c4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:44.827248 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-f75d21eb-f2bf-4c02-a984-8f7b2589c4ea None None] MFA Rules not processed for user `d74fa267aec34ff8b8a607304ba37c1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:44.828595 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f75d21eb-f2bf-4c02-a984-8f7b2589c4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:44.879797 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-fff5fdb4-c291-4780-8ac1-2200af5e31f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37c01f4702604ef780cd68aacd53bef4'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:44.916109 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 845/1697] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:44.916109 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69b69b-ead7-4828-b6c6-add03e35d9b8 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:44.916109 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69b69b-ead7-4828-b6c6-add03e35d9b8 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:44.916109 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69b69b-ead7-4828-b6c6-add03e35d9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:44.964776 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-ec69b69b-ead7-4828-b6c6-add03e35d9b8 None None] MFA Rules not processed for user `7b905ab2ee71495ba7055e32299d3b45`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:44.966394 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ec69b69b-ead7-4828-b6c6-add03e35d9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:44.977109 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-fff5fdb4-c291-4780-8ac1-2200af5e31f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37c01f4702604ef780cd68aacd53bef4'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:44.994662 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-fff5fdb4-c291-4780-8ac1-2200af5e31f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37c01f4702604ef780cd68aacd53bef4'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:44.996492 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-fff5fdb4-c291-4780-8ac1-2200af5e31f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37c01f4702604ef780cd68aacd53bef4'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:45.007040 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-fff5fdb4-c291-4780-8ac1-2200af5e31f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37c01f4702604ef780cd68aacd53bef4'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:45.013832 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 853/1698] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:11:44 2022] DELETE /identity/v3/users/37c01f4702604ef780cd68aacd53bef4 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:45.014467 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5fdb4-c291-4780-8ac1-2200af5e31f3 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:45.025922 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-fff5fdb4-c291-4780-8ac1-2200af5e31f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:45.073119 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 846/1699] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:45.074867 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69b69b-ead7-4828-b6c6-add03e35d9b8 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:45.076874 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ec69b69b-ead7-4828-b6c6-add03e35d9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:45.174945 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69b69b-ead7-4828-b6c6-add03e35d9b8 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:45.180205 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c7dc6-6307-4e7a-99ef-76bfdab8a435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:45.181023 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c7dc6-6307-4e7a-99ef-76bfdab8a435 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:45.181544 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c7dc6-6307-4e7a-99ef-76bfdab8a435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:45.182214 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c7dc6-6307-4e7a-99ef-76bfdab8a435 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:45.183536 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c7dc6-6307-4e7a-99ef-76bfdab8a435 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:45.185964 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c7dc6-6307-4e7a-99ef-76bfdab8a435 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:45.187473 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5fdb4-c291-4780-8ac1-2200af5e31f3 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:45.202722 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772b188-5907-44c0-b231-134ea357541a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:45.206508 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772b188-5907-44c0-b231-134ea357541a admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:45.207114 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772b188-5907-44c0-b231-134ea357541a admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:45.207458 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772b188-5907-44c0-b231-134ea357541a admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:45.208193 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d772b188-5907-44c0-b231-134ea357541a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:45.213359 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d772b188-5907-44c0-b231-134ea357541a admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:45.232519 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 854/1700] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:45.233965 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9212d-3d23-4c96-8c6c-a3863abb8db4 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:45.234261 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9212d-3d23-4c96-8c6c-a3863abb8db4 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:45.234745 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9212d-3d23-4c96-8c6c-a3863abb8db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:45.278107 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-7fe9212d-3d23-4c96-8c6c-a3863abb8db4 None None] MFA Rules not processed for user `366ce09322b94007a99567b219b73de0`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:45.279879 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-7fe9212d-3d23-4c96-8c6c-a3863abb8db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:45.292287 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 847/1701] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:11:45 2022] POST /identity/v3/projects => generated 385 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:45.296421 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c7dc6-6307-4e7a-99ef-76bfdab8a435 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:45.304341 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b63c7dc6-6307-4e7a-99ef-76bfdab8a435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:45.422701 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 855/1702] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:45 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:45.423920 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9212d-3d23-4c96-8c6c-a3863abb8db4 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:45.436745 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9212d-3d23-4c96-8c6c-a3863abb8db4 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:45.443812 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c7dc6-6307-4e7a-99ef-76bfdab8a435 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:45.454231 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd3ca6-3403-497f-8e28-b4f7944e3fea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:45.454851 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd3ca6-3403-497f-8e28-b4f7944e3fea service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:45.455192 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd3ca6-3403-497f-8e28-b4f7944e3fea service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:45.455470 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd3ca6-3403-497f-8e28-b4f7944e3fea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:45.523846 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde5382-a1a3-43b3-ac9d-e01045d2f5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:45.525184 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde5382-a1a3-43b3-ac9d-e01045d2f5e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:45.525669 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde5382-a1a3-43b3-ac9d-e01045d2f5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:45.526099 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde5382-a1a3-43b3-ac9d-e01045d2f5e2 admin admin] PATH_INFO: `/v3/projects/d1790f80b4ec4c98a525fa350953c58d/users/20a838d274284e3eaf1cfb7a410fa61a/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:45.529264 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde5382-a1a3-43b3-ac9d-e01045d2f5e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1790f80b4ec4c98a525fa350953c58d, user_id=20a838d274284e3eaf1cfb7a410fa61a, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:45.532959 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde5382-a1a3-43b3-ac9d-e01045d2f5e2 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:45.545881 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd3ca6-3403-497f-8e28-b4f7944e3fea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:45.555567 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd3ca6-3403-497f-8e28-b4f7944e3fea service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:45.556565 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 856/1703] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:45 2022] PUT /identity/v3/projects/d1790f80b4ec4c98a525fa350953c58d/users/20a838d274284e3eaf1cfb7a410fa61a/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:45.558413 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde5382-a1a3-43b3-ac9d-e01045d2f5e2 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:45.564047 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 848/1704] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:45.580107 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950f5ae-cbdb-4829-ac9f-04374809cd61 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:45.581499 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950f5ae-cbdb-4829-ac9f-04374809cd61 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:45.581917 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950f5ae-cbdb-4829-ac9f-04374809cd61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:45.624810 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-0950f5ae-cbdb-4829-ac9f-04374809cd61 None None] MFA Rules not processed for user `aab60a59067c4bcf8d643e5f3364917d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:45.626328 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0950f5ae-cbdb-4829-ac9f-04374809cd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:45.750202 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde5382-a1a3-43b3-ac9d-e01045d2f5e2 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:45.766682 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1bfa4-fdbe-4700-b623-cbffbcaa6854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:45.767418 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1bfa4-fdbe-4700-b623-cbffbcaa6854 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:45.767648 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1bfa4-fdbe-4700-b623-cbffbcaa6854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:45.767930 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1bfa4-fdbe-4700-b623-cbffbcaa6854 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:45.768801 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1bfa4-fdbe-4700-b623-cbffbcaa6854 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:45.771278 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1bfa4-fdbe-4700-b623-cbffbcaa6854 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:45.788560 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 849/1705] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:45.802216 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259686b-cc19-4e4a-8f8b-eb394ae99e10 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:45.802569 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259686b-cc19-4e4a-8f8b-eb394ae99e10 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:45.803310 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259686b-cc19-4e4a-8f8b-eb394ae99e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:45.845173 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-8259686b-cc19-4e4a-8f8b-eb394ae99e10 None None] MFA Rules not processed for user `20a838d274284e3eaf1cfb7a410fa61a`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:45.846472 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8259686b-cc19-4e4a-8f8b-eb394ae99e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:45.910930 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 857/1706] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:11:45 2022] POST /identity/v3/users => generated 293 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:45.910930 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88dd50e-a2e9-4592-8852-effeb093c1ea None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:45.911435 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88dd50e-a2e9-4592-8852-effeb093c1ea None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:45.911435 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88dd50e-a2e9-4592-8852-effeb093c1ea None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:45.913549 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 858/1707] 10.222.0.45 () {54 vars in 921 bytes} [Wed Oct 26 11:11:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:11:45.914385 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88dd50e-a2e9-4592-8852-effeb093c1ea None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:45.918362 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-a88dd50e-a2e9-4592-8852-effeb093c1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:45.927234 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 850/1708] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:45.932269 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259686b-cc19-4e4a-8f8b-eb394ae99e10 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:45.961095 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259686b-cc19-4e4a-8f8b-eb394ae99e10 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:45.967098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675cfb6a-43a0-434c-89bc-a66abf8d8a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:45.968330 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675cfb6a-43a0-434c-89bc-a66abf8d8a07 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:45.968618 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675cfb6a-43a0-434c-89bc-a66abf8d8a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:45.968898 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675cfb6a-43a0-434c-89bc-a66abf8d8a07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:45.970535 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675cfb6a-43a0-434c-89bc-a66abf8d8a07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:45.973755 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675cfb6a-43a0-434c-89bc-a66abf8d8a07 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:45.990632 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 851/1709] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:45.991892 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675cfb6a-43a0-434c-89bc-a66abf8d8a07 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:45.994953 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-675cfb6a-43a0-434c-89bc-a66abf8d8a07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:46.010300 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675cfb6a-43a0-434c-89bc-a66abf8d8a07 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:46.015737 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c10647-f146-491b-b04a-b3e49fa0ea4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:46.016448 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c10647-f146-491b-b04a-b3e49fa0ea4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:46.016737 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c10647-f146-491b-b04a-b3e49fa0ea4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:46.017015 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c10647-f146-491b-b04a-b3e49fa0ea4c admin admin] PATH_INFO: `/v3/projects/3a87ff965c9a4f748ea276404d40a218` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:46.018288 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c10647-f146-491b-b04a-b3e49fa0ea4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a87ff965c9a4f748ea276404d40a218)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:46.020457 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c10647-f146-491b-b04a-b3e49fa0ea4c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:46.053255 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88dd50e-a2e9-4592-8852-effeb093c1ea None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:46.059970 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bcc0b3-b2fb-4421-a6c2-825361cf627a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:46.062240 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcc0b3-b2fb-4421-a6c2-825361cf627a service nova] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:46.062240 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcc0b3-b2fb-4421-a6c2-825361cf627a service nova] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:46.062240 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcc0b3-b2fb-4421-a6c2-825361cf627a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:46.063609 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-89bcc0b3-b2fb-4421-a6c2-825361cf627a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:46.078012 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bcc0b3-b2fb-4421-a6c2-825361cf627a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:46.079545 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bcc0b3-b2fb-4421-a6c2-825361cf627a service nova] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:46.090441 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 859/1710] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:46.091308 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bcc0b3-b2fb-4421-a6c2-825361cf627a service nova] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:46.093097 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-89bcc0b3-b2fb-4421-a6c2-825361cf627a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:46.177816 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bcc0b3-b2fb-4421-a6c2-825361cf627a service nova] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:46.196803 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-16c10647-f146-491b-b04a-b3e49fa0ea4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a87ff965c9a4f748ea276404d40a218', 'request_id': 'req-16c10647-f146-491b-b04a-b3e49fa0ea4c'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:46.206389 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-16c10647-f146-491b-b04a-b3e49fa0ea4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a87ff965c9a4f748ea276404d40a218', 'request_id': 'req-16c10647-f146-491b-b04a-b3e49fa0ea4c'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:46.239861 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d337a22-2267-476d-a453-efce81716a1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:46.241458 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d337a22-2267-476d-a453-efce81716a1e service cinder] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:46.241740 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d337a22-2267-476d-a453-efce81716a1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:46.242008 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d337a22-2267-476d-a453-efce81716a1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:46.302206 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:46.305310 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d337a22-2267-476d-a453-efce81716a1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:46.306712 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d337a22-2267-476d-a453-efce81716a1e service cinder] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:46.318817 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 860/1711] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:46.318817 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d337a22-2267-476d-a453-efce81716a1e service cinder] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:46.350817 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-16c10647-f146-491b-b04a-b3e49fa0ea4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a87ff965c9a4f748ea276404d40a218', 'request_id': 'req-16c10647-f146-491b-b04a-b3e49fa0ea4c'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:46.365276 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-16c10647-f146-491b-b04a-b3e49fa0ea4c admin admin] The token cache is being invalidate because project 3a87ff965c9a4f748ea276404d40a218 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:11:46.366600 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-16c10647-f146-491b-b04a-b3e49fa0ea4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:46.367083 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-16c10647-f146-491b-b04a-b3e49fa0ea4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:46.368883 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 852/1712] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:11:45 2022] DELETE /identity/v3/projects/3a87ff965c9a4f748ea276404d40a218 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:46.370161 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72c874-66e6-4fa3-8abd-ba88b1f4df7c None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:46.370465 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72c874-66e6-4fa3-8abd-ba88b1f4df7c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:46.370793 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72c874-66e6-4fa3-8abd-ba88b1f4df7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:46.392469 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-3b72c874-66e6-4fa3-8abd-ba88b1f4df7c None None] MFA Rules not processed for user `b4f9a2bba0e748b6a98fa7dea2482ddf`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:46.393694 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3b72c874-66e6-4fa3-8abd-ba88b1f4df7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:46.402893 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d337a22-2267-476d-a453-efce81716a1e service cinder] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:46.408196 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eff947-70ac-4dbe-9ac1-435cc42c0512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:46.408820 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eff947-70ac-4dbe-9ac1-435cc42c0512 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:46.409101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eff947-70ac-4dbe-9ac1-435cc42c0512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:46.409365 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eff947-70ac-4dbe-9ac1-435cc42c0512 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:46.410048 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eff947-70ac-4dbe-9ac1-435cc42c0512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:46.411949 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eff947-70ac-4dbe-9ac1-435cc42c0512 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:46.424133 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 861/1713] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:46.424314 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eff947-70ac-4dbe-9ac1-435cc42c0512 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:46.426553 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-b3eff947-70ac-4dbe-9ac1-435cc42c0512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:46.439868 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eff947-70ac-4dbe-9ac1-435cc42c0512 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:46.445421 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d760117-c779-4a71-ad7c-4b574f25d21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:46.446061 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d760117-c779-4a71-ad7c-4b574f25d21c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:46.446344 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d760117-c779-4a71-ad7c-4b574f25d21c admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:46.446614 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d760117-c779-4a71-ad7c-4b574f25d21c admin admin] PATH_INFO: `/v3/users/82b945fd48524bbc8604d388472dcdc2` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:46.447821 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d760117-c779-4a71-ad7c-4b574f25d21c admin admin] RBAC: Authorizing `identity:delete_user(user_id=82b945fd48524bbc8604d388472dcdc2)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:46.449820 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d760117-c779-4a71-ad7c-4b574f25d21c admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:46.465757 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 853/1714] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Oct 26 11:11:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:46.467320 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f79ff2-a468-4eea-85d2-be25e4a56043 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:46.467684 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f79ff2-a468-4eea-85d2-be25e4a56043 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:46.468347 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f79ff2-a468-4eea-85d2-be25e4a56043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:46.511630 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-c0f79ff2-a468-4eea-85d2-be25e4a56043 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:46.513296 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c0f79ff2-a468-4eea-85d2-be25e4a56043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:46.523281 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 854/1715] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:46.524545 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f79ff2-a468-4eea-85d2-be25e4a56043 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:46.527518 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c0f79ff2-a468-4eea-85d2-be25e4a56043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:46.547465 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f79ff2-a468-4eea-85d2-be25e4a56043 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:46.552620 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760138a1-198b-412f-af24-c5cd8eefaa88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:46.553860 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760138a1-198b-412f-af24-c5cd8eefaa88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:46.554323 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760138a1-198b-412f-af24-c5cd8eefaa88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:46.554602 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760138a1-198b-412f-af24-c5cd8eefaa88 admin admin] PATH_INFO: `/v3/projects/91e22f0c9b034f2483721909c57d59f2/users/68b2bc41d6dc4f0cae6fdfe4a448c7b1/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:46.572322 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760138a1-198b-412f-af24-c5cd8eefaa88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91e22f0c9b034f2483721909c57d59f2, user_id=68b2bc41d6dc4f0cae6fdfe4a448c7b1, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:46.576396 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760138a1-198b-412f-af24-c5cd8eefaa88 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:46.681010 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 855/1716] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:46 2022] PUT /identity/v3/projects/91e22f0c9b034f2483721909c57d59f2/users/68b2bc41d6dc4f0cae6fdfe4a448c7b1/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:46.683056 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760138a1-198b-412f-af24-c5cd8eefaa88 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:46.685252 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-760138a1-198b-412f-af24-c5cd8eefaa88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:46.720334 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-1d760117-c779-4a71-ad7c-4b574f25d21c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82b945fd48524bbc8604d388472dcdc2'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:46.779077 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760138a1-198b-412f-af24-c5cd8eefaa88 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:46.784717 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba90e46-194f-4c78-8d12-f3d432e814f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4f9a2bba0e748b6a98fa7dea2482ddf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:46.785428 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba90e46-194f-4c78-8d12-f3d432e814f8 service placement] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:46.785809 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba90e46-194f-4c78-8d12-f3d432e814f8 service placement] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:46.786161 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba90e46-194f-4c78-8d12-f3d432e814f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:46.797527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba90e46-194f-4c78-8d12-f3d432e814f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:46.799242 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba90e46-194f-4c78-8d12-f3d432e814f8 service placement] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:46.811119 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 856/1717] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:46.812439 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002d2d3-4979-4c8e-9c88-c043ec431f95 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:46.812704 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002d2d3-4979-4c8e-9c88-c043ec431f95 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:46.813423 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002d2d3-4979-4c8e-9c88-c043ec431f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:46.838551 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-0002d2d3-4979-4c8e-9c88-c043ec431f95 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:46.840092 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0002d2d3-4979-4c8e-9c88-c043ec431f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:46.858728 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-1d760117-c779-4a71-ad7c-4b574f25d21c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82b945fd48524bbc8604d388472dcdc2'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:46.874556 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-1d760117-c779-4a71-ad7c-4b574f25d21c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82b945fd48524bbc8604d388472dcdc2'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:46.876099 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-1d760117-c779-4a71-ad7c-4b574f25d21c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82b945fd48524bbc8604d388472dcdc2'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:46.889306 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-1d760117-c779-4a71-ad7c-4b574f25d21c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82b945fd48524bbc8604d388472dcdc2'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:46.897075 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 862/1718] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:11:46 2022] DELETE /identity/v3/users/82b945fd48524bbc8604d388472dcdc2 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:46.899476 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a605f32-2dad-4dbb-a61c-6bf510c27bf2 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:46.899947 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a605f32-2dad-4dbb-a61c-6bf510c27bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:46.900451 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a605f32-2dad-4dbb-a61c-6bf510c27bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:46.953304 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-2a605f32-2dad-4dbb-a61c-6bf510c27bf2 None None] MFA Rules not processed for user `68b2bc41d6dc4f0cae6fdfe4a448c7b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:46.955179 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-2a605f32-2dad-4dbb-a61c-6bf510c27bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:46.962811 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 857/1719] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:46.966188 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002d2d3-4979-4c8e-9c88-c043ec431f95 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:46.978885 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002d2d3-4979-4c8e-9c88-c043ec431f95 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:47.026191 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:47.068834 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa33e70-9fb8-4f79-a842-77de6049631a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:47.069643 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa33e70-9fb8-4f79-a842-77de6049631a admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:47.069934 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa33e70-9fb8-4f79-a842-77de6049631a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:47.070216 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa33e70-9fb8-4f79-a842-77de6049631a admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:47.070963 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa33e70-9fb8-4f79-a842-77de6049631a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:11:47.071169 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa33e70-9fb8-4f79-a842-77de6049631a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:47.073677 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa33e70-9fb8-4f79-a842-77de6049631a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:47.081887 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 863/1720] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:47.082947 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a605f32-2dad-4dbb-a61c-6bf510c27bf2 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:47.087157 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-2a605f32-2dad-4dbb-a61c-6bf510c27bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:47.092274 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 858/1721] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:11:47.101593 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa33e70-9fb8-4f79-a842-77de6049631a admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:47.117445 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa33e70-9fb8-4f79-a842-77de6049631a admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:47.120532 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a605f32-2dad-4dbb-a61c-6bf510c27bf2 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:47.125071 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efa7c6-f099-40df-b40c-4b8d03f504ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:47.125799 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efa7c6-f099-40df-b40c-4b8d03f504ae admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:47.126082 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efa7c6-f099-40df-b40c-4b8d03f504ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:47.126383 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efa7c6-f099-40df-b40c-4b8d03f504ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:47.127141 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55efa7c6-f099-40df-b40c-4b8d03f504ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:47.129865 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55efa7c6-f099-40df-b40c-4b8d03f504ae admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:47.137733 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfae687-c13f-4512-9e54-1ce4f57c2ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:47.138575 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfae687-c13f-4512-9e54-1ce4f57c2ceb admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:47.138862 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfae687-c13f-4512-9e54-1ce4f57c2ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:47.139174 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfae687-c13f-4512-9e54-1ce4f57c2ceb admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:47.139985 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfae687-c13f-4512-9e54-1ce4f57c2ceb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:47.147507 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfae687-c13f-4512-9e54-1ce4f57c2ceb admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:47.276736 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 859/1722] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:11:47 2022] POST /identity/v3/projects => generated 375 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:47.278713 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 864/1723] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:11:47 2022] POST /identity/v3/projects => generated 383 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:11:47.280902 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfae687-c13f-4512-9e54-1ce4f57c2ceb admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:47.283702 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efa7c6-f099-40df-b40c-4b8d03f504ae admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:47.367785 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfae687-c13f-4512-9e54-1ce4f57c2ceb admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:47.380555 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efa7c6-f099-40df-b40c-4b8d03f504ae admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:47.386443 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6284377-38f0-461a-bb83-20d29c8dd489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:47.387198 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6284377-38f0-461a-bb83-20d29c8dd489 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:47.387481 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6284377-38f0-461a-bb83-20d29c8dd489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:47.387756 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6284377-38f0-461a-bb83-20d29c8dd489 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:47.388457 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6284377-38f0-461a-bb83-20d29c8dd489 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:47.390373 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6284377-38f0-461a-bb83-20d29c8dd489 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:47.433637 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8473fb8-0dfd-4631-927f-8e8ece844e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:47.434256 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8473fb8-0dfd-4631-927f-8e8ece844e4c admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:47.434538 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8473fb8-0dfd-4631-927f-8e8ece844e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:47.434814 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8473fb8-0dfd-4631-927f-8e8ece844e4c admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:47.435465 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8473fb8-0dfd-4631-927f-8e8ece844e4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:47.437433 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8473fb8-0dfd-4631-927f-8e8ece844e4c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:47.471149 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 865/1724] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:11:47 2022] POST /identity/v3/users => generated 298 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:11:47.472122 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6284377-38f0-461a-bb83-20d29c8dd489 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:47.473714 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-a6284377-38f0-461a-bb83-20d29c8dd489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:47.486859 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6284377-38f0-461a-bb83-20d29c8dd489 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:47.491706 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53fa4a2-0fa6-42d1-920f-5c280ec9ed65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:47.492431 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fa4a2-0fa6-42d1-920f-5c280ec9ed65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:47.492750 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fa4a2-0fa6-42d1-920f-5c280ec9ed65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:47.492966 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fa4a2-0fa6-42d1-920f-5c280ec9ed65 admin admin] PATH_INFO: `/v3/projects/9d67a0201cd2416897b5066936e073c8` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:47.494086 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53fa4a2-0fa6-42d1-920f-5c280ec9ed65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d67a0201cd2416897b5066936e073c8)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:47.495979 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53fa4a2-0fa6-42d1-920f-5c280ec9ed65 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:47.550396 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 860/1725] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:11:47 2022] POST /identity/v3/users => generated 288 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:11:47.551224 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8473fb8-0dfd-4631-927f-8e8ece844e4c admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:47.561115 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8473fb8-0dfd-4631-927f-8e8ece844e4c admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:47.566031 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3883254-98bc-4145-8135-a72e6a1dd092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:47.566644 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3883254-98bc-4145-8135-a72e6a1dd092 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:47.566910 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3883254-98bc-4145-8135-a72e6a1dd092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:47.567188 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3883254-98bc-4145-8135-a72e6a1dd092 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:47.567844 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3883254-98bc-4145-8135-a72e6a1dd092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:47.570017 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3883254-98bc-4145-8135-a72e6a1dd092 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:47.584942 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 861/1726] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:47.584942 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3883254-98bc-4145-8135-a72e6a1dd092 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:47.593977 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3883254-98bc-4145-8135-a72e6a1dd092 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:47.598958 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0d0ef-f104-41de-b2af-924395196a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:47.599661 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0d0ef-f104-41de-b2af-924395196a45 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:47.599955 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0d0ef-f104-41de-b2af-924395196a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:47.600258 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0d0ef-f104-41de-b2af-924395196a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:47.600970 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0d0ef-f104-41de-b2af-924395196a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:47.609701 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0d0ef-f104-41de-b2af-924395196a45 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:47.619307 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 862/1727] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:47.619307 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0d0ef-f104-41de-b2af-924395196a45 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:47.627057 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0d0ef-f104-41de-b2af-924395196a45 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:47.632609 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832d383-6c94-44d9-b8be-6c50d4c0cd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:47.633271 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832d383-6c94-44d9-b8be-6c50d4c0cd03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:47.633548 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832d383-6c94-44d9-b8be-6c50d4c0cd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:47.633851 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832d383-6c94-44d9-b8be-6c50d4c0cd03 admin admin] PATH_INFO: `/v3/projects/2e525ad150b04328bd188026ba2c4456/users/d5fd671d4d184d3188a42320cd86949b/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:47.650811 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832d383-6c94-44d9-b8be-6c50d4c0cd03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e525ad150b04328bd188026ba2c4456, user_id=d5fd671d4d184d3188a42320cd86949b, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:47.653659 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832d383-6c94-44d9-b8be-6c50d4c0cd03 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:47.745264 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 863/1728] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:47 2022] PUT /identity/v3/projects/2e525ad150b04328bd188026ba2c4456/users/d5fd671d4d184d3188a42320cd86949b/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:47.748494 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832d383-6c94-44d9-b8be-6c50d4c0cd03 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:47.748665 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6832d383-6c94-44d9-b8be-6c50d4c0cd03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:47.754640 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-b53fa4a2-0fa6-42d1-920f-5c280ec9ed65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d67a0201cd2416897b5066936e073c8', 'request_id': 'req-b53fa4a2-0fa6-42d1-920f-5c280ec9ed65'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:47.817209 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832d383-6c94-44d9-b8be-6c50d4c0cd03 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:47.833926 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-b53fa4a2-0fa6-42d1-920f-5c280ec9ed65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d67a0201cd2416897b5066936e073c8', 'request_id': 'req-b53fa4a2-0fa6-42d1-920f-5c280ec9ed65'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:47.846358 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-b53fa4a2-0fa6-42d1-920f-5c280ec9ed65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d67a0201cd2416897b5066936e073c8', 'request_id': 'req-b53fa4a2-0fa6-42d1-920f-5c280ec9ed65'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:47.855681 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-b53fa4a2-0fa6-42d1-920f-5c280ec9ed65 admin admin] The token cache is being invalidate because project 9d67a0201cd2416897b5066936e073c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:11:47.856221 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-b53fa4a2-0fa6-42d1-920f-5c280ec9ed65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:47.857114 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-b53fa4a2-0fa6-42d1-920f-5c280ec9ed65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:47.859354 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 866/1729] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:11:47 2022] DELETE /identity/v3/projects/9d67a0201cd2416897b5066936e073c8 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:47.860286 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53fa4a2-0fa6-42d1-920f-5c280ec9ed65 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:47.861944 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-b53fa4a2-0fa6-42d1-920f-5c280ec9ed65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:47.891947 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce53fe-0f01-4353-9dd7-df07f45fa295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:47.893118 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce53fe-0f01-4353-9dd7-df07f45fa295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:47.893561 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce53fe-0f01-4353-9dd7-df07f45fa295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:47.893847 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce53fe-0f01-4353-9dd7-df07f45fa295 admin admin] PATH_INFO: `/v3/users/9d441e9bdf0f43509f976a5e0ab8c83b` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:47.895695 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce53fe-0f01-4353-9dd7-df07f45fa295 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d441e9bdf0f43509f976a5e0ab8c83b)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:47.897760 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce53fe-0f01-4353-9dd7-df07f45fa295 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:47.931487 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53fa4a2-0fa6-42d1-920f-5c280ec9ed65 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:47.936293 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca0210-38ff-46e2-bf4d-7b89fd2a2e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:47.936904 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca0210-38ff-46e2-bf4d-7b89fd2a2e0f admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:47.937209 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca0210-38ff-46e2-bf4d-7b89fd2a2e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:47.937484 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca0210-38ff-46e2-bf4d-7b89fd2a2e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:47.938123 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca0210-38ff-46e2-bf4d-7b89fd2a2e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:47.939756 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca0210-38ff-46e2-bf4d-7b89fd2a2e0f admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:47.950785 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 867/1730] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:47.951601 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca0210-38ff-46e2-bf4d-7b89fd2a2e0f admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:47.953307 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-16ca0210-38ff-46e2-bf4d-7b89fd2a2e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:47.965708 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca0210-38ff-46e2-bf4d-7b89fd2a2e0f admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:47.970521 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee75e6-cc93-48d6-abab-5123c244414d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:47.971183 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee75e6-cc93-48d6-abab-5123c244414d admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:47.971434 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee75e6-cc93-48d6-abab-5123c244414d admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:47.971708 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee75e6-cc93-48d6-abab-5123c244414d admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:47.972400 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee75e6-cc93-48d6-abab-5123c244414d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:47.973994 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee75e6-cc93-48d6-abab-5123c244414d admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:47.988764 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 868/1731] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:47.990035 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a49eb3-5149-4d7c-a96e-caadd251ca7a None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:47.991235 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a49eb3-5149-4d7c-a96e-caadd251ca7a None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:47.991235 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a49eb3-5149-4d7c-a96e-caadd251ca7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:48.031027 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-b0a49eb3-5149-4d7c-a96e-caadd251ca7a None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:48.031277 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-b0a49eb3-5149-4d7c-a96e-caadd251ca7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:48.041819 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 869/1732] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:48.043022 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a49eb3-5149-4d7c-a96e-caadd251ca7a None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:48.055788 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a49eb3-5149-4d7c-a96e-caadd251ca7a None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:48.062098 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2cd90b-7201-4d60-ac34-856616aa5ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:48.062797 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2cd90b-7201-4d60-ac34-856616aa5ccb admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:48.063078 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2cd90b-7201-4d60-ac34-856616aa5ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:48.063382 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2cd90b-7201-4d60-ac34-856616aa5ccb admin admin] PATH_INFO: `/v3/projects/872e834822944c058e015e6d2e9901d1/users/623f8533d7174e1c95f8eb6f42e8ccb1/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:48.081531 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2cd90b-7201-4d60-ac34-856616aa5ccb admin admin] RBAC: Authorizing `identity:create_grant(project_id=872e834822944c058e015e6d2e9901d1, user_id=623f8533d7174e1c95f8eb6f42e8ccb1, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:48.084272 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2cd90b-7201-4d60-ac34-856616aa5ccb admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:48.120704 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b1ce53fe-0f01-4353-9dd7-df07f45fa295 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d441e9bdf0f43509f976a5e0ab8c83b'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:48.251839 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 870/1733] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:48 2022] PUT /identity/v3/projects/872e834822944c058e015e6d2e9901d1/users/623f8533d7174e1c95f8eb6f42e8ccb1/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:48.256953 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2cd90b-7201-4d60-ac34-856616aa5ccb admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:48.279906 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b1ce53fe-0f01-4353-9dd7-df07f45fa295 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d441e9bdf0f43509f976a5e0ab8c83b'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:48.294820 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b1ce53fe-0f01-4353-9dd7-df07f45fa295 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d441e9bdf0f43509f976a5e0ab8c83b'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:48.302326 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b1ce53fe-0f01-4353-9dd7-df07f45fa295 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d441e9bdf0f43509f976a5e0ab8c83b'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:48.303681 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b1ce53fe-0f01-4353-9dd7-df07f45fa295 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d441e9bdf0f43509f976a5e0ab8c83b'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:48.310626 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 864/1734] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:11:47 2022] DELETE /identity/v3/users/9d441e9bdf0f43509f976a5e0ab8c83b => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:48.312169 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb057ddf-87ae-4eb0-a523-5f66e75fb33a None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:48.312542 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb057ddf-87ae-4eb0-a523-5f66e75fb33a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:48.312829 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb057ddf-87ae-4eb0-a523-5f66e75fb33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:48.331395 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2cd90b-7201-4d60-ac34-856616aa5ccb admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:48.335901 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-fb057ddf-87ae-4eb0-a523-5f66e75fb33a None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:48.337321 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-fb057ddf-87ae-4eb0-a523-5f66e75fb33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:48.402825 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 865/1735] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:48.404117 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afdd1b-29b0-4936-a1ec-d634027925e5 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:48.404404 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afdd1b-29b0-4936-a1ec-d634027925e5 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:48.404682 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afdd1b-29b0-4936-a1ec-d634027925e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:48.464521 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-c7afdd1b-29b0-4936-a1ec-d634027925e5 None None] MFA Rules not processed for user `623f8533d7174e1c95f8eb6f42e8ccb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:48.465746 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c7afdd1b-29b0-4936-a1ec-d634027925e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:48.481864 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53549b5-85d5-4e0c-8979-e4ade8b54261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:48.482606 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53549b5-85d5-4e0c-8979-e4ade8b54261 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:48.482986 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53549b5-85d5-4e0c-8979-e4ade8b54261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:48.483342 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53549b5-85d5-4e0c-8979-e4ade8b54261 admin admin] PATH_INFO: `/v3/projects/2e525ad150b04328bd188026ba2c4456/users/d5fd671d4d184d3188a42320cd86949b/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:48.485455 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53549b5-85d5-4e0c-8979-e4ade8b54261 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e525ad150b04328bd188026ba2c4456, user_id=d5fd671d4d184d3188a42320cd86949b, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:48.488689 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53549b5-85d5-4e0c-8979-e4ade8b54261 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:48.501663 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 871/1736] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:48 2022] PUT /identity/v3/projects/2e525ad150b04328bd188026ba2c4456/users/d5fd671d4d184d3188a42320cd86949b/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:48.502928 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0b505-b6ee-4259-b160-948f9ddf7b46 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:48.503247 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0b505-b6ee-4259-b160-948f9ddf7b46 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:48.503493 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0b505-b6ee-4259-b160-948f9ddf7b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:48.522888 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-d2b0b505-b6ee-4259-b160-948f9ddf7b46 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:48.524629 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-d2b0b505-b6ee-4259-b160-948f9ddf7b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:48.545644 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 866/1737] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:48.546804 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afdd1b-29b0-4936-a1ec-d634027925e5 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:48.561380 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afdd1b-29b0-4936-a1ec-d634027925e5 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:48.597390 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 872/1738] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:48.606163 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78406667-4fb2-48cc-ac9d-e770d4d609ea None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:48.606570 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78406667-4fb2-48cc-ac9d-e770d4d609ea None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:48.606811 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78406667-4fb2-48cc-ac9d-e770d4d609ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:48.625752 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0acef1-2a86-4f69-8e07-baf6fbe04fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:48.626492 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0acef1-2a86-4f69-8e07-baf6fbe04fbe admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:48.626776 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0acef1-2a86-4f69-8e07-baf6fbe04fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:48.627048 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0acef1-2a86-4f69-8e07-baf6fbe04fbe admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:48.627808 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0acef1-2a86-4f69-8e07-baf6fbe04fbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:11:48.628031 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0acef1-2a86-4f69-8e07-baf6fbe04fbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:48.629663 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0acef1-2a86-4f69-8e07-baf6fbe04fbe admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:48.638503 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-78406667-4fb2-48cc-ac9d-e770d4d609ea None None] MFA Rules not processed for user `d5fd671d4d184d3188a42320cd86949b`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:48.640202 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-78406667-4fb2-48cc-ac9d-e770d4d609ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:48.641342 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 867/1739] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:11:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:11:48.642406 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0acef1-2a86-4f69-8e07-baf6fbe04fbe admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:48.644224 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1a0acef1-2a86-4f69-8e07-baf6fbe04fbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:48.656907 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0acef1-2a86-4f69-8e07-baf6fbe04fbe admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:48.661570 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351260e7-cae4-4a6c-83b1-c825409ca691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:48.662227 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351260e7-cae4-4a6c-83b1-c825409ca691 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:48.662509 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351260e7-cae4-4a6c-83b1-c825409ca691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:48.662790 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351260e7-cae4-4a6c-83b1-c825409ca691 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:48.663422 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351260e7-cae4-4a6c-83b1-c825409ca691 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:48.665638 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351260e7-cae4-4a6c-83b1-c825409ca691 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:48.715062 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 873/1740] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:48 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:48.715906 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78406667-4fb2-48cc-ac9d-e770d4d609ea None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:48.717198 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-78406667-4fb2-48cc-ac9d-e770d4d609ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:48.791845 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78406667-4fb2-48cc-ac9d-e770d4d609ea None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:48.795679 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b833f6-03e6-4d4c-807a-c77d8e3f9554 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:48.796549 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b833f6-03e6-4d4c-807a-c77d8e3f9554 service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:48.797130 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b833f6-03e6-4d4c-807a-c77d8e3f9554 service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:48.797405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b833f6-03e6-4d4c-807a-c77d8e3f9554 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:48.806531 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 868/1741] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:11:48 2022] POST /identity/v3/projects => generated 379 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:48.806531 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351260e7-cae4-4a6c-83b1-c825409ca691 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:48.807281 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b833f6-03e6-4d4c-807a-c77d8e3f9554 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:48.808724 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b833f6-03e6-4d4c-807a-c77d8e3f9554 service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:48.819451 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 874/1742] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:48.820143 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b833f6-03e6-4d4c-807a-c77d8e3f9554 service neutron] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:48.821413 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-c2b833f6-03e6-4d4c-807a-c77d8e3f9554 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:48.853643 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:48.883103 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351260e7-cae4-4a6c-83b1-c825409ca691 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:48.888133 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8673501d-36da-46aa-a314-bd158e53329b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:48.888906 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673501d-36da-46aa-a314-bd158e53329b admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:48.889248 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673501d-36da-46aa-a314-bd158e53329b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:48.889628 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673501d-36da-46aa-a314-bd158e53329b admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:48.890192 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8673501d-36da-46aa-a314-bd158e53329b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:48.892214 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8673501d-36da-46aa-a314-bd158e53329b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:48.915382 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b833f6-03e6-4d4c-807a-c77d8e3f9554 service neutron] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:48.976370 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8a706-7a22-45da-a6f4-0fd771e6f5f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:48.976992 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8a706-7a22-45da-a6f4-0fd771e6f5f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:48.977276 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8a706-7a22-45da-a6f4-0fd771e6f5f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:48.977551 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8a706-7a22-45da-a6f4-0fd771e6f5f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:48.979329 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-bef8a706-7a22-45da-a6f4-0fd771e6f5f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:49.032928 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:49.055361 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 869/1743] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:11:48 2022] POST /identity/v3/projects => generated 375 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:49.055361 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8673501d-36da-46aa-a314-bd158e53329b admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:49.062181 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef8a706-7a22-45da-a6f4-0fd771e6f5f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:49.064018 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef8a706-7a22-45da-a6f4-0fd771e6f5f1 service cinder] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:49.087222 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 875/1744] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:49.088827 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8a706-7a22-45da-a6f4-0fd771e6f5f1 service cinder] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:49.113266 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8a706-7a22-45da-a6f4-0fd771e6f5f1 service cinder] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:49.210978 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8673501d-36da-46aa-a314-bd158e53329b admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:49.218759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9f91c-8ec1-4a61-af14-879978585f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:49.219834 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9f91c-8ec1-4a61-af14-879978585f15 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:49.220690 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9f91c-8ec1-4a61-af14-879978585f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:49.221275 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9f91c-8ec1-4a61-af14-879978585f15 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:49.222272 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9f91c-8ec1-4a61-af14-879978585f15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:49.225750 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9f91c-8ec1-4a61-af14-879978585f15 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:49.255150 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e5e36-579d-4a21-943a-d4cce8179dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:49.256369 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e5e36-579d-4a21-943a-d4cce8179dbd admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:49.256603 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e5e36-579d-4a21-943a-d4cce8179dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:49.256906 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e5e36-579d-4a21-943a-d4cce8179dbd admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:49.257586 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e5e36-579d-4a21-943a-d4cce8179dbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:49.259521 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e5e36-579d-4a21-943a-d4cce8179dbd admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:49.388449 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 870/1745] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:11:49 2022] POST /identity/v3/users => generated 290 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:49.388958 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 876/1746] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:11:49 2022] POST /identity/v3/users => generated 288 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:49.390704 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9f91c-8ec1-4a61-af14-879978585f15 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:49.390892 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e5e36-579d-4a21-943a-d4cce8179dbd admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:49.401443 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e5e36-579d-4a21-943a-d4cce8179dbd admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:49.401628 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9f91c-8ec1-4a61-af14-879978585f15 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:49.406217 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc69fd-1355-4f4a-be40-6226342fbf96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:49.406368 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe1e11-6f8b-451a-b04b-61f5cdb3b1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:49.406825 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc69fd-1355-4f4a-be40-6226342fbf96 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:49.406960 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe1e11-6f8b-451a-b04b-61f5cdb3b1e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:49.407109 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc69fd-1355-4f4a-be40-6226342fbf96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:49.407277 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe1e11-6f8b-451a-b04b-61f5cdb3b1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:49.407370 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc69fd-1355-4f4a-be40-6226342fbf96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:49.407489 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe1e11-6f8b-451a-b04b-61f5cdb3b1e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:49.408018 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc69fd-1355-4f4a-be40-6226342fbf96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:49.408284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe1e11-6f8b-451a-b04b-61f5cdb3b1e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:49.409829 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc69fd-1355-4f4a-be40-6226342fbf96 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:49.409948 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe1e11-6f8b-451a-b04b-61f5cdb3b1e6 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:49.422366 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 871/1747] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:49.422608 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 877/1748] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:11:49.424777 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe1e11-6f8b-451a-b04b-61f5cdb3b1e6 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:49.424910 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc69fd-1355-4f4a-be40-6226342fbf96 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:49.434682 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc69fd-1355-4f4a-be40-6226342fbf96 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:49.434905 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe1e11-6f8b-451a-b04b-61f5cdb3b1e6 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:49.439259 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb13b5-d080-4456-8337-42a79d65d728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:49.439410 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c06ace-a6bc-4a25-905e-ec3b059f3cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:49.439901 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb13b5-d080-4456-8337-42a79d65d728 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:49.440128 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c06ace-a6bc-4a25-905e-ec3b059f3cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:49.440260 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb13b5-d080-4456-8337-42a79d65d728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:49.440355 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c06ace-a6bc-4a25-905e-ec3b059f3cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:49.440540 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb13b5-d080-4456-8337-42a79d65d728 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:49.440634 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c06ace-a6bc-4a25-905e-ec3b059f3cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:49.441179 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb13b5-d080-4456-8337-42a79d65d728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:49.441272 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c06ace-a6bc-4a25-905e-ec3b059f3cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:49.442762 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb13b5-d080-4456-8337-42a79d65d728 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:49.442871 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c06ace-a6bc-4a25-905e-ec3b059f3cf1 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:49.453886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 878/1749] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:11:49.458905 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 872/1750] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:49.462659 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb13b5-d080-4456-8337-42a79d65d728 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:49.462791 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c06ace-a6bc-4a25-905e-ec3b059f3cf1 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:49.472985 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb13b5-d080-4456-8337-42a79d65d728 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:49.474086 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c06ace-a6bc-4a25-905e-ec3b059f3cf1 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:49.484753 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc578b-fac1-4267-a438-f2e6ddeff048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:49.485292 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc578b-fac1-4267-a438-f2e6ddeff048 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:49.485811 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc578b-fac1-4267-a438-f2e6ddeff048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:49.486104 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc578b-fac1-4267-a438-f2e6ddeff048 admin admin] PATH_INFO: `/v3/projects/44dc1945c1304de18ba90d15bcf76604/users/fb3a54a17338499eb16ad4c831c0454b/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:49.486830 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfff060-5939-499e-bcaf-41e3c3a7a9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:49.488727 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfff060-5939-499e-bcaf-41e3c3a7a9c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:49.489365 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfff060-5939-499e-bcaf-41e3c3a7a9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:49.489920 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfff060-5939-499e-bcaf-41e3c3a7a9c4 admin admin] PATH_INFO: `/v3/projects/54b3a048b9444f159546c733d40a8aa3/users/be63f9e955534110ac4b461453ee111d/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:49.505937 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fc578b-fac1-4267-a438-f2e6ddeff048 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44dc1945c1304de18ba90d15bcf76604, user_id=fb3a54a17338499eb16ad4c831c0454b, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:49.509624 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fc578b-fac1-4267-a438-f2e6ddeff048 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:49.519592 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfff060-5939-499e-bcaf-41e3c3a7a9c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54b3a048b9444f159546c733d40a8aa3, user_id=be63f9e955534110ac4b461453ee111d, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:49.523220 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfff060-5939-499e-bcaf-41e3c3a7a9c4 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:49.603222 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 873/1751] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:49 2022] PUT /identity/v3/projects/54b3a048b9444f159546c733d40a8aa3/users/be63f9e955534110ac4b461453ee111d/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:11:49.608235 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfff060-5939-499e-bcaf-41e3c3a7a9c4 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:49.608235 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-cdfff060-5939-499e-bcaf-41e3c3a7a9c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:49.611921 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 879/1752] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:49 2022] PUT /identity/v3/projects/44dc1945c1304de18ba90d15bcf76604/users/fb3a54a17338499eb16ad4c831c0454b/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:49.617029 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66a6a2-3161-4cec-9c24-4d9dc1b43caa None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:49.617310 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66a6a2-3161-4cec-9c24-4d9dc1b43caa None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:49.617597 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66a6a2-3161-4cec-9c24-4d9dc1b43caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:49.652515 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-0c66a6a2-3161-4cec-9c24-4d9dc1b43caa None None] MFA Rules not processed for user `be63f9e955534110ac4b461453ee111d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:49.653732 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-0c66a6a2-3161-4cec-9c24-4d9dc1b43caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:49.684928 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfff060-5939-499e-bcaf-41e3c3a7a9c4 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:49.690903 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3945b93-8829-4a2f-a347-d60265ed6c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:49.692164 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3945b93-8829-4a2f-a347-d60265ed6c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:49.692455 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3945b93-8829-4a2f-a347-d60265ed6c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:49.692759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3945b93-8829-4a2f-a347-d60265ed6c38 admin admin] PATH_INFO: `/v3/projects/daba4ce7a36a49148977a5dc51651257` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:49.693991 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3945b93-8829-4a2f-a347-d60265ed6c38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=daba4ce7a36a49148977a5dc51651257)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:49.696244 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3945b93-8829-4a2f-a347-d60265ed6c38 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:49.729415 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 880/1753] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:49.730850 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c676280-15cb-4893-9779-81fd69191c8e None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:49.731209 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c676280-15cb-4893-9779-81fd69191c8e None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:49.731492 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c676280-15cb-4893-9779-81fd69191c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:49.750131 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-8c676280-15cb-4893-9779-81fd69191c8e None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:49.751338 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-8c676280-15cb-4893-9779-81fd69191c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:49.759592 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 881/1754] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:49.760365 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c676280-15cb-4893-9779-81fd69191c8e None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:49.769741 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c676280-15cb-4893-9779-81fd69191c8e None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:49.774967 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bca428-2ee0-45d9-83c7-057e131de6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:49.775566 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bca428-2ee0-45d9-83c7-057e131de6b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:49.775845 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bca428-2ee0-45d9-83c7-057e131de6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:49.776166 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bca428-2ee0-45d9-83c7-057e131de6b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:49.776808 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bca428-2ee0-45d9-83c7-057e131de6b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:49.778713 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bca428-2ee0-45d9-83c7-057e131de6b7 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:49.859982 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d3945b93-8829-4a2f-a347-d60265ed6c38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daba4ce7a36a49148977a5dc51651257', 'request_id': 'req-d3945b93-8829-4a2f-a347-d60265ed6c38'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:49.866325 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d3945b93-8829-4a2f-a347-d60265ed6c38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daba4ce7a36a49148977a5dc51651257', 'request_id': 'req-d3945b93-8829-4a2f-a347-d60265ed6c38'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:49.914514 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 882/1755] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:11:49 2022] POST /identity/v3/projects => generated 379 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:49.914514 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bca428-2ee0-45d9-83c7-057e131de6b7 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:49.916181 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-18bca428-2ee0-45d9-83c7-057e131de6b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:49.985123 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bca428-2ee0-45d9-83c7-057e131de6b7 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:49.988930 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97c142-d5b6-478c-93b3-626b2da54a9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:49.989637 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97c142-d5b6-478c-93b3-626b2da54a9d service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:49.989929 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97c142-d5b6-478c-93b3-626b2da54a9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:49.990223 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97c142-d5b6-478c-93b3-626b2da54a9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:50.001928 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d3945b93-8829-4a2f-a347-d60265ed6c38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daba4ce7a36a49148977a5dc51651257', 'request_id': 'req-d3945b93-8829-4a2f-a347-d60265ed6c38'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:50.015324 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d3945b93-8829-4a2f-a347-d60265ed6c38 admin admin] The token cache is being invalidate because project daba4ce7a36a49148977a5dc51651257 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:11:50.015715 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d3945b93-8829-4a2f-a347-d60265ed6c38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:50.016479 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d3945b93-8829-4a2f-a347-d60265ed6c38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:50.020949 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 874/1756] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:11:49 2022] DELETE /identity/v3/projects/daba4ce7a36a49148977a5dc51651257 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:50.020949 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3945b93-8829-4a2f-a347-d60265ed6c38 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:50.021404 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d3945b93-8829-4a2f-a347-d60265ed6c38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:50.056313 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97c142-d5b6-478c-93b3-626b2da54a9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:50.060814 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97c142-d5b6-478c-93b3-626b2da54a9d service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:50.073869 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 883/1757] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:50.074712 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97c142-d5b6-478c-93b3-626b2da54a9d service neutron] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:50.084650 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97c142-d5b6-478c-93b3-626b2da54a9d service neutron] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:50.089742 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83413da4-77d2-43ef-959f-c3ce1776599a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:50.090572 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83413da4-77d2-43ef-959f-c3ce1776599a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:50.090924 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83413da4-77d2-43ef-959f-c3ce1776599a admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:50.091287 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83413da4-77d2-43ef-959f-c3ce1776599a admin admin] PATH_INFO: `/v3/users/20a838d274284e3eaf1cfb7a410fa61a` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:50.092534 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83413da4-77d2-43ef-959f-c3ce1776599a admin admin] RBAC: Authorizing `identity:delete_user(user_id=20a838d274284e3eaf1cfb7a410fa61a)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:50.097866 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83413da4-77d2-43ef-959f-c3ce1776599a admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:50.098992 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3945b93-8829-4a2f-a347-d60265ed6c38 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:50.104850 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda5c68-f090-4674-8074-c4cb6cad764f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:50.105467 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda5c68-f090-4674-8074-c4cb6cad764f admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:50.105764 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda5c68-f090-4674-8074-c4cb6cad764f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:50.106024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda5c68-f090-4674-8074-c4cb6cad764f admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:50.106659 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda5c68-f090-4674-8074-c4cb6cad764f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:50.108626 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda5c68-f090-4674-8074-c4cb6cad764f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:50.252079 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 875/1758] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:11:50 2022] POST /identity/v3/users => generated 296 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:50.256218 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda5c68-f090-4674-8074-c4cb6cad764f admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:50.266958 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda5c68-f090-4674-8074-c4cb6cad764f admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:50.272428 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50922d2a-14ff-4487-a3ef-716a55a1c374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:50.273142 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50922d2a-14ff-4487-a3ef-716a55a1c374 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:50.273509 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50922d2a-14ff-4487-a3ef-716a55a1c374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:50.273858 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50922d2a-14ff-4487-a3ef-716a55a1c374 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:50.274614 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50922d2a-14ff-4487-a3ef-716a55a1c374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:50.277557 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50922d2a-14ff-4487-a3ef-716a55a1c374 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:50.289284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 876/1759] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:11:50.293350 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50922d2a-14ff-4487-a3ef-716a55a1c374 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:50.303603 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50922d2a-14ff-4487-a3ef-716a55a1c374 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:50.310204 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc75688-f60e-45b7-98c8-3e2e6b40ab08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:50.311194 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc75688-f60e-45b7-98c8-3e2e6b40ab08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:50.311413 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc75688-f60e-45b7-98c8-3e2e6b40ab08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:50.311503 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc75688-f60e-45b7-98c8-3e2e6b40ab08 admin admin] PATH_INFO: `/v3/projects/eed611876e89452fbc75ce364c9bff16/users/c8c9cf58a4cc47a0bfc3cd36724f6944/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:50.340539 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc75688-f60e-45b7-98c8-3e2e6b40ab08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eed611876e89452fbc75ce364c9bff16, user_id=c8c9cf58a4cc47a0bfc3cd36724f6944, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:50.345833 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc75688-f60e-45b7-98c8-3e2e6b40ab08 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:50.416451 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-83413da4-77d2-43ef-959f-c3ce1776599a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20a838d274284e3eaf1cfb7a410fa61a'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:50.440198 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 877/1760] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:50 2022] PUT /identity/v3/projects/eed611876e89452fbc75ce364c9bff16/users/c8c9cf58a4cc47a0bfc3cd36724f6944/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:11:50.446117 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc75688-f60e-45b7-98c8-3e2e6b40ab08 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:50.523788 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc75688-f60e-45b7-98c8-3e2e6b40ab08 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:50.530173 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-83413da4-77d2-43ef-959f-c3ce1776599a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20a838d274284e3eaf1cfb7a410fa61a'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:50.531789 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca4777-1161-4258-a7bb-28bd18033198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:50.534734 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca4777-1161-4258-a7bb-28bd18033198 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:50.534734 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca4777-1161-4258-a7bb-28bd18033198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:50.534734 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca4777-1161-4258-a7bb-28bd18033198 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:50.535596 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ca4777-1161-4258-a7bb-28bd18033198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:50.537963 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ca4777-1161-4258-a7bb-28bd18033198 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:50.543710 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-83413da4-77d2-43ef-959f-c3ce1776599a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20a838d274284e3eaf1cfb7a410fa61a'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:50.544621 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-83413da4-77d2-43ef-959f-c3ce1776599a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20a838d274284e3eaf1cfb7a410fa61a'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:50.549244 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 878/1761] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:50.551936 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-83413da4-77d2-43ef-959f-c3ce1776599a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20a838d274284e3eaf1cfb7a410fa61a'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:50.553917 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca4777-1161-4258-a7bb-28bd18033198 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:50.555786 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e6ca4777-1161-4258-a7bb-28bd18033198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:50.561380 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 884/1762] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:11:50 2022] DELETE /identity/v3/users/20a838d274284e3eaf1cfb7a410fa61a => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:50.572010 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca4777-1161-4258-a7bb-28bd18033198 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:50.589952 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83413da4-77d2-43ef-959f-c3ce1776599a admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:50.591981 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-83413da4-77d2-43ef-959f-c3ce1776599a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:50.639139 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c8038-7a44-47af-a899-49e4c7f71b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:50.639841 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c8038-7a44-47af-a899-49e4c7f71b70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:50.640252 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c8038-7a44-47af-a899-49e4c7f71b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:50.640435 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c8038-7a44-47af-a899-49e4c7f71b70 admin admin] PATH_INFO: `/v3/projects/eed611876e89452fbc75ce364c9bff16/users/c8c9cf58a4cc47a0bfc3cd36724f6944/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:50.642660 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6c8038-7a44-47af-a899-49e4c7f71b70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eed611876e89452fbc75ce364c9bff16, user_id=c8c9cf58a4cc47a0bfc3cd36724f6944, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:50.647104 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6c8038-7a44-47af-a899-49e4c7f71b70 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:50.663633 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 879/1763] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:50 2022] PUT /identity/v3/projects/eed611876e89452fbc75ce364c9bff16/users/c8c9cf58a4cc47a0bfc3cd36724f6944/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:11:50.674028 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d651b-a555-4d19-81a5-4235852f5aa1 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:50.674323 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d651b-a555-4d19-81a5-4235852f5aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:50.674604 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d651b-a555-4d19-81a5-4235852f5aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:50.713483 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83413da4-77d2-43ef-959f-c3ce1776599a admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:50.721393 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-bb0d651b-a555-4d19-81a5-4235852f5aa1 None None] MFA Rules not processed for user `c8c9cf58a4cc47a0bfc3cd36724f6944`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:50.722711 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-bb0d651b-a555-4d19-81a5-4235852f5aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:50.781694 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbee367-cf27-4bab-ab3c-10d35eb29851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:50.782197 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbee367-cf27-4bab-ab3c-10d35eb29851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:50.782485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbee367-cf27-4bab-ab3c-10d35eb29851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:50.782875 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbee367-cf27-4bab-ab3c-10d35eb29851 admin admin] PATH_INFO: `/v3/users/7b905ab2ee71495ba7055e32299d3b45` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:50.784761 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbee367-cf27-4bab-ab3c-10d35eb29851 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b905ab2ee71495ba7055e32299d3b45)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:50.787664 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbee367-cf27-4bab-ab3c-10d35eb29851 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:50.810206 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 880/1764] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:50 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:11:50.825084 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d651b-a555-4d19-81a5-4235852f5aa1 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:50.826880 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-bb0d651b-a555-4d19-81a5-4235852f5aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:50.897439 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d651b-a555-4d19-81a5-4235852f5aa1 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:50.901358 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b35570-57a9-4ec8-9c7c-9b07d2ed0ac8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:50.901980 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b35570-57a9-4ec8-9c7c-9b07d2ed0ac8 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:50.902260 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b35570-57a9-4ec8-9c7c-9b07d2ed0ac8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:50.902537 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b35570-57a9-4ec8-9c7c-9b07d2ed0ac8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:50.913212 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b35570-57a9-4ec8-9c7c-9b07d2ed0ac8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:50.915191 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b35570-57a9-4ec8-9c7c-9b07d2ed0ac8 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:50.918588 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:50.936568 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 881/1765] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:50 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:51.066760 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-dfbee367-cf27-4bab-ab3c-10d35eb29851 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b905ab2ee71495ba7055e32299d3b45'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:51.072881 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b35570-57a9-4ec8-9c7c-9b07d2ed0ac8 service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:51.081535 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b35570-57a9-4ec8-9c7c-9b07d2ed0ac8 service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:51.086680 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa6f7d-13ed-48a2-a7a0-3f35453739c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:51.087305 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa6f7d-13ed-48a2-a7a0-3f35453739c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:51.087590 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa6f7d-13ed-48a2-a7a0-3f35453739c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:51.087870 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa6f7d-13ed-48a2-a7a0-3f35453739c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:51.090230 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-49aa6f7d-13ed-48a2-a7a0-3f35453739c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:51.182741 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-dfbee367-cf27-4bab-ab3c-10d35eb29851 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b905ab2ee71495ba7055e32299d3b45'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:51.195747 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-dfbee367-cf27-4bab-ab3c-10d35eb29851 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b905ab2ee71495ba7055e32299d3b45'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:51.196394 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-dfbee367-cf27-4bab-ab3c-10d35eb29851 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b905ab2ee71495ba7055e32299d3b45'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:51.202536 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa6f7d-13ed-48a2-a7a0-3f35453739c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:51.203326 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-dfbee367-cf27-4bab-ab3c-10d35eb29851 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b905ab2ee71495ba7055e32299d3b45'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:51.204045 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa6f7d-13ed-48a2-a7a0-3f35453739c3 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:51.210189 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 885/1766] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:11:50 2022] DELETE /identity/v3/users/7b905ab2ee71495ba7055e32299d3b45 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:11:51.211131 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbee367-cf27-4bab-ab3c-10d35eb29851 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:51.212490 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-dfbee367-cf27-4bab-ab3c-10d35eb29851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:51.217711 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 882/1767] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:51.219457 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181c972-1106-4774-bd32-54db6f7c77cd None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:51.219746 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181c972-1106-4774-bd32-54db6f7c77cd None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:51.220229 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181c972-1106-4774-bd32-54db6f7c77cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:51.243748 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-d181c972-1106-4774-bd32-54db6f7c77cd None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:51.245114 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d181c972-1106-4774-bd32-54db6f7c77cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:51.378592 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 883/1768] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:51.385079 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbee367-cf27-4bab-ab3c-10d35eb29851 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:51.390312 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181c972-1106-4774-bd32-54db6f7c77cd None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:51.392024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d181c972-1106-4774-bd32-54db6f7c77cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:51.393191 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da6cf7-ec4c-4d23-ac8f-8a1b21a2c6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:51.394738 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da6cf7-ec4c-4d23-ac8f-8a1b21a2c6f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:51.395447 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da6cf7-ec4c-4d23-ac8f-8a1b21a2c6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:51.395956 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da6cf7-ec4c-4d23-ac8f-8a1b21a2c6f6 admin admin] PATH_INFO: `/v3/projects/d1790f80b4ec4c98a525fa350953c58d` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:51.398123 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da6cf7-ec4c-4d23-ac8f-8a1b21a2c6f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1790f80b4ec4c98a525fa350953c58d)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:51.400290 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da6cf7-ec4c-4d23-ac8f-8a1b21a2c6f6 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:51.479487 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181c972-1106-4774-bd32-54db6f7c77cd None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:51.484919 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd7036-ca4f-4f77-b770-6e214000bd88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:51.485770 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd7036-ca4f-4f77-b770-6e214000bd88 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:51.486162 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd7036-ca4f-4f77-b770-6e214000bd88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:51.486813 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd7036-ca4f-4f77-b770-6e214000bd88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:51.504304 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd7036-ca4f-4f77-b770-6e214000bd88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:51.506435 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd7036-ca4f-4f77-b770-6e214000bd88 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:51.517795 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 884/1769] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:11:51.518695 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd7036-ca4f-4f77-b770-6e214000bd88 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:51.520224 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-05fd7036-ca4f-4f77-b770-6e214000bd88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:51.620729 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-d2da6cf7-ec4c-4d23-ac8f-8a1b21a2c6f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1790f80b4ec4c98a525fa350953c58d', 'request_id': 'req-d2da6cf7-ec4c-4d23-ac8f-8a1b21a2c6f6'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:51.623352 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd7036-ca4f-4f77-b770-6e214000bd88 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:51.713437 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239e3c2-5006-4c6d-b22e-eddb59053f18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:51.714066 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239e3c2-5006-4c6d-b22e-eddb59053f18 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:51.714408 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239e3c2-5006-4c6d-b22e-eddb59053f18 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:51.714687 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239e3c2-5006-4c6d-b22e-eddb59053f18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:51.716632 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a239e3c2-5006-4c6d-b22e-eddb59053f18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:51.734140 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-d2da6cf7-ec4c-4d23-ac8f-8a1b21a2c6f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1790f80b4ec4c98a525fa350953c58d', 'request_id': 'req-d2da6cf7-ec4c-4d23-ac8f-8a1b21a2c6f6'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:51.750971 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-d2da6cf7-ec4c-4d23-ac8f-8a1b21a2c6f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1790f80b4ec4c98a525fa350953c58d', 'request_id': 'req-d2da6cf7-ec4c-4d23-ac8f-8a1b21a2c6f6'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:51.783839 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-d2da6cf7-ec4c-4d23-ac8f-8a1b21a2c6f6 admin admin] The token cache is being invalidate because project d1790f80b4ec4c98a525fa350953c58d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:11:51.784615 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-d2da6cf7-ec4c-4d23-ac8f-8a1b21a2c6f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:51.785882 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-d2da6cf7-ec4c-4d23-ac8f-8a1b21a2c6f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:51.795617 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 886/1770] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:11:51 2022] DELETE /identity/v3/projects/d1790f80b4ec4c98a525fa350953c58d => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:51.797166 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4c6ef-d890-4134-bec0-08a75ee2e05e None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:51.797476 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4c6ef-d890-4134-bec0-08a75ee2e05e None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:51.798284 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4c6ef-d890-4134-bec0-08a75ee2e05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:51.824362 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-39d4c6ef-d890-4134-bec0-08a75ee2e05e None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:51.826705 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-39d4c6ef-d890-4134-bec0-08a75ee2e05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:51.836694 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a239e3c2-5006-4c6d-b22e-eddb59053f18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:51.838965 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a239e3c2-5006-4c6d-b22e-eddb59053f18 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:51.854647 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 885/1771] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:51.956394 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 887/1772] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:51.956731 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4af49-c04f-4976-86dc-f92d87ed6c62 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:51.956731 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4af49-c04f-4976-86dc-f92d87ed6c62 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:51.956731 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4af49-c04f-4976-86dc-f92d87ed6c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:51.963513 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:51.979507 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-1cd4af49-c04f-4976-86dc-f92d87ed6c62 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:51.981273 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1cd4af49-c04f-4976-86dc-f92d87ed6c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:51.995079 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 886/1773] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:11:52.002031 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4c6ef-d890-4134-bec0-08a75ee2e05e None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:52.006983 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4c6ef-d890-4134-bec0-08a75ee2e05e None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:52.012426 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc119871-bfba-4726-8ff8-fce63a4e6de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:52.013060 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc119871-bfba-4726-8ff8-fce63a4e6de7 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:52.013398 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc119871-bfba-4726-8ff8-fce63a4e6de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:52.013725 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc119871-bfba-4726-8ff8-fce63a4e6de7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:52.014361 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc119871-bfba-4726-8ff8-fce63a4e6de7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:11:52.015067 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc119871-bfba-4726-8ff8-fce63a4e6de7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:52.016374 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc119871-bfba-4726-8ff8-fce63a4e6de7 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:52.031443 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 888/1774] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:11:52.035683 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4af49-c04f-4976-86dc-f92d87ed6c62 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:52.047088 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4af49-c04f-4976-86dc-f92d87ed6c62 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:52.052370 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5288e-5556-4c26-af2e-c897f1d21687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:52.054004 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5288e-5556-4c26-af2e-c897f1d21687 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:52.054004 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5288e-5556-4c26-af2e-c897f1d21687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:52.054243 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5288e-5556-4c26-af2e-c897f1d21687 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:52.054950 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d5288e-5556-4c26-af2e-c897f1d21687 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:52.057008 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d5288e-5556-4c26-af2e-c897f1d21687 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:52.325576 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc119871-bfba-4726-8ff8-fce63a4e6de7 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:52.327636 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-dc119871-bfba-4726-8ff8-fce63a4e6de7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:52.347813 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 887/1775] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:11:52 2022] POST /identity/v3/projects => generated 379 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:52.352099 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5288e-5556-4c26-af2e-c897f1d21687 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:52.356956 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc119871-bfba-4726-8ff8-fce63a4e6de7 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:52.425656 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41194783-d55b-4ae4-aa17-ef0612e0b07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:52.426313 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41194783-d55b-4ae4-aa17-ef0612e0b07f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:52.426595 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41194783-d55b-4ae4-aa17-ef0612e0b07f admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:52.426883 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41194783-d55b-4ae4-aa17-ef0612e0b07f admin admin] PATH_INFO: `/v3/projects/c7937e7812444ca6a5ed22476e5e6a4c` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:52.428158 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41194783-d55b-4ae4-aa17-ef0612e0b07f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7937e7812444ca6a5ed22476e5e6a4c)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:52.430146 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41194783-d55b-4ae4-aa17-ef0612e0b07f admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:52.434483 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5288e-5556-4c26-af2e-c897f1d21687 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:52.441981 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02fb48-b712-41f2-8543-8b429a0deaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:52.443668 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02fb48-b712-41f2-8543-8b429a0deaa4 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:52.444103 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02fb48-b712-41f2-8543-8b429a0deaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:52.444873 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02fb48-b712-41f2-8543-8b429a0deaa4 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:52.450149 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02fb48-b712-41f2-8543-8b429a0deaa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:52.450779 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02fb48-b712-41f2-8543-8b429a0deaa4 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:52.558436 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 888/1776] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:11:52 2022] POST /identity/v3/users => generated 290 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:11:52.571505 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02fb48-b712-41f2-8543-8b429a0deaa4 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:52.585862 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02fb48-b712-41f2-8543-8b429a0deaa4 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:52.607423 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-41194783-d55b-4ae4-aa17-ef0612e0b07f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7937e7812444ca6a5ed22476e5e6a4c', 'request_id': 'req-41194783-d55b-4ae4-aa17-ef0612e0b07f'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:52.691011 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-41194783-d55b-4ae4-aa17-ef0612e0b07f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7937e7812444ca6a5ed22476e5e6a4c', 'request_id': 'req-41194783-d55b-4ae4-aa17-ef0612e0b07f'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:52.700972 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-41194783-d55b-4ae4-aa17-ef0612e0b07f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7937e7812444ca6a5ed22476e5e6a4c', 'request_id': 'req-41194783-d55b-4ae4-aa17-ef0612e0b07f'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:52.724252 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c41bfb-8be6-4d06-8a61-4e85226c4f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:52.726479 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c41bfb-8be6-4d06-8a61-4e85226c4f8e admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:52.727024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c41bfb-8be6-4d06-8a61-4e85226c4f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:52.727831 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c41bfb-8be6-4d06-8a61-4e85226c4f8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:52.728254 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c41bfb-8be6-4d06-8a61-4e85226c4f8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:52.730829 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c41bfb-8be6-4d06-8a61-4e85226c4f8e admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:52.731498 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-41194783-d55b-4ae4-aa17-ef0612e0b07f admin admin] The token cache is being invalidate because project c7937e7812444ca6a5ed22476e5e6a4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:11:52.732916 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-41194783-d55b-4ae4-aa17-ef0612e0b07f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:52.734275 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-41194783-d55b-4ae4-aa17-ef0612e0b07f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:52.738170 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 889/1777] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:11:52 2022] DELETE /identity/v3/projects/c7937e7812444ca6a5ed22476e5e6a4c => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:11:52.743752 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23c99e-fef4-4911-9595-be662848f726 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:52.744041 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23c99e-fef4-4911-9595-be662848f726 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:52.744338 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23c99e-fef4-4911-9595-be662848f726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:52.750966 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 889/1778] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:52.757110 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c41bfb-8be6-4d06-8a61-4e85226c4f8e admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:52.761215 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e8c41bfb-8be6-4d06-8a61-4e85226c4f8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:52.769153 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-ef23c99e-fef4-4911-9595-be662848f726 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:52.770378 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-ef23c99e-fef4-4911-9595-be662848f726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:52.780277 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 890/1779] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:52.782970 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c41bfb-8be6-4d06-8a61-4e85226c4f8e admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:52.790486 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db072a-8fc2-4466-837d-87cf02ffbe7f None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:52.792909 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db072a-8fc2-4466-837d-87cf02ffbe7f None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:52.793250 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db072a-8fc2-4466-837d-87cf02ffbe7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:52.797284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdcff4d-a29f-4a86-9628-631ad35fd14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:52.798315 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdcff4d-a29f-4a86-9628-631ad35fd14d admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:52.798612 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdcff4d-a29f-4a86-9628-631ad35fd14d admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:52.798887 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdcff4d-a29f-4a86-9628-631ad35fd14d admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:52.801060 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdcff4d-a29f-4a86-9628-631ad35fd14d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:52.802692 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdcff4d-a29f-4a86-9628-631ad35fd14d admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:52.828709 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 890/1780] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:11:52.829283 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-d5db072a-8fc2-4466-837d-87cf02ffbe7f None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:52.830392 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdcff4d-a29f-4a86-9628-631ad35fd14d admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:52.832700 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-d5db072a-8fc2-4466-837d-87cf02ffbe7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:52.851158 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdcff4d-a29f-4a86-9628-631ad35fd14d admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:52.857067 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512796ad-af29-4318-a23a-b9f161180c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:52.858116 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512796ad-af29-4318-a23a-b9f161180c6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:52.858659 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512796ad-af29-4318-a23a-b9f161180c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:52.859199 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512796ad-af29-4318-a23a-b9f161180c6a admin admin] PATH_INFO: `/v3/projects/68b47312172b4f879156c12cb646780f/users/11ba5c4b0ffe4351a4fad042d62023a3/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:52.861384 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 891/1781] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:52.867767 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db072a-8fc2-4466-837d-87cf02ffbe7f None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:52.878630 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512796ad-af29-4318-a23a-b9f161180c6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=68b47312172b4f879156c12cb646780f, user_id=11ba5c4b0ffe4351a4fad042d62023a3, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:52.881501 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512796ad-af29-4318-a23a-b9f161180c6a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:52.882105 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db072a-8fc2-4466-837d-87cf02ffbe7f None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:52.890222 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203d575-defe-480a-bd97-86078c778347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:52.890222 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203d575-defe-480a-bd97-86078c778347 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:52.890222 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203d575-defe-480a-bd97-86078c778347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:52.890222 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203d575-defe-480a-bd97-86078c778347 admin admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:52.890655 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2203d575-defe-480a-bd97-86078c778347 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:11:52.890655 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2203d575-defe-480a-bd97-86078c778347 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:52.891790 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2203d575-defe-480a-bd97-86078c778347 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:52.905482 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 892/1782] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 11:11:52.909803 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203d575-defe-480a-bd97-86078c778347 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:52.921479 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203d575-defe-480a-bd97-86078c778347 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:52.926627 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216d7a9-015b-4761-b004-a3dea129cc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:52.927266 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216d7a9-015b-4761-b004-a3dea129cc2b admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:52.927553 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216d7a9-015b-4761-b004-a3dea129cc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:52.927884 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216d7a9-015b-4761-b004-a3dea129cc2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:52.929343 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216d7a9-015b-4761-b004-a3dea129cc2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:52.932980 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216d7a9-015b-4761-b004-a3dea129cc2b admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:52.980174 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 891/1783] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:52 2022] PUT /identity/v3/projects/68b47312172b4f879156c12cb646780f/users/11ba5c4b0ffe4351a4fad042d62023a3/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:52.995560 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ff960-5022-4e14-98e0-e65adbaabf6f None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:52.995560 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ff960-5022-4e14-98e0-e65adbaabf6f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:52.997842 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ff960-5022-4e14-98e0-e65adbaabf6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:53.028634 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 893/1784] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:11:52 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:11:53.033103 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216d7a9-015b-4761-b004-a3dea129cc2b admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:53.035588 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-507ff960-5022-4e14-98e0-e65adbaabf6f None None] MFA Rules not processed for user `11ba5c4b0ffe4351a4fad042d62023a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:53.036932 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-507ff960-5022-4e14-98e0-e65adbaabf6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:53.150520 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 892/1785] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:53.156495 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ff960-5022-4e14-98e0-e65adbaabf6f None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:53.165956 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:53.194711 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216d7a9-015b-4761-b004-a3dea129cc2b admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:53.203172 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234a913-8766-4b14-a2c2-e93de82650f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:53.206353 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234a913-8766-4b14-a2c2-e93de82650f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:53.206353 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234a913-8766-4b14-a2c2-e93de82650f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:53.206353 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234a913-8766-4b14-a2c2-e93de82650f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:53.206353 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2234a913-8766-4b14-a2c2-e93de82650f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:53.207998 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2234a913-8766-4b14-a2c2-e93de82650f2 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:53.288168 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ff960-5022-4e14-98e0-e65adbaabf6f None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:53.294937 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7a2b0-9d29-46a9-87c8-59673983c61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:53.295763 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7a2b0-9d29-46a9-87c8-59673983c61d admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:53.296124 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7a2b0-9d29-46a9-87c8-59673983c61d admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:53.296446 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7a2b0-9d29-46a9-87c8-59673983c61d admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:53.298018 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7a2b0-9d29-46a9-87c8-59673983c61d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:53.301065 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7a2b0-9d29-46a9-87c8-59673983c61d admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:53.385997 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 894/1786] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:11:53 2022] POST /identity/v3/users => generated 288 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:11:53.389761 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234a913-8766-4b14-a2c2-e93de82650f2 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:53.401130 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234a913-8766-4b14-a2c2-e93de82650f2 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:53.406205 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be051c3-62af-47fd-ad60-76fb14694c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:53.406816 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be051c3-62af-47fd-ad60-76fb14694c06 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:53.407116 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be051c3-62af-47fd-ad60-76fb14694c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:53.407434 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be051c3-62af-47fd-ad60-76fb14694c06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:53.408123 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be051c3-62af-47fd-ad60-76fb14694c06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:53.410042 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be051c3-62af-47fd-ad60-76fb14694c06 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:53.422851 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 895/1787] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:11:53.427295 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be051c3-62af-47fd-ad60-76fb14694c06 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:53.439199 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be051c3-62af-47fd-ad60-76fb14694c06 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:53.444991 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e74b3c-2699-460e-97d6-2d4ac9c1085b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:53.445846 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e74b3c-2699-460e-97d6-2d4ac9c1085b admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:53.446868 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e74b3c-2699-460e-97d6-2d4ac9c1085b admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:53.446868 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e74b3c-2699-460e-97d6-2d4ac9c1085b admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:53.447277 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e74b3c-2699-460e-97d6-2d4ac9c1085b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:53.448914 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e74b3c-2699-460e-97d6-2d4ac9c1085b admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:53.459931 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 896/1788] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:11:53.464227 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e74b3c-2699-460e-97d6-2d4ac9c1085b admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:53.474502 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e74b3c-2699-460e-97d6-2d4ac9c1085b admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:53.477984 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 893/1789] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:11:53 2022] POST /identity/v3/projects => generated 377 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:53.480613 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca7682-01bd-427d-b09b-0a1e0e4660ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:53.481302 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca7682-01bd-427d-b09b-0a1e0e4660ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:53.484295 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca7682-01bd-427d-b09b-0a1e0e4660ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:53.484295 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca7682-01bd-427d-b09b-0a1e0e4660ec admin admin] PATH_INFO: `/v3/projects/de6b681e891d48b087dfb9ff162ec967/users/a4861b40c12b485f8c3decca427bdcd8/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:53.487182 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7a2b0-9d29-46a9-87c8-59673983c61d admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:53.507756 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fca7682-01bd-427d-b09b-0a1e0e4660ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=de6b681e891d48b087dfb9ff162ec967, user_id=a4861b40c12b485f8c3decca427bdcd8, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:53.510861 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fca7682-01bd-427d-b09b-0a1e0e4660ec admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:53.561616 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7a2b0-9d29-46a9-87c8-59673983c61d admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:53.567701 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e5e56-ca11-46c4-b60c-11b2ab3f1944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:53.569009 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e5e56-ca11-46c4-b60c-11b2ab3f1944 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:53.569320 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e5e56-ca11-46c4-b60c-11b2ab3f1944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:53.569576 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e5e56-ca11-46c4-b60c-11b2ab3f1944 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:53.574105 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36e5e56-ca11-46c4-b60c-11b2ab3f1944 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:53.574105 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36e5e56-ca11-46c4-b60c-11b2ab3f1944 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:53.636112 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 897/1790] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:53 2022] PUT /identity/v3/projects/de6b681e891d48b087dfb9ff162ec967/users/a4861b40c12b485f8c3decca427bdcd8/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:11:53.642587 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d36b7-e1d0-4319-a3a3-81714da3ee4e None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:53.643407 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d36b7-e1d0-4319-a3a3-81714da3ee4e None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:53.644122 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d36b7-e1d0-4319-a3a3-81714da3ee4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:53.700105 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 894/1791] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:11:53 2022] POST /identity/v3/users => generated 295 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:11:53.704539 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-845d36b7-e1d0-4319-a3a3-81714da3ee4e None None] MFA Rules not processed for user `a4861b40c12b485f8c3decca427bdcd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:53.706595 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-845d36b7-e1d0-4319-a3a3-81714da3ee4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:53.709977 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e5e56-ca11-46c4-b60c-11b2ab3f1944 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:53.749561 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e5e56-ca11-46c4-b60c-11b2ab3f1944 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:53.831266 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 898/1792] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:53.836115 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d36b7-e1d0-4319-a3a3-81714da3ee4e None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:53.890580 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db48f55-1b51-4017-aad3-5fa82f7cf2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:53.891225 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db48f55-1b51-4017-aad3-5fa82f7cf2c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:53.891512 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db48f55-1b51-4017-aad3-5fa82f7cf2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:53.891791 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db48f55-1b51-4017-aad3-5fa82f7cf2c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:53.892491 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db48f55-1b51-4017-aad3-5fa82f7cf2c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:53.894123 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db48f55-1b51-4017-aad3-5fa82f7cf2c3 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:53.898020 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:53.914667 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 895/1793] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:11:53.918661 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db48f55-1b51-4017-aad3-5fa82f7cf2c3 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:53.931449 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db48f55-1b51-4017-aad3-5fa82f7cf2c3 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:53.937724 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d36b7-e1d0-4319-a3a3-81714da3ee4e None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:53.939274 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4d867-d017-4a88-935d-3d7d8ff09b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:53.940598 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4d867-d017-4a88-935d-3d7d8ff09b92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:53.941107 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4d867-d017-4a88-935d-3d7d8ff09b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:53.941770 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4d867-d017-4a88-935d-3d7d8ff09b92 admin admin] PATH_INFO: `/v3/projects/d8a59394bab94ed59ca9bd43390bd3ca/users/437b60c02fe24c2982e64bb8c057bd09/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:53.943983 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e8b0d-8453-4181-a7c2-f97a6a5fd085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:53.944764 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e8b0d-8453-4181-a7c2-f97a6a5fd085 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:53.945198 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e8b0d-8453-4181-a7c2-f97a6a5fd085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:53.945586 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e8b0d-8453-4181-a7c2-f97a6a5fd085 admin admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:53.946327 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e8b0d-8453-4181-a7c2-f97a6a5fd085 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:53.948542 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e8b0d-8453-4181-a7c2-f97a6a5fd085 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:53.961122 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4d867-d017-4a88-935d-3d7d8ff09b92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8a59394bab94ed59ca9bd43390bd3ca, user_id=437b60c02fe24c2982e64bb8c057bd09, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:53.964511 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4d867-d017-4a88-935d-3d7d8ff09b92 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:54.065951 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 896/1794] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:53 2022] PUT /identity/v3/projects/d8a59394bab94ed59ca9bd43390bd3ca/users/437b60c02fe24c2982e64bb8c057bd09/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:11:54.072186 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 899/1795] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:11:53 2022] POST /identity/v3/projects => generated 375 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:54.075218 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4d867-d017-4a88-935d-3d7d8ff09b92 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:54.078918 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e8b0d-8453-4181-a7c2-f97a6a5fd085 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:54.180931 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4d867-d017-4a88-935d-3d7d8ff09b92 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:54.187614 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e8b0d-8453-4181-a7c2-f97a6a5fd085 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:54.192283 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa7cf19-421d-4971-b214-1e92bb95ccb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:54.193526 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63c23e-9d55-430b-bd2e-cecc37827209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:54.194503 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63c23e-9d55-430b-bd2e-cecc37827209 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:54.194650 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63c23e-9d55-430b-bd2e-cecc37827209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:54.196285 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63c23e-9d55-430b-bd2e-cecc37827209 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:54.196415 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7cf19-421d-4971-b214-1e92bb95ccb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:54.196415 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7cf19-421d-4971-b214-1e92bb95ccb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:54.196579 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad63c23e-9d55-430b-bd2e-cecc37827209 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:54.196680 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7cf19-421d-4971-b214-1e92bb95ccb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:54.197899 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad63c23e-9d55-430b-bd2e-cecc37827209 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:54.198576 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa7cf19-421d-4971-b214-1e92bb95ccb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:54.202218 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa7cf19-421d-4971-b214-1e92bb95ccb4 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:54.222482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 897/1796] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:54.223721 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa7cf19-421d-4971-b214-1e92bb95ccb4 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:54.226055 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4fa7cf19-421d-4971-b214-1e92bb95ccb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:54.294182 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa7cf19-421d-4971-b214-1e92bb95ccb4 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:54.298728 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc358cc6-e5af-4b73-a903-69d614f72a6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:54.299458 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc358cc6-e5af-4b73-a903-69d614f72a6c service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:54.299937 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc358cc6-e5af-4b73-a903-69d614f72a6c service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:54.300252 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc358cc6-e5af-4b73-a903-69d614f72a6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:54.302238 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-bc358cc6-e5af-4b73-a903-69d614f72a6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:54.345912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 900/1797] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:11:54 2022] POST /identity/v3/users => generated 288 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:54.346753 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63c23e-9d55-430b-bd2e-cecc37827209 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:54.368453 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63c23e-9d55-430b-bd2e-cecc37827209 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:54.378979 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd563c-c044-49a0-b5f9-3dfe5aed1415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:54.379677 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd563c-c044-49a0-b5f9-3dfe5aed1415 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:54.379980 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd563c-c044-49a0-b5f9-3dfe5aed1415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:54.380277 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd563c-c044-49a0-b5f9-3dfe5aed1415 admin admin] PATH_INFO: `/v3/projects/d8a59394bab94ed59ca9bd43390bd3ca/users/437b60c02fe24c2982e64bb8c057bd09/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:54.386760 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd563c-c044-49a0-b5f9-3dfe5aed1415 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8a59394bab94ed59ca9bd43390bd3ca, user_id=437b60c02fe24c2982e64bb8c057bd09, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:54.403243 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd563c-c044-49a0-b5f9-3dfe5aed1415 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:54.414603 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc358cc6-e5af-4b73-a903-69d614f72a6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:54.417299 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc358cc6-e5af-4b73-a903-69d614f72a6c service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:54.436185 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 898/1798] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:54 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:54.437392 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc358cc6-e5af-4b73-a903-69d614f72a6c service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:54.459025 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc358cc6-e5af-4b73-a903-69d614f72a6c service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:54.461922 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 901/1799] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:54 2022] PUT /identity/v3/projects/d8a59394bab94ed59ca9bd43390bd3ca/users/437b60c02fe24c2982e64bb8c057bd09/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:54.472943 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736777e-586a-45ee-9b92-36c7bd70a55d None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:54.473654 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736777e-586a-45ee-9b92-36c7bd70a55d None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:54.474227 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736777e-586a-45ee-9b92-36c7bd70a55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:54.566093 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f84738-cb4c-4cba-9a82-683b7a2de7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:54.566755 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f84738-cb4c-4cba-9a82-683b7a2de7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:54.567042 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f84738-cb4c-4cba-9a82-683b7a2de7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:54.567320 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f84738-cb4c-4cba-9a82-683b7a2de7b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:54.567518 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-e736777e-586a-45ee-9b92-36c7bd70a55d None None] MFA Rules not processed for user `437b60c02fe24c2982e64bb8c057bd09`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:54.567968 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f84738-cb4c-4cba-9a82-683b7a2de7b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:54.569653 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f84738-cb4c-4cba-9a82-683b7a2de7b1 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:54.570883 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-e736777e-586a-45ee-9b92-36c7bd70a55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:54.582413 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 899/1800] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:54.586606 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f84738-cb4c-4cba-9a82-683b7a2de7b1 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:54.614687 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f84738-cb4c-4cba-9a82-683b7a2de7b1 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:54.622885 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ff92a-007c-4a66-a70a-082c28deb55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:54.623128 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ff92a-007c-4a66-a70a-082c28deb55e admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:54.623463 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ff92a-007c-4a66-a70a-082c28deb55e admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:54.623863 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ff92a-007c-4a66-a70a-082c28deb55e admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:54.625455 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ff92a-007c-4a66-a70a-082c28deb55e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:54.627242 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ff92a-007c-4a66-a70a-082c28deb55e admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:54.643230 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 900/1801] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:54.648137 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ff92a-007c-4a66-a70a-082c28deb55e admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:54.656396 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ff92a-007c-4a66-a70a-082c28deb55e admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:54.662908 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7386545-b329-4cb2-be70-c82d56259169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:54.663717 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7386545-b329-4cb2-be70-c82d56259169 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:54.664110 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7386545-b329-4cb2-be70-c82d56259169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:54.664514 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7386545-b329-4cb2-be70-c82d56259169 admin admin] PATH_INFO: `/v3/projects/80d93d556dff4a3a98a925ecab374f88/users/7015ba412ba44e96a2ffe38511b13d95/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:54.675428 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 902/1802] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:54 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:54.683731 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7386545-b329-4cb2-be70-c82d56259169 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80d93d556dff4a3a98a925ecab374f88, user_id=7015ba412ba44e96a2ffe38511b13d95, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:54.686683 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7386545-b329-4cb2-be70-c82d56259169 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:54.751295 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736777e-586a-45ee-9b92-36c7bd70a55d None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:54.754622 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-e736777e-586a-45ee-9b92-36c7bd70a55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:54.778986 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 901/1803] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:54 2022] PUT /identity/v3/projects/80d93d556dff4a3a98a925ecab374f88/users/7015ba412ba44e96a2ffe38511b13d95/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:54.790059 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca417ed-9031-44f8-9b84-733871727dd0 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:54.790523 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca417ed-9031-44f8-9b84-733871727dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:54.791209 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca417ed-9031-44f8-9b84-733871727dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:54.836961 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-1ca417ed-9031-44f8-9b84-733871727dd0 None None] MFA Rules not processed for user `7015ba412ba44e96a2ffe38511b13d95`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:54.838362 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1ca417ed-9031-44f8-9b84-733871727dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:54.857820 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736777e-586a-45ee-9b92-36c7bd70a55d None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:54.938702 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1238ccd2-a5e3-421f-9ebb-6a494317f5e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:54.939333 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238ccd2-a5e3-421f-9ebb-6a494317f5e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:54.939615 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238ccd2-a5e3-421f-9ebb-6a494317f5e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:54.940132 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238ccd2-a5e3-421f-9ebb-6a494317f5e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:54.945670 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 902/1804] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:54.950341 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca417ed-9031-44f8-9b84-733871727dd0 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:55.042207 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca417ed-9031-44f8-9b84-733871727dd0 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:55.047555 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1238ccd2-a5e3-421f-9ebb-6a494317f5e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:55.049201 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1238ccd2-a5e3-421f-9ebb-6a494317f5e5 service cinder] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:55.061514 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775632e2-8a7f-4660-9c72-af7b5b373c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:55.062060 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 903/1805] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:54 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:11:55.063225 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775632e2-8a7f-4660-9c72-af7b5b373c6c admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:55.063695 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775632e2-8a7f-4660-9c72-af7b5b373c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:55.064246 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775632e2-8a7f-4660-9c72-af7b5b373c6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:55.065215 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775632e2-8a7f-4660-9c72-af7b5b373c6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:55.068318 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775632e2-8a7f-4660-9c72-af7b5b373c6c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:55.236660 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 903/1806] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:11:54 2022] POST /identity/v3/projects => generated 377 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:55.239507 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1238ccd2-a5e3-421f-9ebb-6a494317f5e5 service cinder] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:55.257744 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1238ccd2-a5e3-421f-9ebb-6a494317f5e5 service cinder] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:55.362554 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5578f-8a7c-4183-9598-080cd94ecb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:55.363838 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5578f-8a7c-4183-9598-080cd94ecb47 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:55.364451 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5578f-8a7c-4183-9598-080cd94ecb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:55.365692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5578f-8a7c-4183-9598-080cd94ecb47 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:55.369015 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab5578f-8a7c-4183-9598-080cd94ecb47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:55.370076 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab5578f-8a7c-4183-9598-080cd94ecb47 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:55.508492 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 904/1807] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:11:55 2022] POST /identity/v3/users => generated 295 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:55.510379 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775632e2-8a7f-4660-9c72-af7b5b373c6c admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:55.530465 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775632e2-8a7f-4660-9c72-af7b5b373c6c admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:55.541610 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ede26-a258-45cf-ad26-5ca2700ea609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:55.543781 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ede26-a258-45cf-ad26-5ca2700ea609 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:55.545939 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ede26-a258-45cf-ad26-5ca2700ea609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:55.548259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ede26-a258-45cf-ad26-5ca2700ea609 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:55.550479 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ede26-a258-45cf-ad26-5ca2700ea609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:55.552598 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ede26-a258-45cf-ad26-5ca2700ea609 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:55.570171 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 904/1808] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:55.574270 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5578f-8a7c-4183-9598-080cd94ecb47 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:55.589299 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5578f-8a7c-4183-9598-080cd94ecb47 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:55.597038 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:55.597979 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837ce16-da7e-4764-aa89-922795d530fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:55.598972 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837ce16-da7e-4764-aa89-922795d530fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:55.599560 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837ce16-da7e-4764-aa89-922795d530fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:55.600640 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837ce16-da7e-4764-aa89-922795d530fd admin admin] PATH_INFO: `/v3/projects/9a7d58f314624eba946bf7ed80178b43/users/8c6985a4219d4e65895257ad2d3549b8/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:55.622389 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7837ce16-da7e-4764-aa89-922795d530fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a7d58f314624eba946bf7ed80178b43, user_id=8c6985a4219d4e65895257ad2d3549b8, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:55.625498 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7837ce16-da7e-4764-aa89-922795d530fd admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:55.735217 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:55.741388 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 905/1809] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:55 2022] PUT /identity/v3/projects/9a7d58f314624eba946bf7ed80178b43/users/8c6985a4219d4e65895257ad2d3549b8/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:55.745502 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ede26-a258-45cf-ad26-5ca2700ea609 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:55.756912 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ede26-a258-45cf-ad26-5ca2700ea609 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:55.815144 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4f2b6-8518-49e0-ba26-97127237e2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:55.815875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4f2b6-8518-49e0-ba26-97127237e2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:55.816225 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4f2b6-8518-49e0-ba26-97127237e2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:55.816570 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4f2b6-8518-49e0-ba26-97127237e2a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:55.817286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4f2b6-8518-49e0-ba26-97127237e2a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:55.819720 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4f2b6-8518-49e0-ba26-97127237e2a7 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:55.836650 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837ce16-da7e-4764-aa89-922795d530fd admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:55.837026 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 905/1810] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:55.858705 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837ce16-da7e-4764-aa89-922795d530fd admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:55.863296 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1a6b6-1cff-492b-8fdb-c6607f56b539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:55.864069 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1a6b6-1cff-492b-8fdb-c6607f56b539 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:55.864431 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1a6b6-1cff-492b-8fdb-c6607f56b539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:55.864776 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1a6b6-1cff-492b-8fdb-c6607f56b539 admin admin] PATH_INFO: `/v3/projects/9a7d58f314624eba946bf7ed80178b43/users/8c6985a4219d4e65895257ad2d3549b8/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:55.866847 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1a6b6-1cff-492b-8fdb-c6607f56b539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a7d58f314624eba946bf7ed80178b43, user_id=8c6985a4219d4e65895257ad2d3549b8, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:55.869678 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1a6b6-1cff-492b-8fdb-c6607f56b539 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:55.889800 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 906/1811] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:55 2022] PUT /identity/v3/projects/9a7d58f314624eba946bf7ed80178b43/users/8c6985a4219d4e65895257ad2d3549b8/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:55.901707 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45736e1c-0515-49c8-97b2-5713cbde2baa None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:55.902817 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45736e1c-0515-49c8-97b2-5713cbde2baa None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:55.903099 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45736e1c-0515-49c8-97b2-5713cbde2baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:55.938133 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-45736e1c-0515-49c8-97b2-5713cbde2baa None None] MFA Rules not processed for user `8c6985a4219d4e65895257ad2d3549b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:55.942263 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-45736e1c-0515-49c8-97b2-5713cbde2baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:56.090727 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 906/1812] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:56.103109 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1a6b6-1cff-492b-8fdb-c6607f56b539 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:56.167881 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1a6b6-1cff-492b-8fdb-c6607f56b539 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:56.173611 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf35dc-c093-4a37-bc89-33af2d7f3e69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:56.174698 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf35dc-c093-4a37-bc89-33af2d7f3e69 service cinder] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:56.175014 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf35dc-c093-4a37-bc89-33af2d7f3e69 service cinder] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:56.175523 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf35dc-c093-4a37-bc89-33af2d7f3e69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:56.248984 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf35dc-c093-4a37-bc89-33af2d7f3e69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:56.250571 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf35dc-c093-4a37-bc89-33af2d7f3e69 service cinder] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:56.260724 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 907/1813] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:56.560669 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:56.805968 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45736e1c-0515-49c8-97b2-5713cbde2baa None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:56.807431 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-45736e1c-0515-49c8-97b2-5713cbde2baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:56.897438 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45736e1c-0515-49c8-97b2-5713cbde2baa None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:56.902524 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87adea99-c840-4ca8-9e29-0056ace7d5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:56.903220 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87adea99-c840-4ca8-9e29-0056ace7d5be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:56.903738 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87adea99-c840-4ca8-9e29-0056ace7d5be admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:56.904028 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87adea99-c840-4ca8-9e29-0056ace7d5be admin admin] PATH_INFO: `/v3/users/623f8533d7174e1c95f8eb6f42e8ccb1` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:56.905266 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87adea99-c840-4ca8-9e29-0056ace7d5be admin admin] RBAC: Authorizing `identity:delete_user(user_id=623f8533d7174e1c95f8eb6f42e8ccb1)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:56.908675 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87adea99-c840-4ca8-9e29-0056ace7d5be admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:57.131514 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf35dc-c093-4a37-bc89-33af2d7f3e69 service cinder] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:57.141476 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf35dc-c093-4a37-bc89-33af2d7f3e69 service cinder] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:57.149768 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0084394d-8fe6-4ce4-acbd-a2238d81a7cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:57.150635 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084394d-8fe6-4ce4-acbd-a2238d81a7cb service cinder] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:57.151063 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084394d-8fe6-4ce4-acbd-a2238d81a7cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:57.151483 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084394d-8fe6-4ce4-acbd-a2238d81a7cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:57.178817 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-87adea99-c840-4ca8-9e29-0056ace7d5be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '623f8533d7174e1c95f8eb6f42e8ccb1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:57.234365 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0084394d-8fe6-4ce4-acbd-a2238d81a7cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:57.236346 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0084394d-8fe6-4ce4-acbd-a2238d81a7cb service cinder] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:57.250505 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 908/1814] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:57 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:11:57.310482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-87adea99-c840-4ca8-9e29-0056ace7d5be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '623f8533d7174e1c95f8eb6f42e8ccb1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:57.336669 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-87adea99-c840-4ca8-9e29-0056ace7d5be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '623f8533d7174e1c95f8eb6f42e8ccb1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:57.353269 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-87adea99-c840-4ca8-9e29-0056ace7d5be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '623f8533d7174e1c95f8eb6f42e8ccb1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:57.354740 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-87adea99-c840-4ca8-9e29-0056ace7d5be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '623f8533d7174e1c95f8eb6f42e8ccb1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:57.366904 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 907/1815] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:11:56 2022] DELETE /identity/v3/users/623f8533d7174e1c95f8eb6f42e8ccb1 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:57.368853 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442e6a4-a678-47a3-b068-64c04e48d4db None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:57.369393 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442e6a4-a678-47a3-b068-64c04e48d4db None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:57.370132 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442e6a4-a678-47a3-b068-64c04e48d4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:57.401364 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-0442e6a4-a678-47a3-b068-64c04e48d4db None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:57.403789 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-0442e6a4-a678-47a3-b068-64c04e48d4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:57.538866 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 909/1816] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:57.552936 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87adea99-c840-4ca8-9e29-0056ace7d5be admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:57.555243 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-87adea99-c840-4ca8-9e29-0056ace7d5be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:57.626754 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87adea99-c840-4ca8-9e29-0056ace7d5be admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:57.630481 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5cc31f-371d-489b-a24e-96b236c880e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:57.631126 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5cc31f-371d-489b-a24e-96b236c880e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:57.631408 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5cc31f-371d-489b-a24e-96b236c880e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:57.631693 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5cc31f-371d-489b-a24e-96b236c880e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:57.642056 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5cc31f-371d-489b-a24e-96b236c880e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:57.643681 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5cc31f-371d-489b-a24e-96b236c880e4 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:57.657312 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 908/1817] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:58.300475 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:58.568470 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0442e6a4-a678-47a3-b068-64c04e48d4db None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:58.571316 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-0442e6a4-a678-47a3-b068-64c04e48d4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:58.585001 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5cc31f-371d-489b-a24e-96b236c880e4 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:58.587304 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3f5cc31f-371d-489b-a24e-96b236c880e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:58.597064 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0442e6a4-a678-47a3-b068-64c04e48d4db None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:58.608549 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63758d-ca66-4ecc-8c08-85ae74f7727b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:58.610198 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63758d-ca66-4ecc-8c08-85ae74f7727b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:58.610808 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63758d-ca66-4ecc-8c08-85ae74f7727b admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:58.611240 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63758d-ca66-4ecc-8c08-85ae74f7727b admin admin] PATH_INFO: `/v3/projects/872e834822944c058e015e6d2e9901d1` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:58.612713 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63758d-ca66-4ecc-8c08-85ae74f7727b admin admin] RBAC: Authorizing `identity:delete_project(project_id=872e834822944c058e015e6d2e9901d1)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:58.616910 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63758d-ca66-4ecc-8c08-85ae74f7727b admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:58.701234 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5cc31f-371d-489b-a24e-96b236c880e4 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:58.706248 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b5204-a468-4d9e-9069-d72cff9be189 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:58.712493 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b5204-a468-4d9e-9069-d72cff9be189 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:58.712493 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b5204-a468-4d9e-9069-d72cff9be189 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:58.712493 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b5204-a468-4d9e-9069-d72cff9be189 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:58.715499 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d98b5204-a468-4d9e-9069-d72cff9be189 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:58.824976 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b5204-a468-4d9e-9069-d72cff9be189 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:58.827214 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b5204-a468-4d9e-9069-d72cff9be189 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:58.837637 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 909/1818] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:11:58.841618 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-dd63758d-ca66-4ecc-8c08-85ae74f7727b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '872e834822944c058e015e6d2e9901d1', 'request_id': 'req-dd63758d-ca66-4ecc-8c08-85ae74f7727b'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:58.982987 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-dd63758d-ca66-4ecc-8c08-85ae74f7727b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '872e834822944c058e015e6d2e9901d1', 'request_id': 'req-dd63758d-ca66-4ecc-8c08-85ae74f7727b'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:59.008210 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-dd63758d-ca66-4ecc-8c08-85ae74f7727b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '872e834822944c058e015e6d2e9901d1', 'request_id': 'req-dd63758d-ca66-4ecc-8c08-85ae74f7727b'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:59.021468 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-dd63758d-ca66-4ecc-8c08-85ae74f7727b admin admin] The token cache is being invalidate because project 872e834822944c058e015e6d2e9901d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:11:59.021834 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-dd63758d-ca66-4ecc-8c08-85ae74f7727b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:59.023485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-dd63758d-ca66-4ecc-8c08-85ae74f7727b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:59.026620 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 910/1819] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:11:58 2022] DELETE /identity/v3/projects/872e834822944c058e015e6d2e9901d1 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:59.030593 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b5204-a468-4d9e-9069-d72cff9be189 service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:59.048625 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b5204-a468-4d9e-9069-d72cff9be189 service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:59.134375 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5df1a-7a09-42cc-b5ac-79841a836e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:59.139098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5df1a-7a09-42cc-b5ac-79841a836e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:59.139098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5df1a-7a09-42cc-b5ac-79841a836e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:59.139098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5df1a-7a09-42cc-b5ac-79841a836e42 admin admin] PATH_INFO: `/v3/users/be63f9e955534110ac4b461453ee111d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:59.139098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5df1a-7a09-42cc-b5ac-79841a836e42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be63f9e955534110ac4b461453ee111d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:59.139098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5df1a-7a09-42cc-b5ac-79841a836e42 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:59.531601 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-acc5df1a-7a09-42cc-b5ac-79841a836e42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be63f9e955534110ac4b461453ee111d'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:59.626332 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:59.659520 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-acc5df1a-7a09-42cc-b5ac-79841a836e42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be63f9e955534110ac4b461453ee111d'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:59.681838 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-acc5df1a-7a09-42cc-b5ac-79841a836e42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be63f9e955534110ac4b461453ee111d'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:59.699641 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-acc5df1a-7a09-42cc-b5ac-79841a836e42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be63f9e955534110ac4b461453ee111d'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:59.705543 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-acc5df1a-7a09-42cc-b5ac-79841a836e42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be63f9e955534110ac4b461453ee111d'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:59.720307 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 910/1820] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:11:59 2022] DELETE /identity/v3/users/be63f9e955534110ac4b461453ee111d => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:11:59.774513 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c161d54-935c-4f7b-ac70-e74fbbf72a6d None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:59.775024 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c161d54-935c-4f7b-ac70-e74fbbf72a6d None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:59.775264 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c161d54-935c-4f7b-ac70-e74fbbf72a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:59.880964 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-5c161d54-935c-4f7b-ac70-e74fbbf72a6d None None] MFA Rules not processed for user `fb3a54a17338499eb16ad4c831c0454b`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:59.882403 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-5c161d54-935c-4f7b-ac70-e74fbbf72a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:00.001569 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5df1a-7a09-42cc-b5ac-79841a836e42 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:00.003129 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-acc5df1a-7a09-42cc-b5ac-79841a836e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:00.008212 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 911/1821] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:11:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:12:00.027587 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c161d54-935c-4f7b-ac70-e74fbbf72a6d None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:00.031888 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-5c161d54-935c-4f7b-ac70-e74fbbf72a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:00.083215 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5df1a-7a09-42cc-b5ac-79841a836e42 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:00.090933 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0227c5-dc7b-41d7-88c2-024ce2f54a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:00.091870 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0227c5-dc7b-41d7-88c2-024ce2f54a14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:00.092370 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0227c5-dc7b-41d7-88c2-024ce2f54a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:00.093042 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0227c5-dc7b-41d7-88c2-024ce2f54a14 admin admin] PATH_INFO: `/v3/users/d74fa267aec34ff8b8a607304ba37c1c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:00.094666 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0227c5-dc7b-41d7-88c2-024ce2f54a14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d74fa267aec34ff8b8a607304ba37c1c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:00.096841 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0227c5-dc7b-41d7-88c2-024ce2f54a14 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:00.141024 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c161d54-935c-4f7b-ac70-e74fbbf72a6d None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:00.147891 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1c4bf-b7c4-4a17-8937-7c20bfe72738 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:00.148969 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1c4bf-b7c4-4a17-8937-7c20bfe72738 service nova] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:00.149684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1c4bf-b7c4-4a17-8937-7c20bfe72738 service nova] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:00.160471 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1c4bf-b7c4-4a17-8937-7c20bfe72738 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:00.171865 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1c4bf-b7c4-4a17-8937-7c20bfe72738 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:00.175260 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1c4bf-b7c4-4a17-8937-7c20bfe72738 service nova] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:00.184387 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 912/1822] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:12:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:12:00.489691 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1c4bf-b7c4-4a17-8937-7c20bfe72738 service nova] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:00.491186 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-5dc1c4bf-b7c4-4a17-8937-7c20bfe72738 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:00.500619 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ad0227c5-dc7b-41d7-88c2-024ce2f54a14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd74fa267aec34ff8b8a607304ba37c1c'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:00.514251 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1c4bf-b7c4-4a17-8937-7c20bfe72738 service nova] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:00.527331 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550088c-315d-4d47-b339-be0ad8eba8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:00.527331 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550088c-315d-4d47-b339-be0ad8eba8e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:00.527544 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550088c-315d-4d47-b339-be0ad8eba8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:00.527811 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550088c-315d-4d47-b339-be0ad8eba8e6 admin admin] PATH_INFO: `/v3/projects/54b3a048b9444f159546c733d40a8aa3` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:00.530271 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2550088c-315d-4d47-b339-be0ad8eba8e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54b3a048b9444f159546c733d40a8aa3)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:00.535177 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2550088c-315d-4d47-b339-be0ad8eba8e6 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:00.674308 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ad0227c5-dc7b-41d7-88c2-024ce2f54a14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd74fa267aec34ff8b8a607304ba37c1c'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:00.692506 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ad0227c5-dc7b-41d7-88c2-024ce2f54a14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd74fa267aec34ff8b8a607304ba37c1c'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:00.709149 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ad0227c5-dc7b-41d7-88c2-024ce2f54a14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd74fa267aec34ff8b8a607304ba37c1c'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:00.710478 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ad0227c5-dc7b-41d7-88c2-024ce2f54a14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd74fa267aec34ff8b8a607304ba37c1c'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:00.712181 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-2550088c-315d-4d47-b339-be0ad8eba8e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54b3a048b9444f159546c733d40a8aa3', 'request_id': 'req-2550088c-315d-4d47-b339-be0ad8eba8e6'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:00.723077 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 911/1823] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:12:00 2022] DELETE /identity/v3/users/d74fa267aec34ff8b8a607304ba37c1c => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:00.724805 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada456ae-7470-45f1-bdae-738b48aec250 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:00.725250 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada456ae-7470-45f1-bdae-738b48aec250 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:00.725677 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada456ae-7470-45f1-bdae-738b48aec250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:00.751670 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-ada456ae-7470-45f1-bdae-738b48aec250 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:00.753061 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ada456ae-7470-45f1-bdae-738b48aec250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:00.829135 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 912/1824] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:12:00.842265 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada456ae-7470-45f1-bdae-738b48aec250 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:00.842408 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-2550088c-315d-4d47-b339-be0ad8eba8e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54b3a048b9444f159546c733d40a8aa3', 'request_id': 'req-2550088c-315d-4d47-b339-be0ad8eba8e6'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:00.845530 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ada456ae-7470-45f1-bdae-738b48aec250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:00.881175 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-2550088c-315d-4d47-b339-be0ad8eba8e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54b3a048b9444f159546c733d40a8aa3', 'request_id': 'req-2550088c-315d-4d47-b339-be0ad8eba8e6'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:00.899225 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-2550088c-315d-4d47-b339-be0ad8eba8e6 admin admin] The token cache is being invalidate because project 54b3a048b9444f159546c733d40a8aa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:12:00.899922 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-2550088c-315d-4d47-b339-be0ad8eba8e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:00.901022 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-2550088c-315d-4d47-b339-be0ad8eba8e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:00.903581 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 913/1825] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:12:00 2022] DELETE /identity/v3/projects/54b3a048b9444f159546c733d40a8aa3 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:00.909332 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550088c-315d-4d47-b339-be0ad8eba8e6 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:00.910172 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-2550088c-315d-4d47-b339-be0ad8eba8e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:00.956172 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada456ae-7470-45f1-bdae-738b48aec250 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:00.995056 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ff6db-d9c4-4812-b161-62bd0550a101 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:00.996051 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ff6db-d9c4-4812-b161-62bd0550a101 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:00.996619 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ff6db-d9c4-4812-b161-62bd0550a101 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:00.997152 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ff6db-d9c4-4812-b161-62bd0550a101 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:01.033366 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f74ff6db-d9c4-4812-b161-62bd0550a101 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:01.064308 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ff6db-d9c4-4812-b161-62bd0550a101 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:01.064308 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ff6db-d9c4-4812-b161-62bd0550a101 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:01.087762 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 913/1826] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:12:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:12:01.174924 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550088c-315d-4d47-b339-be0ad8eba8e6 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:01.200821 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191312ce-95cb-42a9-97f9-1d3e15006857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:01.201921 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191312ce-95cb-42a9-97f9-1d3e15006857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:01.202401 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191312ce-95cb-42a9-97f9-1d3e15006857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:01.203221 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191312ce-95cb-42a9-97f9-1d3e15006857 admin admin] PATH_INFO: `/v3/users/c8c9cf58a4cc47a0bfc3cd36724f6944` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:01.210078 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191312ce-95cb-42a9-97f9-1d3e15006857 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8c9cf58a4cc47a0bfc3cd36724f6944)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:01.214818 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191312ce-95cb-42a9-97f9-1d3e15006857 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:01.628591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ff6db-d9c4-4812-b161-62bd0550a101 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:01.630373 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f74ff6db-d9c4-4812-b161-62bd0550a101 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:01.724816 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-191312ce-95cb-42a9-97f9-1d3e15006857 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8c9cf58a4cc47a0bfc3cd36724f6944'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:01.790598 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ff6db-d9c4-4812-b161-62bd0550a101 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:01.794657 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c273642-75d2-47f6-96c4-9022118df0ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:01.795548 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c273642-75d2-47f6-96c4-9022118df0ff service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:01.795874 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c273642-75d2-47f6-96c4-9022118df0ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:01.796326 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c273642-75d2-47f6-96c4-9022118df0ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:01.798607 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5c273642-75d2-47f6-96c4-9022118df0ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:01.836386 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-191312ce-95cb-42a9-97f9-1d3e15006857 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8c9cf58a4cc47a0bfc3cd36724f6944'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:01.855955 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-191312ce-95cb-42a9-97f9-1d3e15006857 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8c9cf58a4cc47a0bfc3cd36724f6944'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:01.857398 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-191312ce-95cb-42a9-97f9-1d3e15006857 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8c9cf58a4cc47a0bfc3cd36724f6944'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:01.865402 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-191312ce-95cb-42a9-97f9-1d3e15006857 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8c9cf58a4cc47a0bfc3cd36724f6944'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:01.878961 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 914/1827] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:12:00 2022] DELETE /identity/v3/users/c8c9cf58a4cc47a0bfc3cd36724f6944 => generated 0 bytes in 971 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:01.932596 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c273642-75d2-47f6-96c4-9022118df0ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:01.934617 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c273642-75d2-47f6-96c4-9022118df0ff service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:01.946099 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 914/1828] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:12:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:12:02.033031 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191312ce-95cb-42a9-97f9-1d3e15006857 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:02.034879 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-191312ce-95cb-42a9-97f9-1d3e15006857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:02.121032 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191312ce-95cb-42a9-97f9-1d3e15006857 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:02.125879 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6853c15-4c6c-419a-bed6-3ee58b03cf9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:02.126799 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6853c15-4c6c-419a-bed6-3ee58b03cf9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:02.127174 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6853c15-4c6c-419a-bed6-3ee58b03cf9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:02.127557 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6853c15-4c6c-419a-bed6-3ee58b03cf9a admin admin] PATH_INFO: `/v3/projects/ac3c33db2eb54da08166770ba98db9f4` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:02.129053 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6853c15-4c6c-419a-bed6-3ee58b03cf9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac3c33db2eb54da08166770ba98db9f4)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:02.131066 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6853c15-4c6c-419a-bed6-3ee58b03cf9a admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:02.168459 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:02.297465 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-d6853c15-4c6c-419a-bed6-3ee58b03cf9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac3c33db2eb54da08166770ba98db9f4', 'request_id': 'req-d6853c15-4c6c-419a-bed6-3ee58b03cf9a'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:02.436542 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-d6853c15-4c6c-419a-bed6-3ee58b03cf9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac3c33db2eb54da08166770ba98db9f4', 'request_id': 'req-d6853c15-4c6c-419a-bed6-3ee58b03cf9a'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:02.443810 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-d6853c15-4c6c-419a-bed6-3ee58b03cf9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac3c33db2eb54da08166770ba98db9f4', 'request_id': 'req-d6853c15-4c6c-419a-bed6-3ee58b03cf9a'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:02.458042 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-d6853c15-4c6c-419a-bed6-3ee58b03cf9a admin admin] The token cache is being invalidate because project ac3c33db2eb54da08166770ba98db9f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:12:02.458538 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-d6853c15-4c6c-419a-bed6-3ee58b03cf9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:02.459829 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-d6853c15-4c6c-419a-bed6-3ee58b03cf9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:02.461619 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 915/1829] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:12:02 2022] DELETE /identity/v3/projects/ac3c33db2eb54da08166770ba98db9f4 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:02.465739 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c273642-75d2-47f6-96c4-9022118df0ff service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:02.467349 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5c273642-75d2-47f6-96c4-9022118df0ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:02.481882 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c273642-75d2-47f6-96c4-9022118df0ff service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:02.545404 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c640652-a13e-43ef-8573-78c78ee7e197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:02.546168 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c640652-a13e-43ef-8573-78c78ee7e197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:02.546461 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c640652-a13e-43ef-8573-78c78ee7e197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:02.546744 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c640652-a13e-43ef-8573-78c78ee7e197 admin admin] PATH_INFO: `/v3/users/68b2bc41d6dc4f0cae6fdfe4a448c7b1` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:02.547918 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c640652-a13e-43ef-8573-78c78ee7e197 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68b2bc41d6dc4f0cae6fdfe4a448c7b1)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:02.549901 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c640652-a13e-43ef-8573-78c78ee7e197 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:02.617917 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6853c15-4c6c-419a-bed6-3ee58b03cf9a admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:02.619997 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-d6853c15-4c6c-419a-bed6-3ee58b03cf9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:02.639125 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6853c15-4c6c-419a-bed6-3ee58b03cf9a admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:02.656667 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2228d72-3eba-40a2-88c7-d50d50127474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:02.657759 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2228d72-3eba-40a2-88c7-d50d50127474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:02.658195 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2228d72-3eba-40a2-88c7-d50d50127474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:02.658474 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2228d72-3eba-40a2-88c7-d50d50127474 admin admin] PATH_INFO: `/v3/projects/eed611876e89452fbc75ce364c9bff16` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:02.659645 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2228d72-3eba-40a2-88c7-d50d50127474 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eed611876e89452fbc75ce364c9bff16)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:02.662248 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2228d72-3eba-40a2-88c7-d50d50127474 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:02.889408 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-f2228d72-3eba-40a2-88c7-d50d50127474 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eed611876e89452fbc75ce364c9bff16', 'request_id': 'req-f2228d72-3eba-40a2-88c7-d50d50127474'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:02.891999 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9c640652-a13e-43ef-8573-78c78ee7e197 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68b2bc41d6dc4f0cae6fdfe4a448c7b1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:03.014004 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-f2228d72-3eba-40a2-88c7-d50d50127474 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eed611876e89452fbc75ce364c9bff16', 'request_id': 'req-f2228d72-3eba-40a2-88c7-d50d50127474'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:03.025509 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-f2228d72-3eba-40a2-88c7-d50d50127474 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eed611876e89452fbc75ce364c9bff16', 'request_id': 'req-f2228d72-3eba-40a2-88c7-d50d50127474'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:03.037154 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-f2228d72-3eba-40a2-88c7-d50d50127474 admin admin] The token cache is being invalidate because project eed611876e89452fbc75ce364c9bff16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:12:03.037273 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-f2228d72-3eba-40a2-88c7-d50d50127474 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:03.038272 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-f2228d72-3eba-40a2-88c7-d50d50127474 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:03.040742 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 916/1830] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:12:02 2022] DELETE /identity/v3/projects/eed611876e89452fbc75ce364c9bff16 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:12:03.041786 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2228d72-3eba-40a2-88c7-d50d50127474 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:03.046145 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-f2228d72-3eba-40a2-88c7-d50d50127474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:03.111426 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9c640652-a13e-43ef-8573-78c78ee7e197 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68b2bc41d6dc4f0cae6fdfe4a448c7b1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:03.126834 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9c640652-a13e-43ef-8573-78c78ee7e197 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68b2bc41d6dc4f0cae6fdfe4a448c7b1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:03.129943 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2228d72-3eba-40a2-88c7-d50d50127474 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:03.140173 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9c640652-a13e-43ef-8573-78c78ee7e197 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68b2bc41d6dc4f0cae6fdfe4a448c7b1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:03.142365 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9c640652-a13e-43ef-8573-78c78ee7e197 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68b2bc41d6dc4f0cae6fdfe4a448c7b1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:03.153392 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8f8db-a28b-4d3e-bfc0-f49b95dc84f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:03.154306 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8f8db-a28b-4d3e-bfc0-f49b95dc84f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:03.154429 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 915/1831] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:12:02 2022] DELETE /identity/v3/users/68b2bc41d6dc4f0cae6fdfe4a448c7b1 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:12:03.154846 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8f8db-a28b-4d3e-bfc0-f49b95dc84f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:03.155313 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8f8db-a28b-4d3e-bfc0-f49b95dc84f0 admin admin] PATH_INFO: `/v3/users/11ba5c4b0ffe4351a4fad042d62023a3` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:03.157728 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2e37c-f773-493e-80b0-cbe68ab4f9b6 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:03.163886 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2e37c-f773-493e-80b0-cbe68ab4f9b6 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:03.164370 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2e37c-f773-493e-80b0-cbe68ab4f9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:03.171179 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8f8db-a28b-4d3e-bfc0-f49b95dc84f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11ba5c4b0ffe4351a4fad042d62023a3)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:03.176278 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8f8db-a28b-4d3e-bfc0-f49b95dc84f0 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:03.227119 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-8fe2e37c-f773-493e-80b0-cbe68ab4f9b6 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:03.229778 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8fe2e37c-f773-493e-80b0-cbe68ab4f9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:03.405084 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 916/1832] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:12:03.415357 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ca1e9-4c54-446d-a2d1-40dddabe71fe None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:03.415647 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ca1e9-4c54-446d-a2d1-40dddabe71fe None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:03.416117 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ca1e9-4c54-446d-a2d1-40dddabe71fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:03.439041 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-b49ca1e9-4c54-446d-a2d1-40dddabe71fe None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:03.440703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b49ca1e9-4c54-446d-a2d1-40dddabe71fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:03.454996 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 917/1833] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:12:03.470488 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ca1e9-4c54-446d-a2d1-40dddabe71fe None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:03.491231 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ca1e9-4c54-446d-a2d1-40dddabe71fe None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:03.505102 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f2f8f-e649-4bea-9f2d-a5c5152cb06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:03.505755 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f2f8f-e649-4bea-9f2d-a5c5152cb06f admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:03.506038 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f2f8f-e649-4bea-9f2d-a5c5152cb06f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:03.508306 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f2f8f-e649-4bea-9f2d-a5c5152cb06f admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:03.509005 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f2f8f-e649-4bea-9f2d-a5c5152cb06f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:12:03.509322 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f2f8f-e649-4bea-9f2d-a5c5152cb06f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:03.510980 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f2f8f-e649-4bea-9f2d-a5c5152cb06f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:03.527394 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-14a8f8db-a28b-4d3e-bfc0-f49b95dc84f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11ba5c4b0ffe4351a4fad042d62023a3'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:03.554431 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 918/1834] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:12:03.556001 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f2f8f-e649-4bea-9f2d-a5c5152cb06f admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:03.574856 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f2f8f-e649-4bea-9f2d-a5c5152cb06f admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:03.580704 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2004f-1e11-483d-9dac-5f6a1b1ce075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:03.581749 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2004f-1e11-483d-9dac-5f6a1b1ce075 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:03.582397 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2004f-1e11-483d-9dac-5f6a1b1ce075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:03.583176 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2004f-1e11-483d-9dac-5f6a1b1ce075 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:03.584019 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad2004f-1e11-483d-9dac-5f6a1b1ce075 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:03.587020 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad2004f-1e11-483d-9dac-5f6a1b1ce075 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:03.634533 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-14a8f8db-a28b-4d3e-bfc0-f49b95dc84f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11ba5c4b0ffe4351a4fad042d62023a3'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:03.667530 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-14a8f8db-a28b-4d3e-bfc0-f49b95dc84f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11ba5c4b0ffe4351a4fad042d62023a3'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:03.670866 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-14a8f8db-a28b-4d3e-bfc0-f49b95dc84f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11ba5c4b0ffe4351a4fad042d62023a3'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:03.702112 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-14a8f8db-a28b-4d3e-bfc0-f49b95dc84f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11ba5c4b0ffe4351a4fad042d62023a3'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:03.716342 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 917/1835] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:12:03 2022] DELETE /identity/v3/users/11ba5c4b0ffe4351a4fad042d62023a3 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:03.724383 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149eaf2-dea1-463b-b6fc-d744dfd1581d None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:03.725245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149eaf2-dea1-463b-b6fc-d744dfd1581d None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:03.725772 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149eaf2-dea1-463b-b6fc-d744dfd1581d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:03.737602 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 919/1836] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:12:03 2022] POST /identity/v3/projects => generated 367 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:12:03.741397 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2004f-1e11-483d-9dac-5f6a1b1ce075 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:03.743107 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1ad2004f-1e11-483d-9dac-5f6a1b1ce075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:03.780866 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-7149eaf2-dea1-463b-b6fc-d744dfd1581d None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:03.785648 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-7149eaf2-dea1-463b-b6fc-d744dfd1581d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:03.856140 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:03.875769 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2004f-1e11-483d-9dac-5f6a1b1ce075 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:03.881442 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8efaf97-0772-4201-9309-3a08e728d73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:03.882323 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efaf97-0772-4201-9309-3a08e728d73f admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:03.882794 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efaf97-0772-4201-9309-3a08e728d73f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:03.883213 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efaf97-0772-4201-9309-3a08e728d73f admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:03.884048 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8efaf97-0772-4201-9309-3a08e728d73f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:03.886896 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8efaf97-0772-4201-9309-3a08e728d73f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:03.910797 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 918/1837] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:12:03.931926 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149eaf2-dea1-463b-b6fc-d744dfd1581d None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:03.938177 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-7149eaf2-dea1-463b-b6fc-d744dfd1581d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:04.028180 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 920/1838] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:12:03 2022] POST /identity/v3/users => generated 284 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:12:04.028894 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149eaf2-dea1-463b-b6fc-d744dfd1581d None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:04.032450 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8efaf97-0772-4201-9309-3a08e728d73f admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:04.035540 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e9ec4-b873-4854-8a06-fa02b82e723e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:04.036273 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e9ec4-b873-4854-8a06-fa02b82e723e service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:04.036418 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d8efaf97-0772-4201-9309-3a08e728d73f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:04.036557 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e9ec4-b873-4854-8a06-fa02b82e723e service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:04.036839 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e9ec4-b873-4854-8a06-fa02b82e723e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:04.052672 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e9ec4-b873-4854-8a06-fa02b82e723e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:04.062871 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e9ec4-b873-4854-8a06-fa02b82e723e service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:04.066529 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8efaf97-0772-4201-9309-3a08e728d73f admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:04.089771 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08c0a8-1f37-4a49-9df7-a60aa6097ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:04.090527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08c0a8-1f37-4a49-9df7-a60aa6097ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:04.090816 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08c0a8-1f37-4a49-9df7-a60aa6097ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:04.092320 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08c0a8-1f37-4a49-9df7-a60aa6097ff0 admin admin] PATH_INFO: `/v3/projects/91e22f0c9b034f2483721909c57d59f2` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:04.094528 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c08c0a8-1f37-4a49-9df7-a60aa6097ff0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91e22f0c9b034f2483721909c57d59f2)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:04.096571 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 919/1839] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:12:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:12:04.099457 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e9ec4-b873-4854-8a06-fa02b82e723e service neutron] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:04.100451 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c08c0a8-1f37-4a49-9df7-a60aa6097ff0 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:04.127377 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e9ec4-b873-4854-8a06-fa02b82e723e service neutron] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:04.141156 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2c5e7-a93c-4863-843b-360ec5014536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:04.141156 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2c5e7-a93c-4863-843b-360ec5014536 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:04.141156 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2c5e7-a93c-4863-843b-360ec5014536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:04.141156 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2c5e7-a93c-4863-843b-360ec5014536 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:04.144107 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee2c5e7-a93c-4863-843b-360ec5014536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:04.145853 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee2c5e7-a93c-4863-843b-360ec5014536 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:04.163491 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 920/1840] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:12:04.167208 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2c5e7-a93c-4863-843b-360ec5014536 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:04.195786 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2c5e7-a93c-4863-843b-360ec5014536 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:04.210154 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bec88-aae9-47fb-bb87-c178193d02fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:04.211066 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bec88-aae9-47fb-bb87-c178193d02fd admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:04.211439 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bec88-aae9-47fb-bb87-c178193d02fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:04.212543 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bec88-aae9-47fb-bb87-c178193d02fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:04.214208 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252bec88-aae9-47fb-bb87-c178193d02fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:04.216286 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252bec88-aae9-47fb-bb87-c178193d02fd admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:04.233224 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 921/1841] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:12:04.236361 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bec88-aae9-47fb-bb87-c178193d02fd admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:04.252575 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bec88-aae9-47fb-bb87-c178193d02fd admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:04.266532 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ead46b-1200-47e8-b56e-8bb3399a1de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:04.266532 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ead46b-1200-47e8-b56e-8bb3399a1de2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:04.266532 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ead46b-1200-47e8-b56e-8bb3399a1de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:04.266532 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ead46b-1200-47e8-b56e-8bb3399a1de2 admin admin] PATH_INFO: `/v3/projects/17c1c7a478cf489a93d0aa9fd5913c7b/users/be32b01b46144d7794db524c63fc6d6e/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:04.292224 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ead46b-1200-47e8-b56e-8bb3399a1de2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17c1c7a478cf489a93d0aa9fd5913c7b, user_id=be32b01b46144d7794db524c63fc6d6e, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:04.308046 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ead46b-1200-47e8-b56e-8bb3399a1de2 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:04.358749 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0c08c0a8-1f37-4a49-9df7-a60aa6097ff0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91e22f0c9b034f2483721909c57d59f2', 'request_id': 'req-0c08c0a8-1f37-4a49-9df7-a60aa6097ff0'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:04.363590 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0c08c0a8-1f37-4a49-9df7-a60aa6097ff0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91e22f0c9b034f2483721909c57d59f2', 'request_id': 'req-0c08c0a8-1f37-4a49-9df7-a60aa6097ff0'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:04.439502 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 922/1842] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:12:04 2022] PUT /identity/v3/projects/17c1c7a478cf489a93d0aa9fd5913c7b/users/be32b01b46144d7794db524c63fc6d6e/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:12:04.441557 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c32c8-6efa-4dbc-8eb0-c2dc4688bb3e None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:04.441878 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c32c8-6efa-4dbc-8eb0-c2dc4688bb3e None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:04.442153 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c32c8-6efa-4dbc-8eb0-c2dc4688bb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:04.457996 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0c08c0a8-1f37-4a49-9df7-a60aa6097ff0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91e22f0c9b034f2483721909c57d59f2', 'request_id': 'req-0c08c0a8-1f37-4a49-9df7-a60aa6097ff0'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:04.476993 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0c08c0a8-1f37-4a49-9df7-a60aa6097ff0 admin admin] The token cache is being invalidate because project 91e22f0c9b034f2483721909c57d59f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:12:04.477552 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0c08c0a8-1f37-4a49-9df7-a60aa6097ff0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:04.478302 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0c08c0a8-1f37-4a49-9df7-a60aa6097ff0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:04.480735 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 921/1843] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:12:04 2022] DELETE /identity/v3/projects/91e22f0c9b034f2483721909c57d59f2 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:04.481540 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41d061-d3a2-406b-869d-55c598c565f2 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:04.482098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41d061-d3a2-406b-869d-55c598c565f2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:04.482219 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41d061-d3a2-406b-869d-55c598c565f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:04.492810 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-110c32c8-6efa-4dbc-8eb0-c2dc4688bb3e None None] MFA Rules not processed for user `be32b01b46144d7794db524c63fc6d6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:04.493800 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-110c32c8-6efa-4dbc-8eb0-c2dc4688bb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:04.505274 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-cd41d061-d3a2-406b-869d-55c598c565f2 None None] MFA Rules not processed for user `fb3a54a17338499eb16ad4c831c0454b`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:04.505274 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-cd41d061-d3a2-406b-869d-55c598c565f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:04.571843 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 923/1844] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:12:04.576396 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c32c8-6efa-4dbc-8eb0-c2dc4688bb3e None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:04.577839 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-110c32c8-6efa-4dbc-8eb0-c2dc4688bb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:04.578257 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 922/1845] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:12:04.584045 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41d061-d3a2-406b-869d-55c598c565f2 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:04.586272 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-cd41d061-d3a2-406b-869d-55c598c565f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:04.672356 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c32c8-6efa-4dbc-8eb0-c2dc4688bb3e None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:04.677803 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999206d-e531-4c56-82a1-b8f360272422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:04.678723 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999206d-e531-4c56-82a1-b8f360272422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:04.679109 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999206d-e531-4c56-82a1-b8f360272422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:04.679494 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999206d-e531-4c56-82a1-b8f360272422 admin admin] PATH_INFO: `/v3/users/d5fd671d4d184d3188a42320cd86949b` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:04.680792 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999206d-e531-4c56-82a1-b8f360272422 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5fd671d4d184d3188a42320cd86949b)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:04.682798 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999206d-e531-4c56-82a1-b8f360272422 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:04.694722 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41d061-d3a2-406b-869d-55c598c565f2 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:04.700683 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee4537-5099-4d42-94d9-de3df08bf90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:04.701315 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee4537-5099-4d42-94d9-de3df08bf90a admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:04.703698 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee4537-5099-4d42-94d9-de3df08bf90a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:04.704007 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee4537-5099-4d42-94d9-de3df08bf90a admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:04.704694 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ee4537-5099-4d42-94d9-de3df08bf90a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:04.706619 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ee4537-5099-4d42-94d9-de3df08bf90a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:04.838339 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 923/1846] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:12:04 2022] POST /identity/v3/projects => generated 367 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:12:04.839445 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee4537-5099-4d42-94d9-de3df08bf90a admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:04.841877 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-61ee4537-5099-4d42-94d9-de3df08bf90a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:04.873077 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-5999206d-e531-4c56-82a1-b8f360272422 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5fd671d4d184d3188a42320cd86949b'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:04.916287 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee4537-5099-4d42-94d9-de3df08bf90a admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:04.923264 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23a063-2e8b-4017-a6b0-c7bc140e69f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:04.923910 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23a063-2e8b-4017-a6b0-c7bc140e69f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:04.924227 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23a063-2e8b-4017-a6b0-c7bc140e69f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:04.924552 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23a063-2e8b-4017-a6b0-c7bc140e69f2 admin admin] PATH_INFO: `/v3/projects/68b47312172b4f879156c12cb646780f` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:04.925738 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d23a063-2e8b-4017-a6b0-c7bc140e69f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68b47312172b4f879156c12cb646780f)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:04.927687 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d23a063-2e8b-4017-a6b0-c7bc140e69f2 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:04.990709 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-5999206d-e531-4c56-82a1-b8f360272422 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5fd671d4d184d3188a42320cd86949b'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:05.005467 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-5999206d-e531-4c56-82a1-b8f360272422 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5fd671d4d184d3188a42320cd86949b'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:05.006838 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-5999206d-e531-4c56-82a1-b8f360272422 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5fd671d4d184d3188a42320cd86949b'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:05.014350 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-5999206d-e531-4c56-82a1-b8f360272422 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5fd671d4d184d3188a42320cd86949b'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:05.020685 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 924/1847] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:12:04 2022] DELETE /identity/v3/users/d5fd671d4d184d3188a42320cd86949b => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:05.021554 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999206d-e531-4c56-82a1-b8f360272422 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:05.023481 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-5999206d-e531-4c56-82a1-b8f360272422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:05.062000 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1d23a063-2e8b-4017-a6b0-c7bc140e69f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68b47312172b4f879156c12cb646780f', 'request_id': 'req-1d23a063-2e8b-4017-a6b0-c7bc140e69f2'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:05.070266 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1d23a063-2e8b-4017-a6b0-c7bc140e69f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68b47312172b4f879156c12cb646780f', 'request_id': 'req-1d23a063-2e8b-4017-a6b0-c7bc140e69f2'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:05.101140 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999206d-e531-4c56-82a1-b8f360272422 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:05.184954 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1d23a063-2e8b-4017-a6b0-c7bc140e69f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68b47312172b4f879156c12cb646780f', 'request_id': 'req-1d23a063-2e8b-4017-a6b0-c7bc140e69f2'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:05.185420 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfb556-56cc-4c9b-aec2-40eb82653253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:05.186182 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfb556-56cc-4c9b-aec2-40eb82653253 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:05.186776 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfb556-56cc-4c9b-aec2-40eb82653253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:05.187241 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfb556-56cc-4c9b-aec2-40eb82653253 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:05.188235 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfb556-56cc-4c9b-aec2-40eb82653253 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:05.196266 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfb556-56cc-4c9b-aec2-40eb82653253 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:05.208468 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1d23a063-2e8b-4017-a6b0-c7bc140e69f2 admin admin] The token cache is being invalidate because project 68b47312172b4f879156c12cb646780f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:12:05.208774 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1d23a063-2e8b-4017-a6b0-c7bc140e69f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:05.210664 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1d23a063-2e8b-4017-a6b0-c7bc140e69f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:05.214469 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 924/1848] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:12:04 2022] DELETE /identity/v3/projects/68b47312172b4f879156c12cb646780f => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:05.220575 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23a063-2e8b-4017-a6b0-c7bc140e69f2 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:05.224462 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1d23a063-2e8b-4017-a6b0-c7bc140e69f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:05.259335 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23a063-2e8b-4017-a6b0-c7bc140e69f2 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:05.268548 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982bec3-da1c-45a7-a2e1-8534822ed06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:05.269333 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982bec3-da1c-45a7-a2e1-8534822ed06d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:05.269720 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982bec3-da1c-45a7-a2e1-8534822ed06d admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:05.270090 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982bec3-da1c-45a7-a2e1-8534822ed06d admin admin] PATH_INFO: `/v3/users/437b60c02fe24c2982e64bb8c057bd09` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:05.272347 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982bec3-da1c-45a7-a2e1-8534822ed06d admin admin] RBAC: Authorizing `identity:delete_user(user_id=437b60c02fe24c2982e64bb8c057bd09)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:05.274827 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982bec3-da1c-45a7-a2e1-8534822ed06d admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:05.362269 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 925/1849] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:12:05 2022] POST /identity/v3/users => generated 290 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:12:05.373020 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfb556-56cc-4c9b-aec2-40eb82653253 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:05.373020 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-6ddfb556-56cc-4c9b-aec2-40eb82653253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:05.385031 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfb556-56cc-4c9b-aec2-40eb82653253 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:05.390945 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a4f61-341c-4255-8140-d93f664bf7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:05.391781 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a4f61-341c-4255-8140-d93f664bf7be admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:05.392275 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a4f61-341c-4255-8140-d93f664bf7be admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:05.392703 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a4f61-341c-4255-8140-d93f664bf7be admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:05.393522 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a4f61-341c-4255-8140-d93f664bf7be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:05.404105 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a4f61-341c-4255-8140-d93f664bf7be admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:05.413461 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 926/1850] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:12:05.414395 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a4f61-341c-4255-8140-d93f664bf7be admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:05.425882 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a4f61-341c-4255-8140-d93f664bf7be admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:05.430947 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f7b23-1399-4a83-85b3-12762996d1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:05.432221 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f7b23-1399-4a83-85b3-12762996d1df admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:05.432221 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f7b23-1399-4a83-85b3-12762996d1df admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:05.432221 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f7b23-1399-4a83-85b3-12762996d1df admin admin] PATH_INFO: `/v3/projects/c9f40fc6fada4ffaa563bf3e39bad75f/users/8bba53c1617246828916d11906329154/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:05.491527 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f7b23-1399-4a83-85b3-12762996d1df admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9f40fc6fada4ffaa563bf3e39bad75f, user_id=8bba53c1617246828916d11906329154, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:05.502284 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f7b23-1399-4a83-85b3-12762996d1df admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:05.596003 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 927/1851] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:12:05 2022] PUT /identity/v3/projects/c9f40fc6fada4ffaa563bf3e39bad75f/users/8bba53c1617246828916d11906329154/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:05.600649 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f7b23-1399-4a83-85b3-12762996d1df admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:05.626088 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4982bec3-da1c-45a7-a2e1-8534822ed06d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '437b60c02fe24c2982e64bb8c057bd09'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:05.692566 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f7b23-1399-4a83-85b3-12762996d1df admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:05.699203 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463af9bd-bc2d-47e3-bf40-91d83f2f8571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:05.699665 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463af9bd-bc2d-47e3-bf40-91d83f2f8571 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:05.699881 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463af9bd-bc2d-47e3-bf40-91d83f2f8571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:05.700199 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463af9bd-bc2d-47e3-bf40-91d83f2f8571 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:05.700861 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463af9bd-bc2d-47e3-bf40-91d83f2f8571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:05.702612 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463af9bd-bc2d-47e3-bf40-91d83f2f8571 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:05.715737 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 928/1852] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:12:05.720446 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463af9bd-bc2d-47e3-bf40-91d83f2f8571 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:05.735665 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463af9bd-bc2d-47e3-bf40-91d83f2f8571 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:05.736553 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4982bec3-da1c-45a7-a2e1-8534822ed06d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '437b60c02fe24c2982e64bb8c057bd09'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:05.742503 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ea3c8-30e8-4e05-a0aa-31fd87c5f2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:05.742503 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ea3c8-30e8-4e05-a0aa-31fd87c5f2af admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:05.742503 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ea3c8-30e8-4e05-a0aa-31fd87c5f2af admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:05.742503 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ea3c8-30e8-4e05-a0aa-31fd87c5f2af admin admin] PATH_INFO: `/v3/projects/c9f40fc6fada4ffaa563bf3e39bad75f/users/8bba53c1617246828916d11906329154/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:05.744488 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ea3c8-30e8-4e05-a0aa-31fd87c5f2af admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9f40fc6fada4ffaa563bf3e39bad75f, user_id=8bba53c1617246828916d11906329154, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:05.768202 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ea3c8-30e8-4e05-a0aa-31fd87c5f2af admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:05.777956 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4982bec3-da1c-45a7-a2e1-8534822ed06d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '437b60c02fe24c2982e64bb8c057bd09'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:05.790705 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4982bec3-da1c-45a7-a2e1-8534822ed06d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '437b60c02fe24c2982e64bb8c057bd09'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:05.793049 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4982bec3-da1c-45a7-a2e1-8534822ed06d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '437b60c02fe24c2982e64bb8c057bd09'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:05.804532 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 925/1854] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:12:05 2022] DELETE /identity/v3/users/437b60c02fe24c2982e64bb8c057bd09 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:05.804532 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982bec3-da1c-45a7-a2e1-8534822ed06d admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:05.804955 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 929/1854] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:12:05 2022] PUT /identity/v3/projects/c9f40fc6fada4ffaa563bf3e39bad75f/users/8bba53c1617246828916d11906329154/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:12:05.809544 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c869b9-bfad-4870-8044-899ef0ee04e9 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:05.809544 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c869b9-bfad-4870-8044-899ef0ee04e9 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:05.809544 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c869b9-bfad-4870-8044-899ef0ee04e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:05.812030 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4982bec3-da1c-45a7-a2e1-8534822ed06d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:05.899330 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-33c869b9-bfad-4870-8044-899ef0ee04e9 None None] MFA Rules not processed for user `8bba53c1617246828916d11906329154`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:05.901076 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-33c869b9-bfad-4870-8044-899ef0ee04e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:05.963732 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982bec3-da1c-45a7-a2e1-8534822ed06d admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:05.970598 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03d0ff-880d-479d-bccf-61d65993f5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:05.971382 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03d0ff-880d-479d-bccf-61d65993f5c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:05.971809 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03d0ff-880d-479d-bccf-61d65993f5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:05.972243 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03d0ff-880d-479d-bccf-61d65993f5c6 admin admin] PATH_INFO: `/v3/projects/2e525ad150b04328bd188026ba2c4456` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:05.973642 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03d0ff-880d-479d-bccf-61d65993f5c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e525ad150b04328bd188026ba2c4456)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:05.976304 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03d0ff-880d-479d-bccf-61d65993f5c6 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:06.009914 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 930/1855] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:05 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:12:06.022912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c869b9-bfad-4870-8044-899ef0ee04e9 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:06.024335 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-33c869b9-bfad-4870-8044-899ef0ee04e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:06.088091 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c869b9-bfad-4870-8044-899ef0ee04e9 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:06.093371 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac90c0-8476-46ba-862e-660d651218da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:06.094236 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac90c0-8476-46ba-862e-660d651218da service cinder] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:06.094500 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac90c0-8476-46ba-862e-660d651218da service cinder] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:06.094835 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac90c0-8476-46ba-862e-660d651218da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:06.107017 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac90c0-8476-46ba-862e-660d651218da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:06.108686 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac90c0-8476-46ba-862e-660d651218da service cinder] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:06.119298 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 931/1856] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:12:06 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:12:06.196177 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-dd03d0ff-880d-479d-bccf-61d65993f5c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e525ad150b04328bd188026ba2c4456', 'request_id': 'req-dd03d0ff-880d-479d-bccf-61d65993f5c6'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:06.203556 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-dd03d0ff-880d-479d-bccf-61d65993f5c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e525ad150b04328bd188026ba2c4456', 'request_id': 'req-dd03d0ff-880d-479d-bccf-61d65993f5c6'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:06.312858 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-dd03d0ff-880d-479d-bccf-61d65993f5c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e525ad150b04328bd188026ba2c4456', 'request_id': 'req-dd03d0ff-880d-479d-bccf-61d65993f5c6'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:06.313068 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:06.333731 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-dd03d0ff-880d-479d-bccf-61d65993f5c6 admin admin] The token cache is being invalidate because project 2e525ad150b04328bd188026ba2c4456 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:12:06.334083 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-dd03d0ff-880d-479d-bccf-61d65993f5c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:06.338412 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-dd03d0ff-880d-479d-bccf-61d65993f5c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:06.344799 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 926/1857] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:12:05 2022] DELETE /identity/v3/projects/2e525ad150b04328bd188026ba2c4456 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:06.347332 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3967137-384e-4aa4-981b-dfdb2937b94d None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:06.347831 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3967137-384e-4aa4-981b-dfdb2937b94d None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:06.355833 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3967137-384e-4aa4-981b-dfdb2937b94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:06.377577 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-c3967137-384e-4aa4-981b-dfdb2937b94d None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:06.384682 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-c3967137-384e-4aa4-981b-dfdb2937b94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:06.478477 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 932/1858] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:12:06.486476 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d571b-2cf3-4146-aeda-5d0bf14a7fb8 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:06.486769 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d571b-2cf3-4146-aeda-5d0bf14a7fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:06.487081 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d571b-2cf3-4146-aeda-5d0bf14a7fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:06.508387 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-023d571b-2cf3-4146-aeda-5d0bf14a7fb8 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:06.509777 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-023d571b-2cf3-4146-aeda-5d0bf14a7fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:06.512148 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3967137-384e-4aa4-981b-dfdb2937b94d None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:06.516238 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-c3967137-384e-4aa4-981b-dfdb2937b94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:06.521732 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 927/1859] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:12:06.523187 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d571b-2cf3-4146-aeda-5d0bf14a7fb8 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:06.533776 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d571b-2cf3-4146-aeda-5d0bf14a7fb8 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:06.539288 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c083c9-7ba9-4de4-b571-46b526fa725a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:06.540566 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c083c9-7ba9-4de4-b571-46b526fa725a admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:06.540924 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c083c9-7ba9-4de4-b571-46b526fa725a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:06.541515 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c083c9-7ba9-4de4-b571-46b526fa725a admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:06.541802 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c083c9-7ba9-4de4-b571-46b526fa725a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:12:06.542109 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c083c9-7ba9-4de4-b571-46b526fa725a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:06.544307 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c083c9-7ba9-4de4-b571-46b526fa725a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:06.557121 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 928/1860] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:12:06.561437 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c083c9-7ba9-4de4-b571-46b526fa725a admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:06.572306 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c083c9-7ba9-4de4-b571-46b526fa725a admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:06.578613 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82671a-80d6-4914-8c38-ae87496bf7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:06.579877 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82671a-80d6-4914-8c38-ae87496bf7ef admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:06.580208 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82671a-80d6-4914-8c38-ae87496bf7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:06.580491 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82671a-80d6-4914-8c38-ae87496bf7ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:06.581426 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82671a-80d6-4914-8c38-ae87496bf7ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:06.583066 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3967137-384e-4aa4-981b-dfdb2937b94d None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:06.583353 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82671a-80d6-4914-8c38-ae87496bf7ef admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:06.588171 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6781370-3809-4330-a26f-8c0b299be962 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:06.588798 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6781370-3809-4330-a26f-8c0b299be962 service cinder] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:06.589339 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6781370-3809-4330-a26f-8c0b299be962 service cinder] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:06.589466 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6781370-3809-4330-a26f-8c0b299be962 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:06.593220 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-e6781370-3809-4330-a26f-8c0b299be962 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:06.661108 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6781370-3809-4330-a26f-8c0b299be962 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:06.665204 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6781370-3809-4330-a26f-8c0b299be962 service cinder] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:06.680655 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 933/1861] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:12:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:12:06.681823 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6781370-3809-4330-a26f-8c0b299be962 service cinder] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:06.684422 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-e6781370-3809-4330-a26f-8c0b299be962 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:06.707324 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6781370-3809-4330-a26f-8c0b299be962 service cinder] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:06.719132 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b733a9a0-b4c9-42d9-9579-d332a29aeae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:06.720705 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733a9a0-b4c9-42d9-9579-d332a29aeae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:06.720705 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733a9a0-b4c9-42d9-9579-d332a29aeae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:06.720705 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733a9a0-b4c9-42d9-9579-d332a29aeae2 admin admin] PATH_INFO: `/v3/projects/d8a59394bab94ed59ca9bd43390bd3ca` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:06.721143 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 929/1862] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:12:06 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:12:06.725096 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82671a-80d6-4914-8c38-ae87496bf7ef admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:06.725263 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b733a9a0-b4c9-42d9-9579-d332a29aeae2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8a59394bab94ed59ca9bd43390bd3ca)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:06.727384 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b733a9a0-b4c9-42d9-9579-d332a29aeae2 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:06.843784 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82671a-80d6-4914-8c38-ae87496bf7ef admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:06.850064 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d194cd-698d-4885-a152-c7e04ce59c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:06.851357 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d194cd-698d-4885-a152-c7e04ce59c93 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:06.851653 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d194cd-698d-4885-a152-c7e04ce59c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:06.851934 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d194cd-698d-4885-a152-c7e04ce59c93 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:06.852625 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d194cd-698d-4885-a152-c7e04ce59c93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:06.854895 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d194cd-698d-4885-a152-c7e04ce59c93 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:06.904768 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-b733a9a0-b4c9-42d9-9579-d332a29aeae2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8a59394bab94ed59ca9bd43390bd3ca', 'request_id': 'req-b733a9a0-b4c9-42d9-9579-d332a29aeae2'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:06.974294 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-b733a9a0-b4c9-42d9-9579-d332a29aeae2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8a59394bab94ed59ca9bd43390bd3ca', 'request_id': 'req-b733a9a0-b4c9-42d9-9579-d332a29aeae2'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:06.982654 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 930/1863] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:12:06 2022] POST /identity/v3/users => generated 292 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:12:06.989345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d194cd-698d-4885-a152-c7e04ce59c93 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:06.991152 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-b733a9a0-b4c9-42d9-9579-d332a29aeae2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8a59394bab94ed59ca9bd43390bd3ca', 'request_id': 'req-b733a9a0-b4c9-42d9-9579-d332a29aeae2'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:07.006769 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d194cd-698d-4885-a152-c7e04ce59c93 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:07.015775 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-b733a9a0-b4c9-42d9-9579-d332a29aeae2 admin admin] The token cache is being invalidate because project d8a59394bab94ed59ca9bd43390bd3ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:12:07.016277 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-b733a9a0-b4c9-42d9-9579-d332a29aeae2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:07.016851 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-b733a9a0-b4c9-42d9-9579-d332a29aeae2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:07.018405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 934/1864] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:12:06 2022] DELETE /identity/v3/projects/d8a59394bab94ed59ca9bd43390bd3ca => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:07.024959 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db69dd6-de98-469e-a900-606e3ec85a88 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:07.025484 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db69dd6-de98-469e-a900-606e3ec85a88 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:07.025871 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db69dd6-de98-469e-a900-606e3ec85a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:07.062863 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-1db69dd6-de98-469e-a900-606e3ec85a88 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:07.062863 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-1db69dd6-de98-469e-a900-606e3ec85a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:07.082462 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6fcae-50c1-45e1-84d7-66d910667e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:07.083168 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6fcae-50c1-45e1-84d7-66d910667e6f admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:07.083556 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6fcae-50c1-45e1-84d7-66d910667e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:07.083933 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6fcae-50c1-45e1-84d7-66d910667e6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:07.085474 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6fcae-50c1-45e1-84d7-66d910667e6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:07.087230 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6fcae-50c1-45e1-84d7-66d910667e6f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:07.100248 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 931/1865] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:12:07.103364 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6fcae-50c1-45e1-84d7-66d910667e6f admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:07.105140 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a9d6fcae-50c1-45e1-84d7-66d910667e6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:07.128538 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6fcae-50c1-45e1-84d7-66d910667e6f admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:07.135114 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16daa55-b6fa-4378-b431-a81485c7d17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:07.135791 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16daa55-b6fa-4378-b431-a81485c7d17d admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:07.136148 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16daa55-b6fa-4378-b431-a81485c7d17d admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:07.136442 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16daa55-b6fa-4378-b431-a81485c7d17d admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:07.137094 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16daa55-b6fa-4378-b431-a81485c7d17d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:07.138741 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16daa55-b6fa-4378-b431-a81485c7d17d admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:07.144197 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 935/1866] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:12:07.145126 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db69dd6-de98-469e-a900-606e3ec85a88 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:07.146539 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-1db69dd6-de98-469e-a900-606e3ec85a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:07.157397 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 932/1867] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:12:07.157397 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb122b4-016b-43d3-9211-c889daf42bdc None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:07.157397 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb122b4-016b-43d3-9211-c889daf42bdc None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:07.157397 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb122b4-016b-43d3-9211-c889daf42bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:07.177559 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-5fb122b4-016b-43d3-9211-c889daf42bdc None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:07.179403 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5fb122b4-016b-43d3-9211-c889daf42bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:07.187586 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 933/1868] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:12:07.188944 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb122b4-016b-43d3-9211-c889daf42bdc None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:07.197320 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:07.201217 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb122b4-016b-43d3-9211-c889daf42bdc None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:07.206557 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b43a5-ad96-473d-bc22-f923a5431c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:07.215734 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b43a5-ad96-473d-bc22-f923a5431c31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:07.215734 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b43a5-ad96-473d-bc22-f923a5431c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:07.215734 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b43a5-ad96-473d-bc22-f923a5431c31 admin admin] PATH_INFO: `/v3/projects/760f117e45f845ca94401b98e0270860/users/56a2ac5de83a43f68e8d70f843d6b0a3/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:07.215969 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db69dd6-de98-469e-a900-606e3ec85a88 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:07.215969 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa75fc-d8ba-4fcb-9435-90716bff490c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:07.215969 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa75fc-d8ba-4fcb-9435-90716bff490c service cinder] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:07.215969 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa75fc-d8ba-4fcb-9435-90716bff490c service cinder] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:07.216282 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa75fc-d8ba-4fcb-9435-90716bff490c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:07.217851 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-e8fa75fc-d8ba-4fcb-9435-90716bff490c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:07.224082 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b43a5-ad96-473d-bc22-f923a5431c31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=760f117e45f845ca94401b98e0270860, user_id=56a2ac5de83a43f68e8d70f843d6b0a3, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:07.227703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b43a5-ad96-473d-bc22-f923a5431c31 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:07.287094 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fa75fc-d8ba-4fcb-9435-90716bff490c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:07.289117 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fa75fc-d8ba-4fcb-9435-90716bff490c service cinder] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:07.298738 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 936/1869] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:12:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:12:07.299528 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa75fc-d8ba-4fcb-9435-90716bff490c service cinder] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:07.309907 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa75fc-d8ba-4fcb-9435-90716bff490c service cinder] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:07.314647 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b387239-fe81-40a3-8c50-115241383e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:07.315188 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b387239-fe81-40a3-8c50-115241383e69 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:07.315469 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b387239-fe81-40a3-8c50-115241383e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:07.315744 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b387239-fe81-40a3-8c50-115241383e69 admin admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:07.316418 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b387239-fe81-40a3-8c50-115241383e69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:12:07.316724 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b387239-fe81-40a3-8c50-115241383e69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:07.318310 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b387239-fe81-40a3-8c50-115241383e69 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:07.332073 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 937/1870] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:12:07.337101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b387239-fe81-40a3-8c50-115241383e69 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:07.349917 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b387239-fe81-40a3-8c50-115241383e69 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:07.359174 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 934/1871] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:12:07 2022] PUT /identity/v3/projects/760f117e45f845ca94401b98e0270860/users/56a2ac5de83a43f68e8d70f843d6b0a3/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:07.364631 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d94c7-6105-4748-875b-e42e445090be None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:07.365006 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d94c7-6105-4748-875b-e42e445090be None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:07.365368 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d94c7-6105-4748-875b-e42e445090be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:07.393766 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-b05d94c7-6105-4748-875b-e42e445090be None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:07.395720 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b05d94c7-6105-4748-875b-e42e445090be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:07.436430 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f1eee-6b98-4e01-8ef9-870f5e6a9713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:07.437203 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f1eee-6b98-4e01-8ef9-870f5e6a9713 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:07.437595 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f1eee-6b98-4e01-8ef9-870f5e6a9713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:07.437964 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f1eee-6b98-4e01-8ef9-870f5e6a9713 admin admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:07.438790 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f1eee-6b98-4e01-8ef9-870f5e6a9713 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:07.441068 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f1eee-6b98-4e01-8ef9-870f5e6a9713 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:07.477287 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 935/1872] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:12:07.486958 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d94c7-6105-4748-875b-e42e445090be None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:07.488424 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b05d94c7-6105-4748-875b-e42e445090be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:07.554209 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 938/1873] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:12:07 2022] POST /identity/v3/projects => generated 373 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:12:07.569926 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f1eee-6b98-4e01-8ef9-870f5e6a9713 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:07.575392 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d94c7-6105-4748-875b-e42e445090be None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:07.665414 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08643ea0-0c09-47b6-aad5-2752694508a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:07.669326 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08643ea0-0c09-47b6-aad5-2752694508a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:07.669749 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08643ea0-0c09-47b6-aad5-2752694508a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:07.670037 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08643ea0-0c09-47b6-aad5-2752694508a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:07.699310 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f1eee-6b98-4e01-8ef9-870f5e6a9713 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:07.705158 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f4741-063f-4b19-9da8-5f8da9b6d8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:07.705158 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f4741-063f-4b19-9da8-5f8da9b6d8fa admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:07.707215 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f4741-063f-4b19-9da8-5f8da9b6d8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:07.707215 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f4741-063f-4b19-9da8-5f8da9b6d8fa admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:07.707215 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f4741-063f-4b19-9da8-5f8da9b6d8fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:07.708803 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f4741-063f-4b19-9da8-5f8da9b6d8fa admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:07.746298 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08643ea0-0c09-47b6-aad5-2752694508a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:07.747743 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08643ea0-0c09-47b6-aad5-2752694508a0 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:07.767760 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 936/1874] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:12:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:12:07.768942 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08643ea0-0c09-47b6-aad5-2752694508a0 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:07.770477 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-08643ea0-0c09-47b6-aad5-2752694508a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:07.783729 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08643ea0-0c09-47b6-aad5-2752694508a0 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:07.789681 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44568c2e-cfb1-4f4f-be79-1ad049a248f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:07.790354 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44568c2e-cfb1-4f4f-be79-1ad049a248f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:07.790637 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44568c2e-cfb1-4f4f-be79-1ad049a248f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:07.790913 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44568c2e-cfb1-4f4f-be79-1ad049a248f7 admin admin] PATH_INFO: `/v3/users/a4861b40c12b485f8c3decca427bdcd8` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:07.792049 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44568c2e-cfb1-4f4f-be79-1ad049a248f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4861b40c12b485f8c3decca427bdcd8)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:07.794305 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44568c2e-cfb1-4f4f-be79-1ad049a248f7 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:07.816009 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 939/1875] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:12:07 2022] POST /identity/v3/users => generated 287 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:12:07.820247 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f4741-063f-4b19-9da8-5f8da9b6d8fa admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:07.831825 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f4741-063f-4b19-9da8-5f8da9b6d8fa admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:07.836826 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76324673-96ab-4317-8019-58fc86884cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:07.837438 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76324673-96ab-4317-8019-58fc86884cca admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:07.837717 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76324673-96ab-4317-8019-58fc86884cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:07.837990 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76324673-96ab-4317-8019-58fc86884cca admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:07.838669 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76324673-96ab-4317-8019-58fc86884cca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:07.840390 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76324673-96ab-4317-8019-58fc86884cca admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:07.851598 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 940/1876] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:12:07.881517 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76324673-96ab-4317-8019-58fc86884cca admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:07.891504 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76324673-96ab-4317-8019-58fc86884cca admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:07.896217 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497a324-dc41-4403-bb49-33abf7c34664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:07.896835 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497a324-dc41-4403-bb49-33abf7c34664 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:07.897109 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497a324-dc41-4403-bb49-33abf7c34664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:07.897389 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497a324-dc41-4403-bb49-33abf7c34664 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:07.898028 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6497a324-dc41-4403-bb49-33abf7c34664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:07.899607 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6497a324-dc41-4403-bb49-33abf7c34664 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:07.910819 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 941/1877] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:12:07.915497 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497a324-dc41-4403-bb49-33abf7c34664 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:07.930127 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497a324-dc41-4403-bb49-33abf7c34664 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:07.934875 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5610ee-9493-45de-bc16-6752fd8b8f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:07.935599 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5610ee-9493-45de-bc16-6752fd8b8f01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:07.935886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5610ee-9493-45de-bc16-6752fd8b8f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:07.936204 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5610ee-9493-45de-bc16-6752fd8b8f01 admin admin] PATH_INFO: `/v3/projects/7ec5d6482076465888cd6fa4c4006eba/users/49d0f1cd9e194018b53b5d555ae2e121/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:07.951259 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5610ee-9493-45de-bc16-6752fd8b8f01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ec5d6482076465888cd6fa4c4006eba, user_id=49d0f1cd9e194018b53b5d555ae2e121, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:07.954022 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5610ee-9493-45de-bc16-6752fd8b8f01 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:08.035554 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-44568c2e-cfb1-4f4f-be79-1ad049a248f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4861b40c12b485f8c3decca427bdcd8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:08.093572 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 942/1878] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:12:07 2022] PUT /identity/v3/projects/7ec5d6482076465888cd6fa4c4006eba/users/49d0f1cd9e194018b53b5d555ae2e121/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:08.105583 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c453e-b22d-4d4b-8d29-e4eddda3c05d None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:08.105968 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c453e-b22d-4d4b-8d29-e4eddda3c05d None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:08.106346 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c453e-b22d-4d4b-8d29-e4eddda3c05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:08.133767 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-44568c2e-cfb1-4f4f-be79-1ad049a248f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4861b40c12b485f8c3decca427bdcd8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:08.139272 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-554c453e-b22d-4d4b-8d29-e4eddda3c05d None None] MFA Rules not processed for user `49d0f1cd9e194018b53b5d555ae2e121`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:08.148312 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-554c453e-b22d-4d4b-8d29-e4eddda3c05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:08.152475 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-44568c2e-cfb1-4f4f-be79-1ad049a248f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4861b40c12b485f8c3decca427bdcd8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:08.162037 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-44568c2e-cfb1-4f4f-be79-1ad049a248f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4861b40c12b485f8c3decca427bdcd8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:08.162932 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-44568c2e-cfb1-4f4f-be79-1ad049a248f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4861b40c12b485f8c3decca427bdcd8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:08.175369 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 937/1879] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:12:07 2022] DELETE /identity/v3/users/a4861b40c12b485f8c3decca427bdcd8 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:08.181347 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8dc9df-8d1e-4691-aaad-eb4235a81d57 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:08.182974 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8dc9df-8d1e-4691-aaad-eb4235a81d57 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:08.183530 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8dc9df-8d1e-4691-aaad-eb4235a81d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:08.221173 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-2e8dc9df-8d1e-4691-aaad-eb4235a81d57 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:08.221173 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2e8dc9df-8d1e-4691-aaad-eb4235a81d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:08.257253 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 943/1880] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:12:08.271210 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c453e-b22d-4d4b-8d29-e4eddda3c05d None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:08.273359 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-554c453e-b22d-4d4b-8d29-e4eddda3c05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:08.302537 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 938/1881] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:12:08.313423 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8dc9df-8d1e-4691-aaad-eb4235a81d57 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:08.314780 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2e8dc9df-8d1e-4691-aaad-eb4235a81d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:08.355460 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c453e-b22d-4d4b-8d29-e4eddda3c05d None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:08.382699 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8dc9df-8d1e-4691-aaad-eb4235a81d57 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:08.387539 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896dd10-ac05-4da9-b183-f04ef390df7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:08.388210 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896dd10-ac05-4da9-b183-f04ef390df7c service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:08.388469 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896dd10-ac05-4da9-b183-f04ef390df7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:08.388796 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896dd10-ac05-4da9-b183-f04ef390df7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:08.399436 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8896dd10-ac05-4da9-b183-f04ef390df7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:08.406174 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8896dd10-ac05-4da9-b183-f04ef390df7c service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:08.410683 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d18e9-857d-4614-a2d2-9a312c8bf3a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:08.411614 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d18e9-857d-4614-a2d2-9a312c8bf3a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:08.411979 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d18e9-857d-4614-a2d2-9a312c8bf3a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:08.412377 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d18e9-857d-4614-a2d2-9a312c8bf3a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:08.415483 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 939/1882] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:12:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:12:08.482953 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d18e9-857d-4614-a2d2-9a312c8bf3a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:08.485314 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d18e9-857d-4614-a2d2-9a312c8bf3a4 service cinder] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:08.498102 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 944/1883] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:12:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:12:09.062909 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896dd10-ac05-4da9-b183-f04ef390df7c service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:09.065987 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8896dd10-ac05-4da9-b183-f04ef390df7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:09.079675 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896dd10-ac05-4da9-b183-f04ef390df7c service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:09.082637 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:09.085588 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c18f5-32ae-437e-b0f4-ad58d5e916ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:09.097321 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c18f5-32ae-437e-b0f4-ad58d5e916ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:09.097622 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c18f5-32ae-437e-b0f4-ad58d5e916ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:09.097983 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c18f5-32ae-437e-b0f4-ad58d5e916ce admin admin] PATH_INFO: `/v3/projects/de6b681e891d48b087dfb9ff162ec967` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:09.099854 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c18f5-32ae-437e-b0f4-ad58d5e916ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=de6b681e891d48b087dfb9ff162ec967)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:09.111869 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c18f5-32ae-437e-b0f4-ad58d5e916ce admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:09.250383 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f00c18f5-32ae-437e-b0f4-ad58d5e916ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de6b681e891d48b087dfb9ff162ec967', 'request_id': 'req-f00c18f5-32ae-437e-b0f4-ad58d5e916ce'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:09.259914 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f00c18f5-32ae-437e-b0f4-ad58d5e916ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de6b681e891d48b087dfb9ff162ec967', 'request_id': 'req-f00c18f5-32ae-437e-b0f4-ad58d5e916ce'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:09.446566 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f00c18f5-32ae-437e-b0f4-ad58d5e916ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de6b681e891d48b087dfb9ff162ec967', 'request_id': 'req-f00c18f5-32ae-437e-b0f4-ad58d5e916ce'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:09.468487 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f00c18f5-32ae-437e-b0f4-ad58d5e916ce admin admin] The token cache is being invalidate because project de6b681e891d48b087dfb9ff162ec967 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:12:09.468783 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f00c18f5-32ae-437e-b0f4-ad58d5e916ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:09.469702 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f00c18f5-32ae-437e-b0f4-ad58d5e916ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:09.471638 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 940/1884] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:12:09 2022] DELETE /identity/v3/projects/de6b681e891d48b087dfb9ff162ec967 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:12:09.482314 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d18e9-857d-4614-a2d2-9a312c8bf3a4 service cinder] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:09.501972 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d18e9-857d-4614-a2d2-9a312c8bf3a4 service cinder] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:09.564875 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ebd692-ad99-425d-b4cc-6e516a757bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:09.565521 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebd692-ad99-425d-b4cc-6e516a757bd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:09.565820 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebd692-ad99-425d-b4cc-6e516a757bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:09.566099 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebd692-ad99-425d-b4cc-6e516a757bd8 admin admin] PATH_INFO: `/v3/users/7015ba412ba44e96a2ffe38511b13d95` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:09.567260 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ebd692-ad99-425d-b4cc-6e516a757bd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7015ba412ba44e96a2ffe38511b13d95)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:09.569754 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ebd692-ad99-425d-b4cc-6e516a757bd8 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:09.792279 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea66db-5c89-4a2e-9e2e-68453013fe93 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:09.793204 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea66db-5c89-4a2e-9e2e-68453013fe93 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:09.793204 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea66db-5c89-4a2e-9e2e-68453013fe93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:09.802661 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-17ebd692-ad99-425d-b4cc-6e516a757bd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7015ba412ba44e96a2ffe38511b13d95'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:09.823196 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-1bea66db-5c89-4a2e-9e2e-68453013fe93 None None] MFA Rules not processed for user `56a2ac5de83a43f68e8d70f843d6b0a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:09.824523 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1bea66db-5c89-4a2e-9e2e-68453013fe93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:09.896841 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 941/1885] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:12:09.911813 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea66db-5c89-4a2e-9e2e-68453013fe93 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:09.911958 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-17ebd692-ad99-425d-b4cc-6e516a757bd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7015ba412ba44e96a2ffe38511b13d95'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:09.912079 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1bea66db-5c89-4a2e-9e2e-68453013fe93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:09.927526 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-17ebd692-ad99-425d-b4cc-6e516a757bd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7015ba412ba44e96a2ffe38511b13d95'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:09.929039 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-17ebd692-ad99-425d-b4cc-6e516a757bd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7015ba412ba44e96a2ffe38511b13d95'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:09.939675 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-17ebd692-ad99-425d-b4cc-6e516a757bd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7015ba412ba44e96a2ffe38511b13d95'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:09.950051 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 945/1886] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:12:09 2022] DELETE /identity/v3/users/7015ba412ba44e96a2ffe38511b13d95 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:09.994749 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea66db-5c89-4a2e-9e2e-68453013fe93 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:10.070483 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8906e6c9-38d9-402a-87b5-2e352ff8b72b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:10.071161 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906e6c9-38d9-402a-87b5-2e352ff8b72b service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:10.071440 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906e6c9-38d9-402a-87b5-2e352ff8b72b service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:10.071757 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906e6c9-38d9-402a-87b5-2e352ff8b72b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:10.073676 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8906e6c9-38d9-402a-87b5-2e352ff8b72b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:10.137423 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8906e6c9-38d9-402a-87b5-2e352ff8b72b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:10.138873 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8906e6c9-38d9-402a-87b5-2e352ff8b72b service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:10.147787 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 942/1887] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:12:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:12:10.590922 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ebd692-ad99-425d-b4cc-6e516a757bd8 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:10.592390 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-17ebd692-ad99-425d-b4cc-6e516a757bd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:10.694547 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ebd692-ad99-425d-b4cc-6e516a757bd8 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:10.700227 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01050cc6-486e-49f2-a552-68b2723bba2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:10.701049 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01050cc6-486e-49f2-a552-68b2723bba2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:10.704256 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01050cc6-486e-49f2-a552-68b2723bba2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:10.704256 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01050cc6-486e-49f2-a552-68b2723bba2f admin admin] PATH_INFO: `/v3/projects/80d93d556dff4a3a98a925ecab374f88` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:10.704776 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01050cc6-486e-49f2-a552-68b2723bba2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=80d93d556dff4a3a98a925ecab374f88)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:10.707004 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01050cc6-486e-49f2-a552-68b2723bba2f admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:10.851030 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-01050cc6-486e-49f2-a552-68b2723bba2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80d93d556dff4a3a98a925ecab374f88', 'request_id': 'req-01050cc6-486e-49f2-a552-68b2723bba2f'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:10.862688 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:10.911105 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-01050cc6-486e-49f2-a552-68b2723bba2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80d93d556dff4a3a98a925ecab374f88', 'request_id': 'req-01050cc6-486e-49f2-a552-68b2723bba2f'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:10.919028 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-01050cc6-486e-49f2-a552-68b2723bba2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80d93d556dff4a3a98a925ecab374f88', 'request_id': 'req-01050cc6-486e-49f2-a552-68b2723bba2f'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:10.933204 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-01050cc6-486e-49f2-a552-68b2723bba2f admin admin] The token cache is being invalidate because project 80d93d556dff4a3a98a925ecab374f88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:12:10.933628 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-01050cc6-486e-49f2-a552-68b2723bba2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:10.934397 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-01050cc6-486e-49f2-a552-68b2723bba2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:10.936345 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 946/1888] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:12:10 2022] DELETE /identity/v3/projects/80d93d556dff4a3a98a925ecab374f88 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:10.940398 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8906e6c9-38d9-402a-87b5-2e352ff8b72b service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:10.952313 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8906e6c9-38d9-402a-87b5-2e352ff8b72b service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:11.009458 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124a7a2-738d-47bd-add3-cd41ef405f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:11.010263 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124a7a2-738d-47bd-add3-cd41ef405f1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:11.010548 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124a7a2-738d-47bd-add3-cd41ef405f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:11.010822 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124a7a2-738d-47bd-add3-cd41ef405f1c admin admin] PATH_INFO: `/v3/users/8c6985a4219d4e65895257ad2d3549b8` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:11.011925 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7124a7a2-738d-47bd-add3-cd41ef405f1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c6985a4219d4e65895257ad2d3549b8)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:11.013926 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7124a7a2-738d-47bd-add3-cd41ef405f1c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:11.204961 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:11.249015 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7124a7a2-738d-47bd-add3-cd41ef405f1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c6985a4219d4e65895257ad2d3549b8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:11.391049 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7124a7a2-738d-47bd-add3-cd41ef405f1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c6985a4219d4e65895257ad2d3549b8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:11.427030 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7124a7a2-738d-47bd-add3-cd41ef405f1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c6985a4219d4e65895257ad2d3549b8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:11.445220 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7124a7a2-738d-47bd-add3-cd41ef405f1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c6985a4219d4e65895257ad2d3549b8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:11.447667 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7124a7a2-738d-47bd-add3-cd41ef405f1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c6985a4219d4e65895257ad2d3549b8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:11.480196 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 943/1889] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:12:10 2022] DELETE /identity/v3/users/8c6985a4219d4e65895257ad2d3549b8 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:12.121450 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01050cc6-486e-49f2-a552-68b2723bba2f admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:12.128905 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-01050cc6-486e-49f2-a552-68b2723bba2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:12.151572 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01050cc6-486e-49f2-a552-68b2723bba2f admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:12.246519 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad69ab-6869-49d0-b8f6-fefe3185fa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:12.248554 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad69ab-6869-49d0-b8f6-fefe3185fa1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:12.248850 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad69ab-6869-49d0-b8f6-fefe3185fa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:12.249188 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad69ab-6869-49d0-b8f6-fefe3185fa1d admin admin] PATH_INFO: `/v3/projects/9a7d58f314624eba946bf7ed80178b43` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:12.251932 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad69ab-6869-49d0-b8f6-fefe3185fa1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a7d58f314624eba946bf7ed80178b43)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:12.255145 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad69ab-6869-49d0-b8f6-fefe3185fa1d admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:12.406310 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-54ad69ab-6869-49d0-b8f6-fefe3185fa1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a7d58f314624eba946bf7ed80178b43', 'request_id': 'req-54ad69ab-6869-49d0-b8f6-fefe3185fa1d'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:12.471100 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b9adc-178d-4b46-acee-ebd636e10a21 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:12.471896 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b9adc-178d-4b46-acee-ebd636e10a21 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:12.472216 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b9adc-178d-4b46-acee-ebd636e10a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:12.497401 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-845b9adc-178d-4b46-acee-ebd636e10a21 None None] MFA Rules not processed for user `56a2ac5de83a43f68e8d70f843d6b0a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:12.499077 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-845b9adc-178d-4b46-acee-ebd636e10a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:12.540190 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-54ad69ab-6869-49d0-b8f6-fefe3185fa1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a7d58f314624eba946bf7ed80178b43', 'request_id': 'req-54ad69ab-6869-49d0-b8f6-fefe3185fa1d'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:12.549336 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-54ad69ab-6869-49d0-b8f6-fefe3185fa1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a7d58f314624eba946bf7ed80178b43', 'request_id': 'req-54ad69ab-6869-49d0-b8f6-fefe3185fa1d'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:12.577213 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-54ad69ab-6869-49d0-b8f6-fefe3185fa1d admin admin] The token cache is being invalidate because project 9a7d58f314624eba946bf7ed80178b43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:12:12.577760 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-54ad69ab-6869-49d0-b8f6-fefe3185fa1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:12.578619 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-54ad69ab-6869-49d0-b8f6-fefe3185fa1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:12.580869 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 947/1890] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:12:12 2022] DELETE /identity/v3/projects/9a7d58f314624eba946bf7ed80178b43 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:12.585696 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 944/1891] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:12:12.590761 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c4e46-5dd3-40ed-9ad3-dc81ae324a31 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:12.643647 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c4e46-5dd3-40ed-9ad3-dc81ae324a31 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:12.643647 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c4e46-5dd3-40ed-9ad3-dc81ae324a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:12.643647 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-fe2c4e46-5dd3-40ed-9ad3-dc81ae324a31 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:12.643647 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-fe2c4e46-5dd3-40ed-9ad3-dc81ae324a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:12.716418 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 948/1892] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:12:12.722815 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24503762-6500-4c01-b681-bd0d594ea657 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:12.723148 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24503762-6500-4c01-b681-bd0d594ea657 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:12.723449 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24503762-6500-4c01-b681-bd0d594ea657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:12.744332 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-24503762-6500-4c01-b681-bd0d594ea657 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:12.745607 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-24503762-6500-4c01-b681-bd0d594ea657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:12.779786 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 945/1893] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:12:12.782791 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c4e46-5dd3-40ed-9ad3-dc81ae324a31 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:12.794885 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c4e46-5dd3-40ed-9ad3-dc81ae324a31 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:12.800226 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12622b-8f7d-4a97-8512-5902accd364b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:12.800972 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12622b-8f7d-4a97-8512-5902accd364b admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:12.801228 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12622b-8f7d-4a97-8512-5902accd364b admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:12.801552 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12622b-8f7d-4a97-8512-5902accd364b admin admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:12.802207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f12622b-8f7d-4a97-8512-5902accd364b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:12:12.802783 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f12622b-8f7d-4a97-8512-5902accd364b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:12.804375 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f12622b-8f7d-4a97-8512-5902accd364b admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:12.824704 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24503762-6500-4c01-b681-bd0d594ea657 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:12.828416 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 949/1894] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:12:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:12:12.836839 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24503762-6500-4c01-b681-bd0d594ea657 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:12.842139 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690e09c-25b3-4ed3-87a9-0fde98a9dde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:12.842852 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690e09c-25b3-4ed3-87a9-0fde98a9dde1 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:12.843203 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690e09c-25b3-4ed3-87a9-0fde98a9dde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:12.843549 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690e09c-25b3-4ed3-87a9-0fde98a9dde1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:12.844603 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690e09c-25b3-4ed3-87a9-0fde98a9dde1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:12.846658 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690e09c-25b3-4ed3-87a9-0fde98a9dde1 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:13.046536 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12622b-8f7d-4a97-8512-5902accd364b admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:13.058154 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 946/1895] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:12:12 2022] POST /identity/v3/projects => generated 369 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:12:13.063136 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12622b-8f7d-4a97-8512-5902accd364b admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:13.142385 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2d026-bdb3-41eb-9fc9-cebbdea8aa82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:13.143359 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2d026-bdb3-41eb-9fc9-cebbdea8aa82 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:13.143741 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2d026-bdb3-41eb-9fc9-cebbdea8aa82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:13.144164 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2d026-bdb3-41eb-9fc9-cebbdea8aa82 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:13.145116 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d2d026-bdb3-41eb-9fc9-cebbdea8aa82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:13.149029 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d2d026-bdb3-41eb-9fc9-cebbdea8aa82 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:13.344685 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 950/1896] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:12:13 2022] POST /identity/v3/users => generated 285 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:12:13.350172 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690e09c-25b3-4ed3-87a9-0fde98a9dde1 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:13.358241 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:13.364018 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690e09c-25b3-4ed3-87a9-0fde98a9dde1 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:13.369668 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7588c-2cd6-4710-8a87-c0625cc8fdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:13.370246 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7588c-2cd6-4710-8a87-c0625cc8fdef admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:13.370600 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7588c-2cd6-4710-8a87-c0625cc8fdef admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:13.370870 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7588c-2cd6-4710-8a87-c0625cc8fdef admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:13.371541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e7588c-2cd6-4710-8a87-c0625cc8fdef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:13.373581 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e7588c-2cd6-4710-8a87-c0625cc8fdef admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:13.385536 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 947/1897] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:12:13.393519 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2d026-bdb3-41eb-9fc9-cebbdea8aa82 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:13.404859 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2d026-bdb3-41eb-9fc9-cebbdea8aa82 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:13.410249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9047b4f-8476-427b-96b8-f8472145ed80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:13.410869 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9047b4f-8476-427b-96b8-f8472145ed80 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:13.411189 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9047b4f-8476-427b-96b8-f8472145ed80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:13.411465 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9047b4f-8476-427b-96b8-f8472145ed80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:13.412294 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9047b4f-8476-427b-96b8-f8472145ed80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:13.419471 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9047b4f-8476-427b-96b8-f8472145ed80 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:13.425867 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 951/1898] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:12:13.430654 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7588c-2cd6-4710-8a87-c0625cc8fdef admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:13.442121 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7588c-2cd6-4710-8a87-c0625cc8fdef admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:13.447376 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf6814-f2c4-4a3b-8bba-b2b22c400969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:13.448047 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf6814-f2c4-4a3b-8bba-b2b22c400969 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:13.448381 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf6814-f2c4-4a3b-8bba-b2b22c400969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:13.448689 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf6814-f2c4-4a3b-8bba-b2b22c400969 admin admin] PATH_INFO: `/v3/projects/5be198aed6234248b119ae68e1642097/users/2f05fc3ff5a44539b76a57ca31b17308/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:13.463550 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf6814-f2c4-4a3b-8bba-b2b22c400969 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5be198aed6234248b119ae68e1642097, user_id=2f05fc3ff5a44539b76a57ca31b17308, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:13.466284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf6814-f2c4-4a3b-8bba-b2b22c400969 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:13.591978 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 948/1899] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:12:13 2022] PUT /identity/v3/projects/5be198aed6234248b119ae68e1642097/users/2f05fc3ff5a44539b76a57ca31b17308/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:13.596324 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41561a0b-ed81-414b-b013-c1817fb13232 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:13.596956 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41561a0b-ed81-414b-b013-c1817fb13232 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:13.597519 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41561a0b-ed81-414b-b013-c1817fb13232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:13.649433 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-41561a0b-ed81-414b-b013-c1817fb13232 None None] MFA Rules not processed for user `2f05fc3ff5a44539b76a57ca31b17308`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:13.651433 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-41561a0b-ed81-414b-b013-c1817fb13232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:13.777439 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 952/1900] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:12:13.778437 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf6814-f2c4-4a3b-8bba-b2b22c400969 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:13.780212 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-aebf6814-f2c4-4a3b-8bba-b2b22c400969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:13.921018 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf6814-f2c4-4a3b-8bba-b2b22c400969 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:13.925263 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844864f0-0080-4cce-9285-462eced7e3ff service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d0e8cc074b4e36acc2162aebeac169', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:13.925933 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844864f0-0080-4cce-9285-462eced7e3ff service glance] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:13.926340 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844864f0-0080-4cce-9285-462eced7e3ff service glance] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:13.926647 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844864f0-0080-4cce-9285-462eced7e3ff service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:13.949796 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844864f0-0080-4cce-9285-462eced7e3ff service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:13.951388 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844864f0-0080-4cce-9285-462eced7e3ff service glance] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:13.961040 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 949/1901] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:12:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:12:14.294372 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:15.457512 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:16.097960 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41561a0b-ed81-414b-b013-c1817fb13232 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:16.099458 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-41561a0b-ed81-414b-b013-c1817fb13232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:16.173240 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41561a0b-ed81-414b-b013-c1817fb13232 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:16.180116 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccbf19-4046-419e-9a5b-79c7fd559df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:16.180116 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccbf19-4046-419e-9a5b-79c7fd559df5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:16.180116 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccbf19-4046-419e-9a5b-79c7fd559df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:16.180597 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccbf19-4046-419e-9a5b-79c7fd559df5 admin admin] PATH_INFO: `/v3/users/be32b01b46144d7794db524c63fc6d6e` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:16.181468 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ccbf19-4046-419e-9a5b-79c7fd559df5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be32b01b46144d7794db524c63fc6d6e)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:16.183464 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ccbf19-4046-419e-9a5b-79c7fd559df5 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:16.186119 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:16.551669 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-73ccbf19-4046-419e-9a5b-79c7fd559df5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be32b01b46144d7794db524c63fc6d6e'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:16.680539 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-73ccbf19-4046-419e-9a5b-79c7fd559df5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be32b01b46144d7794db524c63fc6d6e'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:16.694378 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-73ccbf19-4046-419e-9a5b-79c7fd559df5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be32b01b46144d7794db524c63fc6d6e'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:16.696100 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-73ccbf19-4046-419e-9a5b-79c7fd559df5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be32b01b46144d7794db524c63fc6d6e'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:16.703773 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-73ccbf19-4046-419e-9a5b-79c7fd559df5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be32b01b46144d7794db524c63fc6d6e'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:16.715570 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 953/1902] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:12:16 2022] DELETE /identity/v3/users/be32b01b46144d7794db524c63fc6d6e => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:16.717317 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56faca3c-0ab6-4381-8782-9f82b0d80443 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:16.718550 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56faca3c-0ab6-4381-8782-9f82b0d80443 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:16.718550 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56faca3c-0ab6-4381-8782-9f82b0d80443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:16.744906 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-56faca3c-0ab6-4381-8782-9f82b0d80443 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:16.746274 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-56faca3c-0ab6-4381-8782-9f82b0d80443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:16.818675 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 950/1903] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:12:16.831225 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccbf19-4046-419e-9a5b-79c7fd559df5 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:16.833629 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-73ccbf19-4046-419e-9a5b-79c7fd559df5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:16.899182 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccbf19-4046-419e-9a5b-79c7fd559df5 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:16.903275 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b8104-9ca7-444a-8ff0-88156be80425 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:16.904030 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b8104-9ca7-444a-8ff0-88156be80425 service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:16.904343 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b8104-9ca7-444a-8ff0-88156be80425 service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:16.904664 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b8104-9ca7-444a-8ff0-88156be80425 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:16.917183 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b8104-9ca7-444a-8ff0-88156be80425 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:16.918848 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b8104-9ca7-444a-8ff0-88156be80425 service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:16.932671 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 954/1904] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:12:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:12:17.837773 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56faca3c-0ab6-4381-8782-9f82b0d80443 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:17.839303 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-56faca3c-0ab6-4381-8782-9f82b0d80443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:17.852825 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56faca3c-0ab6-4381-8782-9f82b0d80443 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:17.860401 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649d683-952b-4812-8343-b87db5712dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:17.862309 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649d683-952b-4812-8343-b87db5712dd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:17.862787 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649d683-952b-4812-8343-b87db5712dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:17.863293 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649d683-952b-4812-8343-b87db5712dd8 admin admin] PATH_INFO: `/v3/projects/17c1c7a478cf489a93d0aa9fd5913c7b` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:17.864736 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649d683-952b-4812-8343-b87db5712dd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17c1c7a478cf489a93d0aa9fd5913c7b)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:17.875437 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649d683-952b-4812-8343-b87db5712dd8 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:18.075567 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:18.114120 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0649d683-952b-4812-8343-b87db5712dd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17c1c7a478cf489a93d0aa9fd5913c7b', 'request_id': 'req-0649d683-952b-4812-8343-b87db5712dd8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:18.121733 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0649d683-952b-4812-8343-b87db5712dd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17c1c7a478cf489a93d0aa9fd5913c7b', 'request_id': 'req-0649d683-952b-4812-8343-b87db5712dd8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:18.212419 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0649d683-952b-4812-8343-b87db5712dd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17c1c7a478cf489a93d0aa9fd5913c7b', 'request_id': 'req-0649d683-952b-4812-8343-b87db5712dd8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:18.231982 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0649d683-952b-4812-8343-b87db5712dd8 admin admin] The token cache is being invalidate because project 17c1c7a478cf489a93d0aa9fd5913c7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:12:18.232305 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0649d683-952b-4812-8343-b87db5712dd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:18.233117 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0649d683-952b-4812-8343-b87db5712dd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:18.236357 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 951/1905] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:12:17 2022] DELETE /identity/v3/projects/17c1c7a478cf489a93d0aa9fd5913c7b => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:12:18.244124 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b8104-9ca7-444a-8ff0-88156be80425 service neutron] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:18.254474 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b8104-9ca7-444a-8ff0-88156be80425 service neutron] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:18.314470 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e22205-bcb2-4311-8535-27ad6d68ff81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:18.318769 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e22205-bcb2-4311-8535-27ad6d68ff81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:18.318769 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e22205-bcb2-4311-8535-27ad6d68ff81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:18.318769 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e22205-bcb2-4311-8535-27ad6d68ff81 admin admin] PATH_INFO: `/v3/users/8bba53c1617246828916d11906329154` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:18.318769 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e22205-bcb2-4311-8535-27ad6d68ff81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bba53c1617246828916d11906329154)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:18.318769 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e22205-bcb2-4311-8535-27ad6d68ff81 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:18.724539 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-34e22205-bcb2-4311-8535-27ad6d68ff81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bba53c1617246828916d11906329154'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:18.845862 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-34e22205-bcb2-4311-8535-27ad6d68ff81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bba53c1617246828916d11906329154'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:18.855287 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-34e22205-bcb2-4311-8535-27ad6d68ff81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bba53c1617246828916d11906329154'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:18.856094 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-34e22205-bcb2-4311-8535-27ad6d68ff81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bba53c1617246828916d11906329154'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:18.867646 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-34e22205-bcb2-4311-8535-27ad6d68ff81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bba53c1617246828916d11906329154'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:18.880145 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 955/1906] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:12:18 2022] DELETE /identity/v3/users/8bba53c1617246828916d11906329154 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:19.306419 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:19.550804 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649d683-952b-4812-8343-b87db5712dd8 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:19.552340 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0649d683-952b-4812-8343-b87db5712dd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:19.566574 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649d683-952b-4812-8343-b87db5712dd8 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:19.643884 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e898e9-98f1-4cda-9dfb-0eb21e5f3d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:19.644723 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e898e9-98f1-4cda-9dfb-0eb21e5f3d25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:19.645267 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e898e9-98f1-4cda-9dfb-0eb21e5f3d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:19.645621 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e898e9-98f1-4cda-9dfb-0eb21e5f3d25 admin admin] PATH_INFO: `/v3/projects/c9f40fc6fada4ffaa563bf3e39bad75f` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:19.647124 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e898e9-98f1-4cda-9dfb-0eb21e5f3d25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9f40fc6fada4ffaa563bf3e39bad75f)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:19.649378 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e898e9-98f1-4cda-9dfb-0eb21e5f3d25 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:19.790529 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-89e898e9-98f1-4cda-9dfb-0eb21e5f3d25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9f40fc6fada4ffaa563bf3e39bad75f', 'request_id': 'req-89e898e9-98f1-4cda-9dfb-0eb21e5f3d25'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:19.796857 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-89e898e9-98f1-4cda-9dfb-0eb21e5f3d25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9f40fc6fada4ffaa563bf3e39bad75f', 'request_id': 'req-89e898e9-98f1-4cda-9dfb-0eb21e5f3d25'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:19.938683 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-89e898e9-98f1-4cda-9dfb-0eb21e5f3d25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9f40fc6fada4ffaa563bf3e39bad75f', 'request_id': 'req-89e898e9-98f1-4cda-9dfb-0eb21e5f3d25'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:19.951026 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-89e898e9-98f1-4cda-9dfb-0eb21e5f3d25 admin admin] The token cache is being invalidate because project c9f40fc6fada4ffaa563bf3e39bad75f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:12:19.951321 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-89e898e9-98f1-4cda-9dfb-0eb21e5f3d25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:19.951974 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-89e898e9-98f1-4cda-9dfb-0eb21e5f3d25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:19.964521 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 952/1907] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:12:19 2022] DELETE /identity/v3/projects/c9f40fc6fada4ffaa563bf3e39bad75f => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:19.967508 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897afa26-c2f5-4c17-a2d3-887caf00deca None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:19.968480 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897afa26-c2f5-4c17-a2d3-887caf00deca None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:19.968773 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897afa26-c2f5-4c17-a2d3-887caf00deca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:20.000886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-897afa26-c2f5-4c17-a2d3-887caf00deca None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:20.002858 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-897afa26-c2f5-4c17-a2d3-887caf00deca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:20.089531 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 956/1908] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:12:20.091322 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622ce8e-3e0c-4699-a15e-bb86c8506312 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:20.092284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622ce8e-3e0c-4699-a15e-bb86c8506312 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:20.092829 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622ce8e-3e0c-4699-a15e-bb86c8506312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:20.120047 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-4622ce8e-3e0c-4699-a15e-bb86c8506312 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:20.121777 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4622ce8e-3e0c-4699-a15e-bb86c8506312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:20.135904 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 953/1909] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:12:20.150539 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897afa26-c2f5-4c17-a2d3-887caf00deca None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:20.161479 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897afa26-c2f5-4c17-a2d3-887caf00deca None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:20.167213 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466d236-70f5-40eb-bec8-38ff1273bac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:20.167829 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466d236-70f5-40eb-bec8-38ff1273bac7 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:20.168552 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466d236-70f5-40eb-bec8-38ff1273bac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:20.168838 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466d236-70f5-40eb-bec8-38ff1273bac7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:20.169495 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9466d236-70f5-40eb-bec8-38ff1273bac7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:12:20.169829 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9466d236-70f5-40eb-bec8-38ff1273bac7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:20.173603 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9466d236-70f5-40eb-bec8-38ff1273bac7 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:20.189783 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 957/1910] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:12:20.193571 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622ce8e-3e0c-4699-a15e-bb86c8506312 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:20.204329 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622ce8e-3e0c-4699-a15e-bb86c8506312 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:20.211930 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27608a92-2876-4479-bb4c-07a925dd4d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:20.218371 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27608a92-2876-4479-bb4c-07a925dd4d72 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:20.218371 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27608a92-2876-4479-bb4c-07a925dd4d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:20.226415 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27608a92-2876-4479-bb4c-07a925dd4d72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:20.227362 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27608a92-2876-4479-bb4c-07a925dd4d72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:20.233302 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27608a92-2876-4479-bb4c-07a925dd4d72 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:20.492134 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 954/1911] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:12:20 2022] POST /identity/v3/projects => generated 381 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:12:20.492794 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466d236-70f5-40eb-bec8-38ff1273bac7 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:20.522705 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466d236-70f5-40eb-bec8-38ff1273bac7 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:20.587931 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b609c9-00b2-48b1-9417-321e06fb0a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:20.588566 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b609c9-00b2-48b1-9417-321e06fb0a31 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:20.588876 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b609c9-00b2-48b1-9417-321e06fb0a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:20.589152 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b609c9-00b2-48b1-9417-321e06fb0a31 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:20.590087 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b609c9-00b2-48b1-9417-321e06fb0a31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:20.591867 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b609c9-00b2-48b1-9417-321e06fb0a31 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:20.740052 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 958/1912] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:12:20 2022] POST /identity/v3/users => generated 291 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:12:20.745097 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27608a92-2876-4479-bb4c-07a925dd4d72 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:20.756465 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27608a92-2876-4479-bb4c-07a925dd4d72 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:20.762314 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c32bb-d00e-4ca4-b575-855d4f052bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:20.762992 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c32bb-d00e-4ca4-b575-855d4f052bbd admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:20.763257 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c32bb-d00e-4ca4-b575-855d4f052bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:20.763535 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c32bb-d00e-4ca4-b575-855d4f052bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:20.764222 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0c32bb-d00e-4ca4-b575-855d4f052bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:20.765892 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0c32bb-d00e-4ca4-b575-855d4f052bbd admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:20.779520 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 955/1913] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:12:20.780841 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b609c9-00b2-48b1-9417-321e06fb0a31 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:20.791245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b609c9-00b2-48b1-9417-321e06fb0a31 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:20.802989 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c5ee25-cf7e-4343-b714-78aa031f3cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:20.804201 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5ee25-cf7e-4343-b714-78aa031f3cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:20.804647 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5ee25-cf7e-4343-b714-78aa031f3cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:20.804928 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5ee25-cf7e-4343-b714-78aa031f3cc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:20.805772 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c5ee25-cf7e-4343-b714-78aa031f3cc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:20.807409 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c5ee25-cf7e-4343-b714-78aa031f3cc1 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:20.823144 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 959/1914] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:12:20.828397 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c32bb-d00e-4ca4-b575-855d4f052bbd admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:20.847157 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c32bb-d00e-4ca4-b575-855d4f052bbd admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:20.853106 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f56fc5-55dc-4d5e-b641-d3ea1ce0ce51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:20.854029 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f56fc5-55dc-4d5e-b641-d3ea1ce0ce51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:20.854317 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f56fc5-55dc-4d5e-b641-d3ea1ce0ce51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:20.854595 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f56fc5-55dc-4d5e-b641-d3ea1ce0ce51 admin admin] PATH_INFO: `/v3/projects/619e957977674b858665abac91c97c62/users/2391d0eec44c4332b6dac9677810ae4d/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:20.870757 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f56fc5-55dc-4d5e-b641-d3ea1ce0ce51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=619e957977674b858665abac91c97c62, user_id=2391d0eec44c4332b6dac9677810ae4d, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:20.873444 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f56fc5-55dc-4d5e-b641-d3ea1ce0ce51 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:20.946970 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 956/1915] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:12:20 2022] PUT /identity/v3/projects/619e957977674b858665abac91c97c62/users/2391d0eec44c4332b6dac9677810ae4d/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:12:20.957557 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6c56c-4ccd-4556-8175-9657fd170942 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:20.957864 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6c56c-4ccd-4556-8175-9657fd170942 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:20.958307 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6c56c-4ccd-4556-8175-9657fd170942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:20.987571 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-1ab6c56c-4ccd-4556-8175-9657fd170942 None None] MFA Rules not processed for user `2391d0eec44c4332b6dac9677810ae4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:20.988814 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-1ab6c56c-4ccd-4556-8175-9657fd170942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:21.053653 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 960/1916] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:12:21.058736 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f56fc5-55dc-4d5e-b641-d3ea1ce0ce51 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:21.125042 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f56fc5-55dc-4d5e-b641-d3ea1ce0ce51 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:21.135080 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32faecb2-15e4-4724-993f-7694704e0bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:21.135724 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32faecb2-15e4-4724-993f-7694704e0bef admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:21.136181 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32faecb2-15e4-4724-993f-7694704e0bef admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:21.136455 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32faecb2-15e4-4724-993f-7694704e0bef admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:21.137285 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32faecb2-15e4-4724-993f-7694704e0bef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:21.139360 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32faecb2-15e4-4724-993f-7694704e0bef admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:21.239056 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 957/1917] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:12:21 2022] POST /identity/v3/projects => generated 383 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:12:21.243479 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6c56c-4ccd-4556-8175-9657fd170942 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:21.255152 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6c56c-4ccd-4556-8175-9657fd170942 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:21.394721 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5fa73-48ed-4f13-bd10-0404bef9c1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:21.395386 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5fa73-48ed-4f13-bd10-0404bef9c1d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:21.395731 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5fa73-48ed-4f13-bd10-0404bef9c1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:21.396033 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5fa73-48ed-4f13-bd10-0404bef9c1d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:21.396716 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b5fa73-48ed-4f13-bd10-0404bef9c1d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:21.399257 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b5fa73-48ed-4f13-bd10-0404bef9c1d4 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:21.591306 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 961/1918] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:12:21 2022] POST /identity/v3/users => generated 298 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:12:21.592026 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32faecb2-15e4-4724-993f-7694704e0bef admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:21.638940 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32faecb2-15e4-4724-993f-7694704e0bef admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:21.648817 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277450e6-598e-4f28-bfbe-cac232d7e331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:21.649464 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277450e6-598e-4f28-bfbe-cac232d7e331 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:21.649751 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277450e6-598e-4f28-bfbe-cac232d7e331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:21.650028 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277450e6-598e-4f28-bfbe-cac232d7e331 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:21.650822 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277450e6-598e-4f28-bfbe-cac232d7e331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:21.666319 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277450e6-598e-4f28-bfbe-cac232d7e331 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:21.688490 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 958/1919] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:12:21.689027 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5fa73-48ed-4f13-bd10-0404bef9c1d4 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:21.703294 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5fa73-48ed-4f13-bd10-0404bef9c1d4 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:21.709185 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8657cc-5827-465b-a334-4b312e5a409b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:21.710271 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8657cc-5827-465b-a334-4b312e5a409b admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:21.710552 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8657cc-5827-465b-a334-4b312e5a409b admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:21.710848 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8657cc-5827-465b-a334-4b312e5a409b admin admin] PATH_INFO: `/v3/projects/5509c8aba97d43bcbd9e4b928b1901e8/users/177538f701d6439e9f148d2a12e4ea30/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:21.732944 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8657cc-5827-465b-a334-4b312e5a409b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5509c8aba97d43bcbd9e4b928b1901e8, user_id=177538f701d6439e9f148d2a12e4ea30, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:21.736401 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8657cc-5827-465b-a334-4b312e5a409b admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:21.850292 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 962/1920] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:12:21 2022] PUT /identity/v3/projects/5509c8aba97d43bcbd9e4b928b1901e8/users/177538f701d6439e9f148d2a12e4ea30/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:21.855138 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277450e6-598e-4f28-bfbe-cac232d7e331 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:21.876468 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277450e6-598e-4f28-bfbe-cac232d7e331 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:21.945381 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081830b-92ff-43c1-bda1-b56ef979f252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:21.946214 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081830b-92ff-43c1-bda1-b56ef979f252 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:21.946495 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081830b-92ff-43c1-bda1-b56ef979f252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:21.946777 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081830b-92ff-43c1-bda1-b56ef979f252 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:21.947447 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081830b-92ff-43c1-bda1-b56ef979f252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:21.949088 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081830b-92ff-43c1-bda1-b56ef979f252 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:21.959490 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 959/1921] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:12:21.964004 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8657cc-5827-465b-a334-4b312e5a409b admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:21.974724 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8657cc-5827-465b-a334-4b312e5a409b admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:21.979499 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52d328-1750-4ceb-9de5-362231d6f1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:21.980258 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52d328-1750-4ceb-9de5-362231d6f1c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:21.980547 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52d328-1750-4ceb-9de5-362231d6f1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:21.980825 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52d328-1750-4ceb-9de5-362231d6f1c0 admin admin] PATH_INFO: `/v3/projects/5509c8aba97d43bcbd9e4b928b1901e8/users/177538f701d6439e9f148d2a12e4ea30/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:21.982852 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff52d328-1750-4ceb-9de5-362231d6f1c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5509c8aba97d43bcbd9e4b928b1901e8, user_id=177538f701d6439e9f148d2a12e4ea30, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:21.985641 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff52d328-1750-4ceb-9de5-362231d6f1c0 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:22.009938 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 963/1922] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:12:21 2022] PUT /identity/v3/projects/5509c8aba97d43bcbd9e4b928b1901e8/users/177538f701d6439e9f148d2a12e4ea30/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:22.011786 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb6ec1-a713-449c-ae6e-7e0eb5d2f7e2 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:22.012103 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb6ec1-a713-449c-ae6e-7e0eb5d2f7e2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:22.012391 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb6ec1-a713-449c-ae6e-7e0eb5d2f7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:22.043840 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-77fb6ec1-a713-449c-ae6e-7e0eb5d2f7e2 None None] MFA Rules not processed for user `177538f701d6439e9f148d2a12e4ea30`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:22.045298 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-77fb6ec1-a713-449c-ae6e-7e0eb5d2f7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:22.123384 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 960/1923] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:22 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:12:22.131066 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52d328-1750-4ceb-9de5-362231d6f1c0 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:22.133970 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-ff52d328-1750-4ceb-9de5-362231d6f1c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:22.200050 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52d328-1750-4ceb-9de5-362231d6f1c0 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:22.203956 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267d532-9562-42ca-9178-1b39bea3d4cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:22.204817 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267d532-9562-42ca-9178-1b39bea3d4cd service cinder] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:22.205123 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267d532-9562-42ca-9178-1b39bea3d4cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:22.206336 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267d532-9562-42ca-9178-1b39bea3d4cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:22.215077 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0267d532-9562-42ca-9178-1b39bea3d4cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:22.216599 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0267d532-9562-42ca-9178-1b39bea3d4cd service cinder] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:22.226970 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 964/1924] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:12:22 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:12:22.335040 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:22.394180 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb6ec1-a713-449c-ae6e-7e0eb5d2f7e2 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:22.404531 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb6ec1-a713-449c-ae6e-7e0eb5d2f7e2 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:22.408145 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe510d44-472b-4e07-bcde-bd21444e9ab7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:22.408763 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe510d44-472b-4e07-bcde-bd21444e9ab7 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:22.409043 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe510d44-472b-4e07-bcde-bd21444e9ab7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:22.409321 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe510d44-472b-4e07-bcde-bd21444e9ab7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:22.471804 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe510d44-472b-4e07-bcde-bd21444e9ab7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:22.473950 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe510d44-472b-4e07-bcde-bd21444e9ab7 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:22.485287 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 961/1925] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:12:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:12:23.183351 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267d532-9562-42ca-9178-1b39bea3d4cd service cinder] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:23.261481 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267d532-9562-42ca-9178-1b39bea3d4cd service cinder] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:23.265959 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7216df9-03a5-4f2a-914f-044f3f829292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:23.266590 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7216df9-03a5-4f2a-914f-044f3f829292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:23.266866 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7216df9-03a5-4f2a-914f-044f3f829292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:23.267138 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7216df9-03a5-4f2a-914f-044f3f829292 admin admin] PATH_INFO: `/v3/users/2391d0eec44c4332b6dac9677810ae4d` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:23.268732 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7216df9-03a5-4f2a-914f-044f3f829292 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2391d0eec44c4332b6dac9677810ae4d)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:23.270732 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7216df9-03a5-4f2a-914f-044f3f829292 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:23.580856 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-e7216df9-03a5-4f2a-914f-044f3f829292 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2391d0eec44c4332b6dac9677810ae4d'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:23.698225 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-e7216df9-03a5-4f2a-914f-044f3f829292 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2391d0eec44c4332b6dac9677810ae4d'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:23.698410 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:23.720652 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-e7216df9-03a5-4f2a-914f-044f3f829292 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2391d0eec44c4332b6dac9677810ae4d'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:23.722020 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-e7216df9-03a5-4f2a-914f-044f3f829292 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2391d0eec44c4332b6dac9677810ae4d'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:23.736283 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-e7216df9-03a5-4f2a-914f-044f3f829292 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2391d0eec44c4332b6dac9677810ae4d'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:23.747539 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 965/1926] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:12:23 2022] DELETE /identity/v3/users/2391d0eec44c4332b6dac9677810ae4d => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:23.752738 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67000d0-42d7-45a2-8a6a-f6590e6554b6 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:23.753270 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67000d0-42d7-45a2-8a6a-f6590e6554b6 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:23.753915 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67000d0-42d7-45a2-8a6a-f6590e6554b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:23.786114 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-f67000d0-42d7-45a2-8a6a-f6590e6554b6 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:23.787531 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f67000d0-42d7-45a2-8a6a-f6590e6554b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:23.873943 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 962/1927] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:12:23.885616 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7216df9-03a5-4f2a-914f-044f3f829292 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:23.887158 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-e7216df9-03a5-4f2a-914f-044f3f829292 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:23.955161 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7216df9-03a5-4f2a-914f-044f3f829292 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:23.959319 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494f639-865a-4924-8264-680c98a4a5af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:23.960549 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494f639-865a-4924-8264-680c98a4a5af service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:23.960857 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494f639-865a-4924-8264-680c98a4a5af service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:23.961123 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494f639-865a-4924-8264-680c98a4a5af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:23.971158 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494f639-865a-4924-8264-680c98a4a5af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:23.972767 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494f639-865a-4924-8264-680c98a4a5af service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:23.983132 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 966/1928] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:12:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:12:24.968281 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67000d0-42d7-45a2-8a6a-f6590e6554b6 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:24.974197 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f67000d0-42d7-45a2-8a6a-f6590e6554b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:25.012678 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67000d0-42d7-45a2-8a6a-f6590e6554b6 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:25.021914 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad31d3-1065-4e87-bec8-d84fbee58515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:25.023867 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad31d3-1065-4e87-bec8-d84fbee58515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:25.024843 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad31d3-1065-4e87-bec8-d84fbee58515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:25.025445 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad31d3-1065-4e87-bec8-d84fbee58515 admin admin] PATH_INFO: `/v3/projects/619e957977674b858665abac91c97c62` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:25.026931 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad31d3-1065-4e87-bec8-d84fbee58515 admin admin] RBAC: Authorizing `identity:delete_project(project_id=619e957977674b858665abac91c97c62)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:25.030379 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad31d3-1065-4e87-bec8-d84fbee58515 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:25.182867 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7fad31d3-1065-4e87-bec8-d84fbee58515 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '619e957977674b858665abac91c97c62', 'request_id': 'req-7fad31d3-1065-4e87-bec8-d84fbee58515'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:25.189647 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7fad31d3-1065-4e87-bec8-d84fbee58515 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '619e957977674b858665abac91c97c62', 'request_id': 'req-7fad31d3-1065-4e87-bec8-d84fbee58515'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:25.534602 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7fad31d3-1065-4e87-bec8-d84fbee58515 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '619e957977674b858665abac91c97c62', 'request_id': 'req-7fad31d3-1065-4e87-bec8-d84fbee58515'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:25.553280 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7fad31d3-1065-4e87-bec8-d84fbee58515 admin admin] The token cache is being invalidate because project 619e957977674b858665abac91c97c62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:12:25.554232 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7fad31d3-1065-4e87-bec8-d84fbee58515 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:25.555375 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7fad31d3-1065-4e87-bec8-d84fbee58515 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:25.557634 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 963/1929] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:12:24 2022] DELETE /identity/v3/projects/619e957977674b858665abac91c97c62 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:25.561316 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494f639-865a-4924-8264-680c98a4a5af service neutron] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:25.584045 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494f639-865a-4924-8264-680c98a4a5af service neutron] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:25.724642 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33132a89-fd56-46ea-94d9-b8451e05c591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:25.726478 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33132a89-fd56-46ea-94d9-b8451e05c591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:25.727649 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33132a89-fd56-46ea-94d9-b8451e05c591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:25.727649 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33132a89-fd56-46ea-94d9-b8451e05c591 admin admin] PATH_INFO: `/v3/users/177538f701d6439e9f148d2a12e4ea30` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:25.728774 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33132a89-fd56-46ea-94d9-b8451e05c591 admin admin] RBAC: Authorizing `identity:delete_user(user_id=177538f701d6439e9f148d2a12e4ea30)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:25.730711 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33132a89-fd56-46ea-94d9-b8451e05c591 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:26.036371 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-33132a89-fd56-46ea-94d9-b8451e05c591 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '177538f701d6439e9f148d2a12e4ea30'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:26.139974 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-33132a89-fd56-46ea-94d9-b8451e05c591 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '177538f701d6439e9f148d2a12e4ea30'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:26.160244 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-33132a89-fd56-46ea-94d9-b8451e05c591 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '177538f701d6439e9f148d2a12e4ea30'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:26.160987 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-33132a89-fd56-46ea-94d9-b8451e05c591 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '177538f701d6439e9f148d2a12e4ea30'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:26.170105 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-33132a89-fd56-46ea-94d9-b8451e05c591 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '177538f701d6439e9f148d2a12e4ea30'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:26.177255 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 967/1930] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:12:25 2022] DELETE /identity/v3/users/177538f701d6439e9f148d2a12e4ea30 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:26.841784 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad31d3-1065-4e87-bec8-d84fbee58515 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:26.845600 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7fad31d3-1065-4e87-bec8-d84fbee58515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:26.863839 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad31d3-1065-4e87-bec8-d84fbee58515 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:26.946435 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5e521-62a2-411e-9518-0e9604e6a173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:26.947405 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5e521-62a2-411e-9518-0e9604e6a173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:26.947684 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5e521-62a2-411e-9518-0e9604e6a173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:26.947961 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5e521-62a2-411e-9518-0e9604e6a173 admin admin] PATH_INFO: `/v3/projects/5509c8aba97d43bcbd9e4b928b1901e8` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:26.949668 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f5e521-62a2-411e-9518-0e9604e6a173 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5509c8aba97d43bcbd9e4b928b1901e8)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:26.951746 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f5e521-62a2-411e-9518-0e9604e6a173 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:27.162756 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-28f5e521-62a2-411e-9518-0e9604e6a173 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5509c8aba97d43bcbd9e4b928b1901e8', 'request_id': 'req-28f5e521-62a2-411e-9518-0e9604e6a173'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:27.181203 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-28f5e521-62a2-411e-9518-0e9604e6a173 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5509c8aba97d43bcbd9e4b928b1901e8', 'request_id': 'req-28f5e521-62a2-411e-9518-0e9604e6a173'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:27.292145 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-28f5e521-62a2-411e-9518-0e9604e6a173 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5509c8aba97d43bcbd9e4b928b1901e8', 'request_id': 'req-28f5e521-62a2-411e-9518-0e9604e6a173'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:27.313372 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-28f5e521-62a2-411e-9518-0e9604e6a173 admin admin] The token cache is being invalidate because project 5509c8aba97d43bcbd9e4b928b1901e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:12:27.313683 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-28f5e521-62a2-411e-9518-0e9604e6a173 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:27.315226 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-28f5e521-62a2-411e-9518-0e9604e6a173 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:27.320521 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 964/1931] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:12:26 2022] DELETE /identity/v3/projects/5509c8aba97d43bcbd9e4b928b1901e8 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:27.322399 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd1f1e-11f9-4071-9d6f-15c0ce91f0bc None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:27.323500 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd1f1e-11f9-4071-9d6f-15c0ce91f0bc None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:27.324308 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd1f1e-11f9-4071-9d6f-15c0ce91f0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:27.362777 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-affd1f1e-11f9-4071-9d6f-15c0ce91f0bc None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:27.364565 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-affd1f1e-11f9-4071-9d6f-15c0ce91f0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:27.457772 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 968/1932] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:12:27.464836 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00939c16-27fe-49f8-ab24-20d7adc22275 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:27.464836 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00939c16-27fe-49f8-ab24-20d7adc22275 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:27.464836 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00939c16-27fe-49f8-ab24-20d7adc22275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:27.497697 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-00939c16-27fe-49f8-ab24-20d7adc22275 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:27.498942 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-00939c16-27fe-49f8-ab24-20d7adc22275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:27.506605 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:27.512263 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd1f1e-11f9-4071-9d6f-15c0ce91f0bc None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:27.512680 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 965/1933] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:12:27.523512 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd1f1e-11f9-4071-9d6f-15c0ce91f0bc None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:27.529445 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba8d0a-dbcb-4c83-8d4d-6f2ade93d221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:27.530400 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba8d0a-dbcb-4c83-8d4d-6f2ade93d221 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:27.530917 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba8d0a-dbcb-4c83-8d4d-6f2ade93d221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:27.532417 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba8d0a-dbcb-4c83-8d4d-6f2ade93d221 admin admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:27.533465 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba8d0a-dbcb-4c83-8d4d-6f2ade93d221 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:12:27.533948 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba8d0a-dbcb-4c83-8d4d-6f2ade93d221 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:27.536409 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba8d0a-dbcb-4c83-8d4d-6f2ade93d221 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:27.550611 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 969/1934] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:12:27.555508 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00939c16-27fe-49f8-ab24-20d7adc22275 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:27.565683 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00939c16-27fe-49f8-ab24-20d7adc22275 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:27.571008 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d0602-e21a-4a94-9ff8-438340beadaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:27.571690 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d0602-e21a-4a94-9ff8-438340beadaa admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:27.572001 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d0602-e21a-4a94-9ff8-438340beadaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:27.572338 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d0602-e21a-4a94-9ff8-438340beadaa admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:27.573000 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d0602-e21a-4a94-9ff8-438340beadaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:27.575161 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d0602-e21a-4a94-9ff8-438340beadaa admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:27.707798 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 966/1935] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:12:27 2022] POST /identity/v3/projects => generated 375 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:12:27.712407 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba8d0a-dbcb-4c83-8d4d-6f2ade93d221 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:27.723199 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba8d0a-dbcb-4c83-8d4d-6f2ade93d221 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:27.789940 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33405b05-bf43-43a0-a573-b3ee455fbf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:27.790555 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33405b05-bf43-43a0-a573-b3ee455fbf30 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:27.790834 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33405b05-bf43-43a0-a573-b3ee455fbf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:27.791106 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33405b05-bf43-43a0-a573-b3ee455fbf30 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:27.791752 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33405b05-bf43-43a0-a573-b3ee455fbf30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:27.793721 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33405b05-bf43-43a0-a573-b3ee455fbf30 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:27.884444 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 970/1936] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:12:27 2022] POST /identity/v3/users => generated 288 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:12:27.888641 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d0602-e21a-4a94-9ff8-438340beadaa admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:27.902736 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d0602-e21a-4a94-9ff8-438340beadaa admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:27.908926 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd1c93-4ba2-4b3a-825e-c3a6030fc708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:27.909905 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd1c93-4ba2-4b3a-825e-c3a6030fc708 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:27.910482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd1c93-4ba2-4b3a-825e-c3a6030fc708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:27.910952 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd1c93-4ba2-4b3a-825e-c3a6030fc708 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:27.911817 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd1c93-4ba2-4b3a-825e-c3a6030fc708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:27.914867 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd1c93-4ba2-4b3a-825e-c3a6030fc708 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:27.929369 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 967/1937] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:12:27.933558 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33405b05-bf43-43a0-a573-b3ee455fbf30 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:27.960645 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33405b05-bf43-43a0-a573-b3ee455fbf30 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:27.977035 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11277184-59e8-479f-b6d7-3f403e584d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:27.977716 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11277184-59e8-479f-b6d7-3f403e584d9a admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:27.978268 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11277184-59e8-479f-b6d7-3f403e584d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:27.978268 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11277184-59e8-479f-b6d7-3f403e584d9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:27.978890 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11277184-59e8-479f-b6d7-3f403e584d9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:27.980596 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11277184-59e8-479f-b6d7-3f403e584d9a admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:28.004002 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 971/1938] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:12:28.005545 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd1c93-4ba2-4b3a-825e-c3a6030fc708 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:28.026597 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd1c93-4ba2-4b3a-825e-c3a6030fc708 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:28.033199 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11277184-59e8-479f-b6d7-3f403e584d9a admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:28.035144 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-11277184-59e8-479f-b6d7-3f403e584d9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:28.043946 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1130842b-8c74-405f-9189-679067910e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:28.044678 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130842b-8c74-405f-9189-679067910e80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:28.044963 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130842b-8c74-405f-9189-679067910e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:28.045237 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130842b-8c74-405f-9189-679067910e80 admin admin] PATH_INFO: `/v3/projects/1716d0bd65664ad7bffdab382b2786d4/users/38894b69804d4822918e7183d8b1e3b4/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:28.056116 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11277184-59e8-479f-b6d7-3f403e584d9a admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:28.062241 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e532c5-e4e5-491e-86fe-4a121c5c40ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:28.063288 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e532c5-e4e5-491e-86fe-4a121c5c40ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:28.063703 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e532c5-e4e5-491e-86fe-4a121c5c40ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:28.064388 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e532c5-e4e5-491e-86fe-4a121c5c40ab admin admin] PATH_INFO: `/v3/users/49d0f1cd9e194018b53b5d555ae2e121` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:28.068929 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e532c5-e4e5-491e-86fe-4a121c5c40ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=49d0f1cd9e194018b53b5d555ae2e121)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:28.069097 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1130842b-8c74-405f-9189-679067910e80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1716d0bd65664ad7bffdab382b2786d4, user_id=38894b69804d4822918e7183d8b1e3b4, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:28.069247 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e532c5-e4e5-491e-86fe-4a121c5c40ab admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:28.070940 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1130842b-8c74-405f-9189-679067910e80 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:28.175748 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 968/1939] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:12:28 2022] PUT /identity/v3/projects/1716d0bd65664ad7bffdab382b2786d4/users/38894b69804d4822918e7183d8b1e3b4/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:28.187840 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf50e2f-025b-4ec8-9386-16048be879c8 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:28.188162 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf50e2f-025b-4ec8-9386-16048be879c8 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:28.188442 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf50e2f-025b-4ec8-9386-16048be879c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:28.216426 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-edf50e2f-025b-4ec8-9386-16048be879c8 None None] MFA Rules not processed for user `38894b69804d4822918e7183d8b1e3b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:28.217856 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-edf50e2f-025b-4ec8-9386-16048be879c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:28.283130 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 969/1940] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:12:28.291440 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-65e532c5-e4e5-491e-86fe-4a121c5c40ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49d0f1cd9e194018b53b5d555ae2e121'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:28.295575 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf50e2f-025b-4ec8-9386-16048be879c8 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:28.298375 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-edf50e2f-025b-4ec8-9386-16048be879c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:28.353915 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf50e2f-025b-4ec8-9386-16048be879c8 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:28.357890 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab5d65-faa3-4314-be54-5d2df825d643 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d0e8cc074b4e36acc2162aebeac169', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:28.358533 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab5d65-faa3-4314-be54-5d2df825d643 service glance] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:28.358926 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab5d65-faa3-4314-be54-5d2df825d643 service glance] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:28.359207 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab5d65-faa3-4314-be54-5d2df825d643 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:28.368868 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab5d65-faa3-4314-be54-5d2df825d643 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:28.370281 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab5d65-faa3-4314-be54-5d2df825d643 service glance] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:28.379270 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 970/1941] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:12:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:12:28.409122 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-65e532c5-e4e5-491e-86fe-4a121c5c40ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49d0f1cd9e194018b53b5d555ae2e121'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:28.420576 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-65e532c5-e4e5-491e-86fe-4a121c5c40ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49d0f1cd9e194018b53b5d555ae2e121'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:28.421514 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-65e532c5-e4e5-491e-86fe-4a121c5c40ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49d0f1cd9e194018b53b5d555ae2e121'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:28.430667 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-65e532c5-e4e5-491e-86fe-4a121c5c40ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49d0f1cd9e194018b53b5d555ae2e121'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:28.437093 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 972/1942] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:12:28 2022] DELETE /identity/v3/users/49d0f1cd9e194018b53b5d555ae2e121 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:28.441564 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0d93e-14bc-4566-9a6f-29bf6b9207bb None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:28.441858 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0d93e-14bc-4566-9a6f-29bf6b9207bb None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:28.442193 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0d93e-14bc-4566-9a6f-29bf6b9207bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:28.468365 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-6de0d93e-14bc-4566-9a6f-29bf6b9207bb None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:28.469612 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6de0d93e-14bc-4566-9a6f-29bf6b9207bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:28.551217 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 971/1943] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:12:28.557643 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e532c5-e4e5-491e-86fe-4a121c5c40ab admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:28.559040 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-65e532c5-e4e5-491e-86fe-4a121c5c40ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:28.625286 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e532c5-e4e5-491e-86fe-4a121c5c40ab admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:28.634260 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce3d04-3e3f-4ab3-a84f-04126ff0b482 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:28.634260 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce3d04-3e3f-4ab3-a84f-04126ff0b482 service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:28.634260 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce3d04-3e3f-4ab3-a84f-04126ff0b482 service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:28.635561 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce3d04-3e3f-4ab3-a84f-04126ff0b482 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:28.648217 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce3d04-3e3f-4ab3-a84f-04126ff0b482 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:28.649755 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce3d04-3e3f-4ab3-a84f-04126ff0b482 service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:28.664328 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 973/1944] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:12:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:12:28.980583 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:29.142112 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0d93e-14bc-4566-9a6f-29bf6b9207bb None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:29.143599 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6de0d93e-14bc-4566-9a6f-29bf6b9207bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:29.159902 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0d93e-14bc-4566-9a6f-29bf6b9207bb None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:29.174565 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818e1ee-e209-4507-b90f-581404011399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:29.175667 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818e1ee-e209-4507-b90f-581404011399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:29.176192 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818e1ee-e209-4507-b90f-581404011399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:29.176772 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818e1ee-e209-4507-b90f-581404011399 admin admin] PATH_INFO: `/v3/projects/7ec5d6482076465888cd6fa4c4006eba` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:29.178230 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4818e1ee-e209-4507-b90f-581404011399 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ec5d6482076465888cd6fa4c4006eba)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:29.181050 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4818e1ee-e209-4507-b90f-581404011399 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:29.382879 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4818e1ee-e209-4507-b90f-581404011399 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ec5d6482076465888cd6fa4c4006eba', 'request_id': 'req-4818e1ee-e209-4507-b90f-581404011399'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:29.392927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4818e1ee-e209-4507-b90f-581404011399 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ec5d6482076465888cd6fa4c4006eba', 'request_id': 'req-4818e1ee-e209-4507-b90f-581404011399'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:29.559928 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4818e1ee-e209-4507-b90f-581404011399 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ec5d6482076465888cd6fa4c4006eba', 'request_id': 'req-4818e1ee-e209-4507-b90f-581404011399'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:29.570971 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4818e1ee-e209-4507-b90f-581404011399 admin admin] The token cache is being invalidate because project 7ec5d6482076465888cd6fa4c4006eba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:12:29.571287 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4818e1ee-e209-4507-b90f-581404011399 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:29.571937 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4818e1ee-e209-4507-b90f-581404011399 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:29.573554 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 972/1945] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:12:29 2022] DELETE /identity/v3/projects/7ec5d6482076465888cd6fa4c4006eba => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:29.579047 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67a148-b59e-4e71-b20d-2f64a99c4547 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:29.579563 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67a148-b59e-4e71-b20d-2f64a99c4547 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:29.579836 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67a148-b59e-4e71-b20d-2f64a99c4547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:29.601587 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-5a67a148-b59e-4e71-b20d-2f64a99c4547 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:29.602779 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-5a67a148-b59e-4e71-b20d-2f64a99c4547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:29.661638 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 974/1946] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:12:29.670355 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a279be-1e46-4756-94da-2208dd7490a3 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:29.670711 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a279be-1e46-4756-94da-2208dd7490a3 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:29.670987 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a279be-1e46-4756-94da-2208dd7490a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:29.692254 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-c2a279be-1e46-4756-94da-2208dd7490a3 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:29.693566 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c2a279be-1e46-4756-94da-2208dd7490a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:29.703024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 973/1947] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:12:29.707257 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a67a148-b59e-4e71-b20d-2f64a99c4547 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:29.716935 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a67a148-b59e-4e71-b20d-2f64a99c4547 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:29.721965 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7aab4-40b3-45f8-abc0-47ca39553fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:29.722596 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7aab4-40b3-45f8-abc0-47ca39553fcf admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:29.722880 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7aab4-40b3-45f8-abc0-47ca39553fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:29.723172 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7aab4-40b3-45f8-abc0-47ca39553fcf admin admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:29.723836 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac7aab4-40b3-45f8-abc0-47ca39553fcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:12:29.724171 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac7aab4-40b3-45f8-abc0-47ca39553fcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:29.726486 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac7aab4-40b3-45f8-abc0-47ca39553fcf admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:29.743326 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 975/1948] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:12:29.744523 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a279be-1e46-4756-94da-2208dd7490a3 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:29.765738 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a279be-1e46-4756-94da-2208dd7490a3 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:29.767094 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4cd638-941d-4ec4-b561-1a4972b831b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:29.768982 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cd638-941d-4ec4-b561-1a4972b831b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:29.769572 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cd638-941d-4ec4-b561-1a4972b831b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:29.770199 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cd638-941d-4ec4-b561-1a4972b831b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:29.771185 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4cd638-941d-4ec4-b561-1a4972b831b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:29.773485 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4cd638-941d-4ec4-b561-1a4972b831b8 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:29.933812 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 974/1949] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:12:29 2022] POST /identity/v3/projects => generated 373 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:12:29.935172 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7aab4-40b3-45f8-abc0-47ca39553fcf admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:29.946073 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7aab4-40b3-45f8-abc0-47ca39553fcf admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:30.011948 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900102b-9d8b-409e-b606-bce075d9a1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:30.012606 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900102b-9d8b-409e-b606-bce075d9a1f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:30.012881 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900102b-9d8b-409e-b606-bce075d9a1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:30.013159 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900102b-9d8b-409e-b606-bce075d9a1f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:30.013791 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900102b-9d8b-409e-b606-bce075d9a1f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:30.015692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900102b-9d8b-409e-b606-bce075d9a1f9 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:30.152677 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 976/1950] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:12:29 2022] POST /identity/v3/users => generated 287 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:12:30.156758 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4cd638-941d-4ec4-b561-1a4972b831b8 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:30.167657 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4cd638-941d-4ec4-b561-1a4972b831b8 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:30.172356 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17db5fa-9045-4b24-9eb5-f89ff3a1bb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:30.173032 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17db5fa-9045-4b24-9eb5-f89ff3a1bb79 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:30.173319 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17db5fa-9045-4b24-9eb5-f89ff3a1bb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:30.173591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17db5fa-9045-4b24-9eb5-f89ff3a1bb79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:30.174240 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17db5fa-9045-4b24-9eb5-f89ff3a1bb79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:30.175932 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17db5fa-9045-4b24-9eb5-f89ff3a1bb79 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:30.186400 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 975/1951] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:12:30.190535 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900102b-9d8b-409e-b606-bce075d9a1f9 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:30.200894 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900102b-9d8b-409e-b606-bce075d9a1f9 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:30.205554 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e39438-65ea-4710-8428-8e88060180ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:30.206148 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e39438-65ea-4710-8428-8e88060180ca admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:30.206532 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e39438-65ea-4710-8428-8e88060180ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:30.206852 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e39438-65ea-4710-8428-8e88060180ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:30.207528 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e39438-65ea-4710-8428-8e88060180ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:30.209199 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e39438-65ea-4710-8428-8e88060180ca admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:30.220391 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 977/1952] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:12:30.224574 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17db5fa-9045-4b24-9eb5-f89ff3a1bb79 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:30.235177 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17db5fa-9045-4b24-9eb5-f89ff3a1bb79 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:30.240203 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28531d-27b9-4fdc-afed-6b81a9c7d86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:30.240865 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28531d-27b9-4fdc-afed-6b81a9c7d86c admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:30.241180 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28531d-27b9-4fdc-afed-6b81a9c7d86c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:30.241491 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28531d-27b9-4fdc-afed-6b81a9c7d86c admin admin] PATH_INFO: `/v3/projects/04f12089e1284fe0b41261e15e3aec01/users/94475ca521f94967ac4793482522275e/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:30.256166 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28531d-27b9-4fdc-afed-6b81a9c7d86c admin admin] RBAC: Authorizing `identity:create_grant(project_id=04f12089e1284fe0b41261e15e3aec01, user_id=94475ca521f94967ac4793482522275e, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:30.259433 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28531d-27b9-4fdc-afed-6b81a9c7d86c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:30.460679 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 976/1953] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:12:30 2022] PUT /identity/v3/projects/04f12089e1284fe0b41261e15e3aec01/users/94475ca521f94967ac4793482522275e/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:12:30.473893 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8ea10-9c46-4d71-8877-d2180aab0850 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:30.474247 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8ea10-9c46-4d71-8877-d2180aab0850 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:30.474467 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8ea10-9c46-4d71-8877-d2180aab0850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:30.518741 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-2ba8ea10-9c46-4d71-8877-d2180aab0850 None None] MFA Rules not processed for user `94475ca521f94967ac4793482522275e`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:30.519869 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-2ba8ea10-9c46-4d71-8877-d2180aab0850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:30.607224 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 978/1954] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:12:30.624498 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28531d-27b9-4fdc-afed-6b81a9c7d86c admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:30.624498 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2e28531d-27b9-4fdc-afed-6b81a9c7d86c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:30.684469 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28531d-27b9-4fdc-afed-6b81a9c7d86c admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:30.688263 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d35ef-6052-4790-ad6d-ad18ea76a72d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:30.688822 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d35ef-6052-4790-ad6d-ad18ea76a72d service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:30.689107 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d35ef-6052-4790-ad6d-ad18ea76a72d service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:30.689395 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d35ef-6052-4790-ad6d-ad18ea76a72d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:30.702919 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d35ef-6052-4790-ad6d-ad18ea76a72d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:30.704336 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d35ef-6052-4790-ad6d-ad18ea76a72d service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:30.715724 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 977/1955] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:12:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:12:31.632579 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:32.274231 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea2fa5-2fca-4d0f-af95-433af85069cd None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:32.275489 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea2fa5-2fca-4d0f-af95-433af85069cd None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:32.275489 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea2fa5-2fca-4d0f-af95-433af85069cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:32.294632 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-b0ea2fa5-2fca-4d0f-af95-433af85069cd None None] MFA Rules not processed for user `bfef80e955344073a2a35c569e199f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:32.295838 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-b0ea2fa5-2fca-4d0f-af95-433af85069cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:32.365833 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 979/1956] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:12:33.843910 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:34.150179 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:36.847804 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:37.018481 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:37.021409 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d35ef-6052-4790-ad6d-ad18ea76a72d service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:37.022993 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ed0d35ef-6052-4790-ad6d-ad18ea76a72d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:37.106947 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d35ef-6052-4790-ad6d-ad18ea76a72d service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:37.106947 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65812b1-73ef-4002-8771-6cc9ba152b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:37.106947 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65812b1-73ef-4002-8771-6cc9ba152b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:37.106947 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65812b1-73ef-4002-8771-6cc9ba152b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:37.107582 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65812b1-73ef-4002-8771-6cc9ba152b63 admin admin] PATH_INFO: `/v3/users/aab60a59067c4bcf8d643e5f3364917d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:37.107582 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65812b1-73ef-4002-8771-6cc9ba152b63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aab60a59067c4bcf8d643e5f3364917d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:37.107582 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65812b1-73ef-4002-8771-6cc9ba152b63 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:37.335076 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-e65812b1-73ef-4002-8771-6cc9ba152b63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aab60a59067c4bcf8d643e5f3364917d'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:37.440499 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-e65812b1-73ef-4002-8771-6cc9ba152b63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aab60a59067c4bcf8d643e5f3364917d'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:37.454112 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-e65812b1-73ef-4002-8771-6cc9ba152b63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aab60a59067c4bcf8d643e5f3364917d'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:37.461676 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-e65812b1-73ef-4002-8771-6cc9ba152b63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aab60a59067c4bcf8d643e5f3364917d'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:37.462403 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-e65812b1-73ef-4002-8771-6cc9ba152b63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aab60a59067c4bcf8d643e5f3364917d'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:37.471752 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 978/1957] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:12:37 2022] DELETE /identity/v3/users/aab60a59067c4bcf8d643e5f3364917d => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:37.731192 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea2fa5-2fca-4d0f-af95-433af85069cd None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:37.747802 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea2fa5-2fca-4d0f-af95-433af85069cd None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:37.843635 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914bf27-8bdb-40f0-b181-3b390cd58711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:37.844323 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914bf27-8bdb-40f0-b181-3b390cd58711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:37.844601 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914bf27-8bdb-40f0-b181-3b390cd58711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:37.844874 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914bf27-8bdb-40f0-b181-3b390cd58711 admin admin] PATH_INFO: `/v3/projects/fba044d242a5412db5f598d5fb0856e0` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:37.846644 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6914bf27-8bdb-40f0-b181-3b390cd58711 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fba044d242a5412db5f598d5fb0856e0)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:37.849048 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6914bf27-8bdb-40f0-b181-3b390cd58711 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:37.982394 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-6914bf27-8bdb-40f0-b181-3b390cd58711 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fba044d242a5412db5f598d5fb0856e0', 'request_id': 'req-6914bf27-8bdb-40f0-b181-3b390cd58711'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:38.128643 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-6914bf27-8bdb-40f0-b181-3b390cd58711 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fba044d242a5412db5f598d5fb0856e0', 'request_id': 'req-6914bf27-8bdb-40f0-b181-3b390cd58711'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:38.135761 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-6914bf27-8bdb-40f0-b181-3b390cd58711 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fba044d242a5412db5f598d5fb0856e0', 'request_id': 'req-6914bf27-8bdb-40f0-b181-3b390cd58711'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:38.146989 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-6914bf27-8bdb-40f0-b181-3b390cd58711 admin admin] The token cache is being invalidate because project fba044d242a5412db5f598d5fb0856e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:12:38.147381 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-6914bf27-8bdb-40f0-b181-3b390cd58711 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:38.148145 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-6914bf27-8bdb-40f0-b181-3b390cd58711 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:38.150243 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 980/1958] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:12:37 2022] DELETE /identity/v3/projects/fba044d242a5412db5f598d5fb0856e0 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:38.154224 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65812b1-73ef-4002-8771-6cc9ba152b63 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:38.155661 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e65812b1-73ef-4002-8771-6cc9ba152b63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:38.173846 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65812b1-73ef-4002-8771-6cc9ba152b63 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:38.241462 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716941cc-87b2-4873-9841-4644801ce35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:38.242115 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716941cc-87b2-4873-9841-4644801ce35d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:38.242477 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716941cc-87b2-4873-9841-4644801ce35d admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:38.242770 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716941cc-87b2-4873-9841-4644801ce35d admin admin] PATH_INFO: `/v3/users/366ce09322b94007a99567b219b73de0` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:38.243948 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716941cc-87b2-4873-9841-4644801ce35d admin admin] RBAC: Authorizing `identity:delete_user(user_id=366ce09322b94007a99567b219b73de0)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:38.245976 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716941cc-87b2-4873-9841-4644801ce35d admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:38.539353 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-716941cc-87b2-4873-9841-4644801ce35d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '366ce09322b94007a99567b219b73de0'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:38.630112 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-716941cc-87b2-4873-9841-4644801ce35d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '366ce09322b94007a99567b219b73de0'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:38.644705 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-716941cc-87b2-4873-9841-4644801ce35d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '366ce09322b94007a99567b219b73de0'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:38.655490 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-716941cc-87b2-4873-9841-4644801ce35d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '366ce09322b94007a99567b219b73de0'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:38.656529 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-716941cc-87b2-4873-9841-4644801ce35d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '366ce09322b94007a99567b219b73de0'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:38.663045 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 979/1959] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:12:38 2022] DELETE /identity/v3/users/366ce09322b94007a99567b219b73de0 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:12:38.961066 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914bf27-8bdb-40f0-b181-3b390cd58711 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:38.963326 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-6914bf27-8bdb-40f0-b181-3b390cd58711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:38.977377 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914bf27-8bdb-40f0-b181-3b390cd58711 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:39.009935 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:39.042223 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00903c9-3354-42ef-84a9-07d92d3c7f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:39.042862 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00903c9-3354-42ef-84a9-07d92d3c7f87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:39.043143 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00903c9-3354-42ef-84a9-07d92d3c7f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:39.043420 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00903c9-3354-42ef-84a9-07d92d3c7f87 admin admin] PATH_INFO: `/v3/projects/5a588994bbfb4758880595033b67c27b` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:39.044576 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00903c9-3354-42ef-84a9-07d92d3c7f87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a588994bbfb4758880595033b67c27b)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:39.046604 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00903c9-3354-42ef-84a9-07d92d3c7f87 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:39.065747 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:39.200382 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-d00903c9-3354-42ef-84a9-07d92d3c7f87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a588994bbfb4758880595033b67c27b', 'request_id': 'req-d00903c9-3354-42ef-84a9-07d92d3c7f87'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:39.344677 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-d00903c9-3354-42ef-84a9-07d92d3c7f87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a588994bbfb4758880595033b67c27b', 'request_id': 'req-d00903c9-3354-42ef-84a9-07d92d3c7f87'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:39.352653 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-d00903c9-3354-42ef-84a9-07d92d3c7f87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a588994bbfb4758880595033b67c27b', 'request_id': 'req-d00903c9-3354-42ef-84a9-07d92d3c7f87'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:39.363651 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-d00903c9-3354-42ef-84a9-07d92d3c7f87 admin admin] The token cache is being invalidate because project 5a588994bbfb4758880595033b67c27b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:12:39.363945 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-d00903c9-3354-42ef-84a9-07d92d3c7f87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:39.364640 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-d00903c9-3354-42ef-84a9-07d92d3c7f87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:39.366287 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 981/1960] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:12:38 2022] DELETE /identity/v3/projects/5a588994bbfb4758880595033b67c27b => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:39.371219 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e76953-3746-4a0f-a336-d25fdeae3ab2 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:39.371676 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e76953-3746-4a0f-a336-d25fdeae3ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:39.371919 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e76953-3746-4a0f-a336-d25fdeae3ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:39.392337 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-17e76953-3746-4a0f-a336-d25fdeae3ab2 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:39.401848 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-17e76953-3746-4a0f-a336-d25fdeae3ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:39.460776 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 980/1961] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:12:39.469721 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49586d-0ac8-401f-bd55-e668ca219605 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:39.470079 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49586d-0ac8-401f-bd55-e668ca219605 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:39.470447 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49586d-0ac8-401f-bd55-e668ca219605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:39.502055 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-4e49586d-0ac8-401f-bd55-e668ca219605 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:39.503291 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-4e49586d-0ac8-401f-bd55-e668ca219605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:39.515911 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 982/1962] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:12:39.522791 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e76953-3746-4a0f-a336-d25fdeae3ab2 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:39.531838 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e76953-3746-4a0f-a336-d25fdeae3ab2 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:39.538762 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319f302-88d9-413e-a47a-93b3351c1444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:39.539428 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319f302-88d9-413e-a47a-93b3351c1444 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:39.539747 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319f302-88d9-413e-a47a-93b3351c1444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:39.540094 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319f302-88d9-413e-a47a-93b3351c1444 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:39.540677 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319f302-88d9-413e-a47a-93b3351c1444 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:12:39.540986 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319f302-88d9-413e-a47a-93b3351c1444 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:39.544542 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319f302-88d9-413e-a47a-93b3351c1444 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:39.566546 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 981/1963] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:12:39.569574 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49586d-0ac8-401f-bd55-e668ca219605 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:39.582975 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49586d-0ac8-401f-bd55-e668ca219605 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:39.604611 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf50d5-6037-4eb0-9f47-ce5954e671e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:39.605537 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf50d5-6037-4eb0-9f47-ce5954e671e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:39.606057 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf50d5-6037-4eb0-9f47-ce5954e671e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:39.606535 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf50d5-6037-4eb0-9f47-ce5954e671e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:39.607348 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf50d5-6037-4eb0-9f47-ce5954e671e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:39.609524 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf50d5-6037-4eb0-9f47-ce5954e671e9 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:39.713223 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 983/1964] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:12:39 2022] POST /identity/v3/projects => generated 373 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:12:39.718958 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319f302-88d9-413e-a47a-93b3351c1444 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:39.731051 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319f302-88d9-413e-a47a-93b3351c1444 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:39.793147 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d27a5-601a-4c76-a94a-65f8dfa4a968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:39.795143 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d27a5-601a-4c76-a94a-65f8dfa4a968 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:39.795774 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d27a5-601a-4c76-a94a-65f8dfa4a968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:39.796082 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d27a5-601a-4c76-a94a-65f8dfa4a968 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:39.799728 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d27a5-601a-4c76-a94a-65f8dfa4a968 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:39.799728 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d27a5-601a-4c76-a94a-65f8dfa4a968 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:39.912501 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 982/1965] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:12:39 2022] POST /identity/v3/users => generated 287 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:12:39.917579 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf50d5-6037-4eb0-9f47-ce5954e671e9 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:39.927884 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf50d5-6037-4eb0-9f47-ce5954e671e9 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:39.932586 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c3fb8-29ad-4d1f-9fe6-ff88cf392b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:39.933184 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c3fb8-29ad-4d1f-9fe6-ff88cf392b9d admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:39.933791 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c3fb8-29ad-4d1f-9fe6-ff88cf392b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:39.934103 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c3fb8-29ad-4d1f-9fe6-ff88cf392b9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:39.934760 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570c3fb8-29ad-4d1f-9fe6-ff88cf392b9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:39.936636 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570c3fb8-29ad-4d1f-9fe6-ff88cf392b9d admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:39.949215 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 984/1966] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:12:39.954304 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d27a5-601a-4c76-a94a-65f8dfa4a968 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:39.966611 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d27a5-601a-4c76-a94a-65f8dfa4a968 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:39.972325 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84acc893-4b36-4b95-ab60-25348498c423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:39.973060 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acc893-4b36-4b95-ab60-25348498c423 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:39.973411 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acc893-4b36-4b95-ab60-25348498c423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:39.973760 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acc893-4b36-4b95-ab60-25348498c423 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:39.974484 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84acc893-4b36-4b95-ab60-25348498c423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:39.976238 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84acc893-4b36-4b95-ab60-25348498c423 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:39.991638 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 983/1967] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:12:39.993008 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c3fb8-29ad-4d1f-9fe6-ff88cf392b9d admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:40.003777 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c3fb8-29ad-4d1f-9fe6-ff88cf392b9d admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:40.011023 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe5d84-62c9-439a-94cb-95295614e331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:40.012476 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe5d84-62c9-439a-94cb-95295614e331 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:40.012709 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe5d84-62c9-439a-94cb-95295614e331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:40.012989 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe5d84-62c9-439a-94cb-95295614e331 admin admin] PATH_INFO: `/v3/projects/e77db5270f5e433c9359daa2b39f35f8/users/beef383c74d6490e8599fac7e7b704a4/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:40.028753 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe5d84-62c9-439a-94cb-95295614e331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e77db5270f5e433c9359daa2b39f35f8, user_id=beef383c74d6490e8599fac7e7b704a4, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:40.031440 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe5d84-62c9-439a-94cb-95295614e331 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:40.146201 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 985/1968] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:12:39 2022] PUT /identity/v3/projects/e77db5270f5e433c9359daa2b39f35f8/users/beef383c74d6490e8599fac7e7b704a4/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:40.167389 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705073e-3f16-4a06-a6f7-a0b381a2c2db None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:40.167692 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705073e-3f16-4a06-a6f7-a0b381a2c2db None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:40.167984 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705073e-3f16-4a06-a6f7-a0b381a2c2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:40.214340 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-3705073e-3f16-4a06-a6f7-a0b381a2c2db None None] MFA Rules not processed for user `beef383c74d6490e8599fac7e7b704a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:40.215572 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3705073e-3f16-4a06-a6f7-a0b381a2c2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:40.289732 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 984/1969] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:12:40.305727 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe5d84-62c9-439a-94cb-95295614e331 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:40.307620 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-1dfe5d84-62c9-439a-94cb-95295614e331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:40.380042 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe5d84-62c9-439a-94cb-95295614e331 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:40.384282 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9194a-42e5-422d-9df7-5d9865e992f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:40.384896 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9194a-42e5-422d-9df7-5d9865e992f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:40.385180 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9194a-42e5-422d-9df7-5d9865e992f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:40.385455 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9194a-42e5-422d-9df7-5d9865e992f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:40.393678 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb9194a-42e5-422d-9df7-5d9865e992f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:40.395112 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb9194a-42e5-422d-9df7-5d9865e992f1 service cinder] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:40.403836 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 986/1970] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:12:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:12:40.427453 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705073e-3f16-4a06-a6f7-a0b381a2c2db None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:40.490448 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705073e-3f16-4a06-a6f7-a0b381a2c2db None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:40.495672 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f5af5-c097-45b9-8f75-eb1a6da786e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:40.496365 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f5af5-c097-45b9-8f75-eb1a6da786e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:40.496642 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f5af5-c097-45b9-8f75-eb1a6da786e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:40.496914 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f5af5-c097-45b9-8f75-eb1a6da786e0 admin admin] PATH_INFO: `/v3/users/beef383c74d6490e8599fac7e7b704a4` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:40.498042 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f5af5-c097-45b9-8f75-eb1a6da786e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=beef383c74d6490e8599fac7e7b704a4)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:40.500026 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f5af5-c097-45b9-8f75-eb1a6da786e0 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:40.740768 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9f7f5af5-c097-45b9-8f75-eb1a6da786e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beef383c74d6490e8599fac7e7b704a4'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:40.834763 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9f7f5af5-c097-45b9-8f75-eb1a6da786e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beef383c74d6490e8599fac7e7b704a4'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:40.848238 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9f7f5af5-c097-45b9-8f75-eb1a6da786e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beef383c74d6490e8599fac7e7b704a4'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:40.860676 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9f7f5af5-c097-45b9-8f75-eb1a6da786e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beef383c74d6490e8599fac7e7b704a4'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:40.861485 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9f7f5af5-c097-45b9-8f75-eb1a6da786e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beef383c74d6490e8599fac7e7b704a4'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:40.882134 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 985/1971] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:12:40 2022] DELETE /identity/v3/users/beef383c74d6490e8599fac7e7b704a4 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:40.892372 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e693cd6-9a2d-43ce-88c5-7ff8912f4f9c None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:40.892916 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e693cd6-9a2d-43ce-88c5-7ff8912f4f9c None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:40.893358 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e693cd6-9a2d-43ce-88c5-7ff8912f4f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:40.920177 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-0e693cd6-9a2d-43ce-88c5-7ff8912f4f9c None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:40.920177 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-0e693cd6-9a2d-43ce-88c5-7ff8912f4f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:40.979870 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 987/1972] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:12:40.989540 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f5af5-c097-45b9-8f75-eb1a6da786e0 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:40.990970 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9f7f5af5-c097-45b9-8f75-eb1a6da786e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:41.055040 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f5af5-c097-45b9-8f75-eb1a6da786e0 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:41.059273 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e34f4-566f-42ac-b572-cb5334c88c0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:41.059894 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e34f4-566f-42ac-b572-cb5334c88c0e service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:41.060208 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e34f4-566f-42ac-b572-cb5334c88c0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:41.060487 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e34f4-566f-42ac-b572-cb5334c88c0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:41.069701 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e34f4-566f-42ac-b572-cb5334c88c0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:41.071554 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e34f4-566f-42ac-b572-cb5334c88c0e service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:41.082079 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 986/1973] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:12:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:12:41.373025 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:41.527259 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:41.766424 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e693cd6-9a2d-43ce-88c5-7ff8912f4f9c None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:41.767862 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-0e693cd6-9a2d-43ce-88c5-7ff8912f4f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:41.780466 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e693cd6-9a2d-43ce-88c5-7ff8912f4f9c None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:41.786077 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc02f51-3029-401a-b2f9-14eea5fec030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:41.786770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc02f51-3029-401a-b2f9-14eea5fec030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:41.787042 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc02f51-3029-401a-b2f9-14eea5fec030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:41.787317 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc02f51-3029-401a-b2f9-14eea5fec030 admin admin] PATH_INFO: `/v3/projects/e77db5270f5e433c9359daa2b39f35f8` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:41.788579 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc02f51-3029-401a-b2f9-14eea5fec030 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e77db5270f5e433c9359daa2b39f35f8)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:41.790550 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc02f51-3029-401a-b2f9-14eea5fec030 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:41.909327 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-bcc02f51-3029-401a-b2f9-14eea5fec030 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e77db5270f5e433c9359daa2b39f35f8', 'request_id': 'req-bcc02f51-3029-401a-b2f9-14eea5fec030'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:42.004311 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-bcc02f51-3029-401a-b2f9-14eea5fec030 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e77db5270f5e433c9359daa2b39f35f8', 'request_id': 'req-bcc02f51-3029-401a-b2f9-14eea5fec030'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:42.013122 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-bcc02f51-3029-401a-b2f9-14eea5fec030 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e77db5270f5e433c9359daa2b39f35f8', 'request_id': 'req-bcc02f51-3029-401a-b2f9-14eea5fec030'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:42.024453 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-bcc02f51-3029-401a-b2f9-14eea5fec030 admin admin] The token cache is being invalidate because project e77db5270f5e433c9359daa2b39f35f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:12:42.024856 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-bcc02f51-3029-401a-b2f9-14eea5fec030 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:42.025599 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-bcc02f51-3029-401a-b2f9-14eea5fec030 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:42.027252 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 988/1974] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:12:41 2022] DELETE /identity/v3/projects/e77db5270f5e433c9359daa2b39f35f8 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:42.032275 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8f2a7-ffc6-467e-83f0-3803029dcb30 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:42.033114 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8f2a7-ffc6-467e-83f0-3803029dcb30 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:42.033527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8f2a7-ffc6-467e-83f0-3803029dcb30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:42.053610 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-01b8f2a7-ffc6-467e-83f0-3803029dcb30 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:42.054945 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-01b8f2a7-ffc6-467e-83f0-3803029dcb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:42.125699 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 987/1975] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:12:42.133980 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443daf8-845a-4a43-8e2a-7a0e628d276c None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:42.134501 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443daf8-845a-4a43-8e2a-7a0e628d276c None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:42.134778 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443daf8-845a-4a43-8e2a-7a0e628d276c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:42.154843 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-a443daf8-845a-4a43-8e2a-7a0e628d276c None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:42.156146 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-a443daf8-845a-4a43-8e2a-7a0e628d276c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:42.164360 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 989/1976] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:12:42.169185 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8f2a7-ffc6-467e-83f0-3803029dcb30 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:42.181328 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8f2a7-ffc6-467e-83f0-3803029dcb30 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:42.185967 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67a9b4-6087-427f-9d8b-0d213c1b9645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:42.186580 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67a9b4-6087-427f-9d8b-0d213c1b9645 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:42.186860 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67a9b4-6087-427f-9d8b-0d213c1b9645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:42.187133 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67a9b4-6087-427f-9d8b-0d213c1b9645 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:42.187780 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b67a9b4-6087-427f-9d8b-0d213c1b9645 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:12:42.188105 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b67a9b4-6087-427f-9d8b-0d213c1b9645 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:42.189708 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b67a9b4-6087-427f-9d8b-0d213c1b9645 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:42.201979 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 988/1977] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:12:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:12:42.206372 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443daf8-845a-4a43-8e2a-7a0e628d276c None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:42.217022 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443daf8-845a-4a43-8e2a-7a0e628d276c None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:42.222052 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48ad06-b79b-46c7-96ea-794fe1ab2645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:42.222667 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48ad06-b79b-46c7-96ea-794fe1ab2645 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:42.222947 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48ad06-b79b-46c7-96ea-794fe1ab2645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:42.223220 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48ad06-b79b-46c7-96ea-794fe1ab2645 admin admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:42.225107 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48ad06-b79b-46c7-96ea-794fe1ab2645 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:42.228071 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48ad06-b79b-46c7-96ea-794fe1ab2645 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:42.328552 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 990/1978] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:12:42 2022] POST /identity/v3/projects => generated 369 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:12:42.333393 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67a9b4-6087-427f-9d8b-0d213c1b9645 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:42.347192 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67a9b4-6087-427f-9d8b-0d213c1b9645 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:42.410050 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e01e30-77a2-49d0-8fcf-884e0d3fc78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:42.410662 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e01e30-77a2-49d0-8fcf-884e0d3fc78f admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:42.410942 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e01e30-77a2-49d0-8fcf-884e0d3fc78f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:42.411213 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e01e30-77a2-49d0-8fcf-884e0d3fc78f admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:42.411849 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e01e30-77a2-49d0-8fcf-884e0d3fc78f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:42.413865 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e01e30-77a2-49d0-8fcf-884e0d3fc78f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:42.521593 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 989/1979] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:12:42 2022] POST /identity/v3/users => generated 285 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:12:42.527522 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48ad06-b79b-46c7-96ea-794fe1ab2645 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:42.537814 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48ad06-b79b-46c7-96ea-794fe1ab2645 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:42.542918 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394d73b-a709-4a30-9201-462e7b24ef7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:42.543523 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394d73b-a709-4a30-9201-462e7b24ef7e admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:42.543804 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394d73b-a709-4a30-9201-462e7b24ef7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:42.544113 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394d73b-a709-4a30-9201-462e7b24ef7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:42.545002 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d394d73b-a709-4a30-9201-462e7b24ef7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:42.546491 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d394d73b-a709-4a30-9201-462e7b24ef7e admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:42.558809 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 991/1980] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:12:42.564249 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e01e30-77a2-49d0-8fcf-884e0d3fc78f admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:42.572746 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e01e30-77a2-49d0-8fcf-884e0d3fc78f admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:42.577434 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8a499-b636-47a4-b866-8df14c4db6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:42.578044 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8a499-b636-47a4-b866-8df14c4db6d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:42.578326 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8a499-b636-47a4-b866-8df14c4db6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:42.578603 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8a499-b636-47a4-b866-8df14c4db6d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:42.579263 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8a499-b636-47a4-b866-8df14c4db6d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:42.580916 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8a499-b636-47a4-b866-8df14c4db6d8 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:42.591473 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 990/1981] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:12:42.595690 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394d73b-a709-4a30-9201-462e7b24ef7e admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:42.610883 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394d73b-a709-4a30-9201-462e7b24ef7e admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:42.615728 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b241741-d2a7-49a3-8350-44542c5f30de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:42.616432 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b241741-d2a7-49a3-8350-44542c5f30de admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:42.616717 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b241741-d2a7-49a3-8350-44542c5f30de admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:42.617116 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b241741-d2a7-49a3-8350-44542c5f30de admin admin] PATH_INFO: `/v3/projects/06c8ce728d104b9ebfb92feb084daa01/users/9543242fbcad412ba81466a826241e1b/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:42.632549 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b241741-d2a7-49a3-8350-44542c5f30de admin admin] RBAC: Authorizing `identity:create_grant(project_id=06c8ce728d104b9ebfb92feb084daa01, user_id=9543242fbcad412ba81466a826241e1b, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:42.635317 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b241741-d2a7-49a3-8350-44542c5f30de admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:42.695425 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 992/1982] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:12:42 2022] PUT /identity/v3/projects/06c8ce728d104b9ebfb92feb084daa01/users/9543242fbcad412ba81466a826241e1b/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:12:42.706713 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a9b4a-00f8-4053-8093-6f108a2f9e87 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:42.707071 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a9b4a-00f8-4053-8093-6f108a2f9e87 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:42.707400 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a9b4a-00f8-4053-8093-6f108a2f9e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:42.738000 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-6e4a9b4a-00f8-4053-8093-6f108a2f9e87 None None] MFA Rules not processed for user `9543242fbcad412ba81466a826241e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:42.739431 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6e4a9b4a-00f8-4053-8093-6f108a2f9e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:42.806213 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 991/1983] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:12:43.077850 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:43.603838 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b241741-d2a7-49a3-8350-44542c5f30de admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:43.606001 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-8b241741-d2a7-49a3-8350-44542c5f30de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:43.672912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b241741-d2a7-49a3-8350-44542c5f30de admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:43.677529 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d0689b-2e31-45ad-9f4b-87787a98de7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:43.678158 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0689b-2e31-45ad-9f4b-87787a98de7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:43.678440 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0689b-2e31-45ad-9f4b-87787a98de7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:43.678738 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0689b-2e31-45ad-9f4b-87787a98de7e admin admin] PATH_INFO: `/v3/users/94475ca521f94967ac4793482522275e` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:43.679938 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d0689b-2e31-45ad-9f4b-87787a98de7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=94475ca521f94967ac4793482522275e)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:43.682052 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d0689b-2e31-45ad-9f4b-87787a98de7e admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:44.075262 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:44.204142 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-78d0689b-2e31-45ad-9f4b-87787a98de7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94475ca521f94967ac4793482522275e'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:44.351836 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-78d0689b-2e31-45ad-9f4b-87787a98de7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94475ca521f94967ac4793482522275e'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:44.368261 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-78d0689b-2e31-45ad-9f4b-87787a98de7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94475ca521f94967ac4793482522275e'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:44.369562 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-78d0689b-2e31-45ad-9f4b-87787a98de7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94475ca521f94967ac4793482522275e'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:44.377453 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-78d0689b-2e31-45ad-9f4b-87787a98de7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94475ca521f94967ac4793482522275e'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:44.384894 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 993/1984] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:12:43 2022] DELETE /identity/v3/users/94475ca521f94967ac4793482522275e => generated 0 bytes in 782 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:44.389265 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1eb56-9059-4737-856e-e9061fa90897 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:44.389704 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1eb56-9059-4737-856e-e9061fa90897 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:44.390045 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1eb56-9059-4737-856e-e9061fa90897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:44.423076 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-8dd1eb56-9059-4737-856e-e9061fa90897 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:44.423076 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8dd1eb56-9059-4737-856e-e9061fa90897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:44.502694 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 992/1985] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:12:44.512920 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d0689b-2e31-45ad-9f4b-87787a98de7e admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:44.514335 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-78d0689b-2e31-45ad-9f4b-87787a98de7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:44.570210 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d0689b-2e31-45ad-9f4b-87787a98de7e admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:44.574838 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf383d-5301-431a-ab8d-560c7205f72e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:44.579360 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf383d-5301-431a-ab8d-560c7205f72e service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:44.579360 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf383d-5301-431a-ab8d-560c7205f72e service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:44.579360 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf383d-5301-431a-ab8d-560c7205f72e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:44.585169 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf383d-5301-431a-ab8d-560c7205f72e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:44.586662 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf383d-5301-431a-ab8d-560c7205f72e service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:44.596678 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 994/1986] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:12:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:12:45.053937 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1eb56-9059-4737-856e-e9061fa90897 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:45.055386 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8dd1eb56-9059-4737-856e-e9061fa90897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:45.068331 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1eb56-9059-4737-856e-e9061fa90897 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:45.073605 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f6c8d-ac35-498d-a1f8-b200a50234a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:45.074263 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f6c8d-ac35-498d-a1f8-b200a50234a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:45.074567 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f6c8d-ac35-498d-a1f8-b200a50234a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:45.074847 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f6c8d-ac35-498d-a1f8-b200a50234a6 admin admin] PATH_INFO: `/v3/projects/04f12089e1284fe0b41261e15e3aec01` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:45.076082 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802f6c8d-ac35-498d-a1f8-b200a50234a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04f12089e1284fe0b41261e15e3aec01)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:45.079414 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802f6c8d-ac35-498d-a1f8-b200a50234a6 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:45.262072 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-802f6c8d-ac35-498d-a1f8-b200a50234a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04f12089e1284fe0b41261e15e3aec01', 'request_id': 'req-802f6c8d-ac35-498d-a1f8-b200a50234a6'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:45.268811 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-802f6c8d-ac35-498d-a1f8-b200a50234a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04f12089e1284fe0b41261e15e3aec01', 'request_id': 'req-802f6c8d-ac35-498d-a1f8-b200a50234a6'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:45.409502 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-802f6c8d-ac35-498d-a1f8-b200a50234a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04f12089e1284fe0b41261e15e3aec01', 'request_id': 'req-802f6c8d-ac35-498d-a1f8-b200a50234a6'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:45.412255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:45.422631 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-802f6c8d-ac35-498d-a1f8-b200a50234a6 admin admin] The token cache is being invalidate because project 04f12089e1284fe0b41261e15e3aec01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:12:45.422925 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-802f6c8d-ac35-498d-a1f8-b200a50234a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:45.423571 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-802f6c8d-ac35-498d-a1f8-b200a50234a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:45.425177 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 993/1987] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:12:45 2022] DELETE /identity/v3/projects/04f12089e1284fe0b41261e15e3aec01 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:45.430253 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825c54f-f0ee-4340-bead-680389302d5a None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:45.430751 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825c54f-f0ee-4340-bead-680389302d5a None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:45.430911 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825c54f-f0ee-4340-bead-680389302d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:45.453992 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-5825c54f-f0ee-4340-bead-680389302d5a None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:45.455370 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-5825c54f-f0ee-4340-bead-680389302d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:45.534224 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 995/1988] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:12:45.548424 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6235571-3dc3-4685-bc98-69d794f63947 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:45.548424 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6235571-3dc3-4685-bc98-69d794f63947 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:45.548424 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6235571-3dc3-4685-bc98-69d794f63947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:45.564015 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-f6235571-3dc3-4685-bc98-69d794f63947 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:45.565730 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f6235571-3dc3-4685-bc98-69d794f63947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:45.575825 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:45.578875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 994/1989] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:12:45.579831 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825c54f-f0ee-4340-bead-680389302d5a None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:45.592145 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825c54f-f0ee-4340-bead-680389302d5a None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:45.597244 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4eb939-79f7-43f0-be24-43887866ab28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:45.597803 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4eb939-79f7-43f0-be24-43887866ab28 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:45.598089 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4eb939-79f7-43f0-be24-43887866ab28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:45.598364 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4eb939-79f7-43f0-be24-43887866ab28 admin admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:45.599014 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4eb939-79f7-43f0-be24-43887866ab28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:12:45.599370 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4eb939-79f7-43f0-be24-43887866ab28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:45.601130 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4eb939-79f7-43f0-be24-43887866ab28 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:45.614837 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 996/1990] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:12:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 11:12:45.619698 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6235571-3dc3-4685-bc98-69d794f63947 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:45.629633 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6235571-3dc3-4685-bc98-69d794f63947 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:45.634975 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc6d9f-6f0c-4286-ba64-c3d40ac11128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:45.635589 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc6d9f-6f0c-4286-ba64-c3d40ac11128 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:45.635871 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc6d9f-6f0c-4286-ba64-c3d40ac11128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:45.636204 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc6d9f-6f0c-4286-ba64-c3d40ac11128 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:45.636873 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc6d9f-6f0c-4286-ba64-c3d40ac11128 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:45.638786 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc6d9f-6f0c-4286-ba64-c3d40ac11128 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:45.753501 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 995/1991] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:12:45 2022] POST /identity/v3/projects => generated 391 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:12:45.757690 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4eb939-79f7-43f0-be24-43887866ab28 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:45.768306 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4eb939-79f7-43f0-be24-43887866ab28 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:45.827181 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd47f4f-66fd-406c-8592-c6d5bccc73bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:45.827181 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd47f4f-66fd-406c-8592-c6d5bccc73bf admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:45.827181 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd47f4f-66fd-406c-8592-c6d5bccc73bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:45.827181 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd47f4f-66fd-406c-8592-c6d5bccc73bf admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:45.827692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd47f4f-66fd-406c-8592-c6d5bccc73bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:45.829496 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd47f4f-66fd-406c-8592-c6d5bccc73bf admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:45.929580 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 997/1992] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:12:45 2022] POST /identity/v3/users => generated 296 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:12:45.934355 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc6d9f-6f0c-4286-ba64-c3d40ac11128 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:45.944922 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc6d9f-6f0c-4286-ba64-c3d40ac11128 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:45.950449 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc074df-3d7c-46cd-a47f-fcd9fa916291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:45.954127 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc074df-3d7c-46cd-a47f-fcd9fa916291 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:45.954127 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc074df-3d7c-46cd-a47f-fcd9fa916291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:45.954127 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:45.954127 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc074df-3d7c-46cd-a47f-fcd9fa916291 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:45.954507 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc074df-3d7c-46cd-a47f-fcd9fa916291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:45.956389 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc074df-3d7c-46cd-a47f-fcd9fa916291 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:45.967049 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 996/1993] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:12:45.971669 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd47f4f-66fd-406c-8592-c6d5bccc73bf admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:45.982136 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd47f4f-66fd-406c-8592-c6d5bccc73bf admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:45.986789 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ed9a1-df18-44ae-87ee-474f1a8500a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:45.987385 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ed9a1-df18-44ae-87ee-474f1a8500a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:45.987690 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ed9a1-df18-44ae-87ee-474f1a8500a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:45.987964 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ed9a1-df18-44ae-87ee-474f1a8500a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:45.988628 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ed9a1-df18-44ae-87ee-474f1a8500a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:45.990262 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ed9a1-df18-44ae-87ee-474f1a8500a4 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:46.001759 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 998/1994] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:12:46.005662 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc074df-3d7c-46cd-a47f-fcd9fa916291 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:46.015717 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc074df-3d7c-46cd-a47f-fcd9fa916291 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:46.020481 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0da7ac-b209-48a7-987f-699e0fa5d720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:46.021144 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0da7ac-b209-48a7-987f-699e0fa5d720 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:46.021428 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0da7ac-b209-48a7-987f-699e0fa5d720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:46.021706 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0da7ac-b209-48a7-987f-699e0fa5d720 admin admin] PATH_INFO: `/v3/projects/709d2a92c44044eb99b6eb0b49e55e5e/users/73ef3490c0584ada8a15b896505fa0ac/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:46.036239 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0da7ac-b209-48a7-987f-699e0fa5d720 admin admin] RBAC: Authorizing `identity:create_grant(project_id=709d2a92c44044eb99b6eb0b49e55e5e, user_id=73ef3490c0584ada8a15b896505fa0ac, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:46.038997 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0da7ac-b209-48a7-987f-699e0fa5d720 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:46.158780 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 997/1995] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:12:46 2022] PUT /identity/v3/projects/709d2a92c44044eb99b6eb0b49e55e5e/users/73ef3490c0584ada8a15b896505fa0ac/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:46.171189 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed14185-3ff6-4a67-86d6-05c144eae55d None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:46.171473 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed14185-3ff6-4a67-86d6-05c144eae55d None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:46.171747 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed14185-3ff6-4a67-86d6-05c144eae55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:46.200019 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-6ed14185-3ff6-4a67-86d6-05c144eae55d None None] MFA Rules not processed for user `73ef3490c0584ada8a15b896505fa0ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:46.201255 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-6ed14185-3ff6-4a67-86d6-05c144eae55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:46.267546 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 999/1996] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:46 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:12:46.278345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0da7ac-b209-48a7-987f-699e0fa5d720 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:46.280014 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7b0da7ac-b209-48a7-987f-699e0fa5d720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:46.341047 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0da7ac-b209-48a7-987f-699e0fa5d720 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:46.345005 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838733da-feae-42c1-80ee-91f3bed1c073 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:46.345813 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838733da-feae-42c1-80ee-91f3bed1c073 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:46.346421 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838733da-feae-42c1-80ee-91f3bed1c073 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:46.346706 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838733da-feae-42c1-80ee-91f3bed1c073 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:46.356510 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838733da-feae-42c1-80ee-91f3bed1c073 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:46.357951 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838733da-feae-42c1-80ee-91f3bed1c073 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:46.366928 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 998/1997] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:12:46 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:12:46.764150 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed14185-3ff6-4a67-86d6-05c144eae55d None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:46.765583 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-6ed14185-3ff6-4a67-86d6-05c144eae55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:46.838666 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed14185-3ff6-4a67-86d6-05c144eae55d None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:46.843845 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394547f5-a81c-4a18-88c0-201e8d1c28a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:46.844584 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394547f5-a81c-4a18-88c0-201e8d1c28a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:46.844944 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394547f5-a81c-4a18-88c0-201e8d1c28a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:46.845226 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394547f5-a81c-4a18-88c0-201e8d1c28a3 admin admin] PATH_INFO: `/v3/users/2f05fc3ff5a44539b76a57ca31b17308` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:46.847084 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394547f5-a81c-4a18-88c0-201e8d1c28a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f05fc3ff5a44539b76a57ca31b17308)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:46.849252 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394547f5-a81c-4a18-88c0-201e8d1c28a3 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:47.084103 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-394547f5-a81c-4a18-88c0-201e8d1c28a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f05fc3ff5a44539b76a57ca31b17308'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:47.156354 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-394547f5-a81c-4a18-88c0-201e8d1c28a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f05fc3ff5a44539b76a57ca31b17308'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:47.165864 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-394547f5-a81c-4a18-88c0-201e8d1c28a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f05fc3ff5a44539b76a57ca31b17308'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:47.166621 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-394547f5-a81c-4a18-88c0-201e8d1c28a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f05fc3ff5a44539b76a57ca31b17308'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:47.173792 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-394547f5-a81c-4a18-88c0-201e8d1c28a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f05fc3ff5a44539b76a57ca31b17308'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:47.183511 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1000/1998] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:12:46 2022] DELETE /identity/v3/users/2f05fc3ff5a44539b76a57ca31b17308 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:47.188073 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e06997-7eee-40c0-8a04-635acfc34de1 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:47.188572 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e06997-7eee-40c0-8a04-635acfc34de1 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:47.188717 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e06997-7eee-40c0-8a04-635acfc34de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:47.208204 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-c6e06997-7eee-40c0-8a04-635acfc34de1 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:47.209421 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c6e06997-7eee-40c0-8a04-635acfc34de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:47.269330 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 999/1999] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:12:47.279648 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394547f5-a81c-4a18-88c0-201e8d1c28a3 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:47.281661 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-394547f5-a81c-4a18-88c0-201e8d1c28a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:47.337722 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394547f5-a81c-4a18-88c0-201e8d1c28a3 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:47.342008 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e215799-35b5-4f6a-8efb-b08ff7cef8b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:47.342629 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e215799-35b5-4f6a-8efb-b08ff7cef8b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:47.342912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e215799-35b5-4f6a-8efb-b08ff7cef8b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:47.343188 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e215799-35b5-4f6a-8efb-b08ff7cef8b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:47.352582 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e215799-35b5-4f6a-8efb-b08ff7cef8b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:47.354000 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e215799-35b5-4f6a-8efb-b08ff7cef8b5 service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:47.363311 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1001/2000] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:12:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:12:47.775583 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:47.843229 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e06997-7eee-40c0-8a04-635acfc34de1 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:47.844713 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c6e06997-7eee-40c0-8a04-635acfc34de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:47.857472 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e06997-7eee-40c0-8a04-635acfc34de1 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:47.862753 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd8a591-6f63-40e6-a7b5-c181657ab1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:47.863562 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8a591-6f63-40e6-a7b5-c181657ab1ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:47.863912 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8a591-6f63-40e6-a7b5-c181657ab1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:47.864235 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8a591-6f63-40e6-a7b5-c181657ab1ff admin admin] PATH_INFO: `/v3/projects/5be198aed6234248b119ae68e1642097` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:47.865863 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd8a591-6f63-40e6-a7b5-c181657ab1ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=5be198aed6234248b119ae68e1642097)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:47.867909 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd8a591-6f63-40e6-a7b5-c181657ab1ff admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:48.007449 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9cd8a591-6f63-40e6-a7b5-c181657ab1ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5be198aed6234248b119ae68e1642097', 'request_id': 'req-9cd8a591-6f63-40e6-a7b5-c181657ab1ff'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:48.013954 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9cd8a591-6f63-40e6-a7b5-c181657ab1ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5be198aed6234248b119ae68e1642097', 'request_id': 'req-9cd8a591-6f63-40e6-a7b5-c181657ab1ff'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:48.115665 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9cd8a591-6f63-40e6-a7b5-c181657ab1ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5be198aed6234248b119ae68e1642097', 'request_id': 'req-9cd8a591-6f63-40e6-a7b5-c181657ab1ff'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:48.127188 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9cd8a591-6f63-40e6-a7b5-c181657ab1ff admin admin] The token cache is being invalidate because project 5be198aed6234248b119ae68e1642097 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:12:48.127482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9cd8a591-6f63-40e6-a7b5-c181657ab1ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:48.128162 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9cd8a591-6f63-40e6-a7b5-c181657ab1ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:48.129705 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1000/2001] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:12:47 2022] DELETE /identity/v3/projects/5be198aed6234248b119ae68e1642097 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:48.134576 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809eff99-d1ea-477c-9f35-ac192cff4773 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:48.134864 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809eff99-d1ea-477c-9f35-ac192cff4773 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:48.135139 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809eff99-d1ea-477c-9f35-ac192cff4773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:48.163471 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-809eff99-d1ea-477c-9f35-ac192cff4773 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:48.165777 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-809eff99-d1ea-477c-9f35-ac192cff4773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:48.230091 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1002/2002] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:12:48.237965 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef3fb9-fd61-46eb-b103-c55ed7cc1abb None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:48.238452 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef3fb9-fd61-46eb-b103-c55ed7cc1abb None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:48.238552 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef3fb9-fd61-46eb-b103-c55ed7cc1abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:48.260984 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-45ef3fb9-fd61-46eb-b103-c55ed7cc1abb None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:48.262592 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-45ef3fb9-fd61-46eb-b103-c55ed7cc1abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:48.270281 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1001/2003] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:12:48.275277 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809eff99-d1ea-477c-9f35-ac192cff4773 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:48.285361 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809eff99-d1ea-477c-9f35-ac192cff4773 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:48.290176 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716ba6c-43ee-41ae-9a42-1760c03b3459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:48.290781 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716ba6c-43ee-41ae-9a42-1760c03b3459 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:48.291065 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716ba6c-43ee-41ae-9a42-1760c03b3459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:48.291346 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716ba6c-43ee-41ae-9a42-1760c03b3459 admin admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:48.291990 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716ba6c-43ee-41ae-9a42-1760c03b3459 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:12:48.292326 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716ba6c-43ee-41ae-9a42-1760c03b3459 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:48.293939 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716ba6c-43ee-41ae-9a42-1760c03b3459 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:48.305317 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1003/2004] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:12:48.309706 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef3fb9-fd61-46eb-b103-c55ed7cc1abb None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:48.320488 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef3fb9-fd61-46eb-b103-c55ed7cc1abb None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:48.325868 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d881a-09cd-40fc-aa11-7d6bcbf16fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:48.326587 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d881a-09cd-40fc-aa11-7d6bcbf16fb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:48.326870 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d881a-09cd-40fc-aa11-7d6bcbf16fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:48.327278 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d881a-09cd-40fc-aa11-7d6bcbf16fb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:48.327983 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d881a-09cd-40fc-aa11-7d6bcbf16fb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:48.329923 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d881a-09cd-40fc-aa11-7d6bcbf16fb6 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:48.385597 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:48.445210 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1002/2005] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:12:48 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:12:48.450046 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716ba6c-43ee-41ae-9a42-1760c03b3459 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:48.460052 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716ba6c-43ee-41ae-9a42-1760c03b3459 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:48.521605 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2b153-bfec-43ab-a12f-58ca4b5f61e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:48.522247 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2b153-bfec-43ab-a12f-58ca4b5f61e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:48.522531 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2b153-bfec-43ab-a12f-58ca4b5f61e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:48.522804 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2b153-bfec-43ab-a12f-58ca4b5f61e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:48.523436 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d2b153-bfec-43ab-a12f-58ca4b5f61e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:48.525939 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d2b153-bfec-43ab-a12f-58ca4b5f61e8 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:48.670144 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1004/2006] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:12:48 2022] POST /identity/v3/users => generated 293 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:12:48.676610 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d881a-09cd-40fc-aa11-7d6bcbf16fb6 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:48.691672 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d881a-09cd-40fc-aa11-7d6bcbf16fb6 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:48.697331 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97cc24c-857a-4367-afb2-55809956f5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:48.697959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cc24c-857a-4367-afb2-55809956f5b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:48.698242 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cc24c-857a-4367-afb2-55809956f5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:48.698546 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cc24c-857a-4367-afb2-55809956f5b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:48.699169 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97cc24c-857a-4367-afb2-55809956f5b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:48.700824 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97cc24c-857a-4367-afb2-55809956f5b4 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:48.712504 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1003/2007] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:12:48.717202 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2b153-bfec-43ab-a12f-58ca4b5f61e8 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:48.732713 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2b153-bfec-43ab-a12f-58ca4b5f61e8 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:48.737758 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524b325-9319-4bb4-be76-e2f1e2b34228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:48.738455 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524b325-9319-4bb4-be76-e2f1e2b34228 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:48.738824 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524b325-9319-4bb4-be76-e2f1e2b34228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:48.739106 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524b325-9319-4bb4-be76-e2f1e2b34228 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:48.739753 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524b325-9319-4bb4-be76-e2f1e2b34228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:48.741439 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524b325-9319-4bb4-be76-e2f1e2b34228 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:48.756911 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1005/2008] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:12:48.761181 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97cc24c-857a-4367-afb2-55809956f5b4 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:48.772314 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97cc24c-857a-4367-afb2-55809956f5b4 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:48.777046 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345c50f-87af-4971-b819-b782a8b978fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:48.777719 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345c50f-87af-4971-b819-b782a8b978fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:48.778002 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345c50f-87af-4971-b819-b782a8b978fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:48.778276 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345c50f-87af-4971-b819-b782a8b978fe admin admin] PATH_INFO: `/v3/projects/6d6b6902b9c94925ba8dd044c3803a93/users/7bee05625f1549f8b48f15391f3ab6b6/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:48.793199 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0345c50f-87af-4971-b819-b782a8b978fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d6b6902b9c94925ba8dd044c3803a93, user_id=7bee05625f1549f8b48f15391f3ab6b6, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:48.796081 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0345c50f-87af-4971-b819-b782a8b978fe admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:48.918320 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1004/2009] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:12:48 2022] PUT /identity/v3/projects/6d6b6902b9c94925ba8dd044c3803a93/users/7bee05625f1549f8b48f15391f3ab6b6/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:48.928711 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45455bf9-0e09-404b-95bd-49dae70cf346 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:48.929194 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45455bf9-0e09-404b-95bd-49dae70cf346 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:48.929380 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45455bf9-0e09-404b-95bd-49dae70cf346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:48.957965 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-45455bf9-0e09-404b-95bd-49dae70cf346 None None] MFA Rules not processed for user `7bee05625f1549f8b48f15391f3ab6b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:48.959193 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-45455bf9-0e09-404b-95bd-49dae70cf346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:49.023152 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1006/2010] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:12:49.034752 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345c50f-87af-4971-b819-b782a8b978fe admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:49.036552 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0345c50f-87af-4971-b819-b782a8b978fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:49.102944 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345c50f-87af-4971-b819-b782a8b978fe admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:49.106741 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c75a0-6545-49db-8dd7-120bd4aadef9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:49.107351 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c75a0-6545-49db-8dd7-120bd4aadef9 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:49.107631 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c75a0-6545-49db-8dd7-120bd4aadef9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:49.107900 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c75a0-6545-49db-8dd7-120bd4aadef9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:49.116551 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c75a0-6545-49db-8dd7-120bd4aadef9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:49.118980 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c75a0-6545-49db-8dd7-120bd4aadef9 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:49.128374 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1005/2011] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:12:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:12:49.844522 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:50.090601 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:51.001589 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45455bf9-0e09-404b-95bd-49dae70cf346 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:51.003005 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-45455bf9-0e09-404b-95bd-49dae70cf346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:51.062399 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45455bf9-0e09-404b-95bd-49dae70cf346 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:51.067447 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde381b-150d-45af-b082-2594e0cdb84e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d0e8cc074b4e36acc2162aebeac169', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:51.068097 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde381b-150d-45af-b082-2594e0cdb84e service glance] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:51.068379 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde381b-150d-45af-b082-2594e0cdb84e service glance] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:51.068649 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde381b-150d-45af-b082-2594e0cdb84e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:51.070408 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-3bde381b-150d-45af-b082-2594e0cdb84e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:51.136841 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde381b-150d-45af-b082-2594e0cdb84e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:51.138349 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde381b-150d-45af-b082-2594e0cdb84e service glance] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:51.147858 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1007/2012] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:12:51 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:12:51.804643 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa43061-19a8-4e7f-9794-106806494576 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:51.805153 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa43061-19a8-4e7f-9794-106806494576 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:51.805302 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa43061-19a8-4e7f-9794-106806494576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:51.825353 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-afa43061-19a8-4e7f-9794-106806494576 None None] MFA Rules not processed for user `3c90765757a34c6291c9980a7d5d5c79`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:51.826632 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-afa43061-19a8-4e7f-9794-106806494576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:51.887612 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1006/2013] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Oct 26 11:12:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:12:51.962350 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde381b-150d-45af-b082-2594e0cdb84e service glance] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:51.963875 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-3bde381b-150d-45af-b082-2594e0cdb84e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:52.042463 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde381b-150d-45af-b082-2594e0cdb84e service glance] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:52.047731 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19589d-8e91-461e-984d-e5317b1c4ceb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21b84cc38a848de8d19a41e1eb04a58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:52.048677 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19589d-8e91-461e-984d-e5317b1c4ceb service swift] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:52.048677 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19589d-8e91-461e-984d-e5317b1c4ceb service swift] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:52.048847 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19589d-8e91-461e-984d-e5317b1c4ceb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:52.077747 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19589d-8e91-461e-984d-e5317b1c4ceb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:52.079941 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19589d-8e91-461e-984d-e5317b1c4ceb service swift] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:52.090067 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1008/2014] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Oct 26 11:12:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 26 11:12:52.640898 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa43061-19a8-4e7f-9794-106806494576 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:52.741653 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa43061-19a8-4e7f-9794-106806494576 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:52.749457 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea2420-a9ca-45db-b931-06227d53a6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:52.750402 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea2420-a9ca-45db-b931-06227d53a6ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:52.750692 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea2420-a9ca-45db-b931-06227d53a6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:52.750972 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea2420-a9ca-45db-b931-06227d53a6ab admin admin] PATH_INFO: `/v3/users/7bee05625f1549f8b48f15391f3ab6b6` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:52.752473 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ea2420-a9ca-45db-b931-06227d53a6ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bee05625f1549f8b48f15391f3ab6b6)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:52.754930 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ea2420-a9ca-45db-b931-06227d53a6ab admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:52.789516 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:53.018173 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:53.046116 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c6ea2420-a9ca-45db-b931-06227d53a6ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bee05625f1549f8b48f15391f3ab6b6'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:53.158281 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c6ea2420-a9ca-45db-b931-06227d53a6ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bee05625f1549f8b48f15391f3ab6b6'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:53.201020 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c6ea2420-a9ca-45db-b931-06227d53a6ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bee05625f1549f8b48f15391f3ab6b6'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:53.210044 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c6ea2420-a9ca-45db-b931-06227d53a6ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bee05625f1549f8b48f15391f3ab6b6'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:53.214436 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c6ea2420-a9ca-45db-b931-06227d53a6ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bee05625f1549f8b48f15391f3ab6b6'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:53.217619 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1007/2015] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:12:52 2022] DELETE /identity/v3/users/7bee05625f1549f8b48f15391f3ab6b6 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:53.222334 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca38fec-263c-49b3-8a7f-ef0e35ba1d23 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:53.222629 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca38fec-263c-49b3-8a7f-ef0e35ba1d23 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:53.222911 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca38fec-263c-49b3-8a7f-ef0e35ba1d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:53.257604 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-8ca38fec-263c-49b3-8a7f-ef0e35ba1d23 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:53.262678 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-8ca38fec-263c-49b3-8a7f-ef0e35ba1d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:53.393498 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1009/2016] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:12:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:12:53.393620 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea2420-a9ca-45db-b931-06227d53a6ab admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:53.397505 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c6ea2420-a9ca-45db-b931-06227d53a6ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:53.520767 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea2420-a9ca-45db-b931-06227d53a6ab admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:53.528985 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ba0f2-8dd1-4e69-9572-7b46c6787055 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:53.529837 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ba0f2-8dd1-4e69-9572-7b46c6787055 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:53.529985 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ba0f2-8dd1-4e69-9572-7b46c6787055 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:53.530482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ba0f2-8dd1-4e69-9572-7b46c6787055 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:53.545054 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ba0f2-8dd1-4e69-9572-7b46c6787055 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:53.546479 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ba0f2-8dd1-4e69-9572-7b46c6787055 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:53.559602 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1008/2017] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:12:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:12:54.278688 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca38fec-263c-49b3-8a7f-ef0e35ba1d23 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:54.281061 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-8ca38fec-263c-49b3-8a7f-ef0e35ba1d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:54.299457 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca38fec-263c-49b3-8a7f-ef0e35ba1d23 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:54.315241 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92095988-deca-41f4-ab03-ff5addeefad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:54.318609 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92095988-deca-41f4-ab03-ff5addeefad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:54.319049 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92095988-deca-41f4-ab03-ff5addeefad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:54.319401 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92095988-deca-41f4-ab03-ff5addeefad9 admin admin] PATH_INFO: `/v3/projects/6d6b6902b9c94925ba8dd044c3803a93` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:54.323101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92095988-deca-41f4-ab03-ff5addeefad9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d6b6902b9c94925ba8dd044c3803a93)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:54.327531 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92095988-deca-41f4-ab03-ff5addeefad9 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:54.658090 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-92095988-deca-41f4-ab03-ff5addeefad9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d6b6902b9c94925ba8dd044c3803a93', 'request_id': 'req-92095988-deca-41f4-ab03-ff5addeefad9'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:54.753111 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-92095988-deca-41f4-ab03-ff5addeefad9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d6b6902b9c94925ba8dd044c3803a93', 'request_id': 'req-92095988-deca-41f4-ab03-ff5addeefad9'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:54.762871 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-92095988-deca-41f4-ab03-ff5addeefad9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d6b6902b9c94925ba8dd044c3803a93', 'request_id': 'req-92095988-deca-41f4-ab03-ff5addeefad9'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:54.784007 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-92095988-deca-41f4-ab03-ff5addeefad9 admin admin] The token cache is being invalidate because project 6d6b6902b9c94925ba8dd044c3803a93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:12:54.784343 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-92095988-deca-41f4-ab03-ff5addeefad9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:54.785239 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-92095988-deca-41f4-ab03-ff5addeefad9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:12:54.787122 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1010/2018] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:12:54 2022] DELETE /identity/v3/projects/6d6b6902b9c94925ba8dd044c3803a93 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:12:55.618835 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:56.333029 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:58.431202 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:58.907282 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:59.636485 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ba0f2-8dd1-4e69-9572-7b46c6787055 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:59.638252 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-393ba0f2-8dd1-4e69-9572-7b46c6787055 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:59.669896 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ba0f2-8dd1-4e69-9572-7b46c6787055 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:59.789239 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef4611-404c-47b1-be96-de9de527c609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:59.790477 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef4611-404c-47b1-be96-de9de527c609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:59.790767 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef4611-404c-47b1-be96-de9de527c609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:59.791208 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef4611-404c-47b1-be96-de9de527c609 admin admin] PATH_INFO: `/v3/users/38894b69804d4822918e7183d8b1e3b4` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:59.792499 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef4611-404c-47b1-be96-de9de527c609 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38894b69804d4822918e7183d8b1e3b4)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:59.794874 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef4611-404c-47b1-be96-de9de527c609 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:59.959223 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92095988-deca-41f4-ab03-ff5addeefad9 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:59.960731 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-92095988-deca-41f4-ab03-ff5addeefad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:59.979906 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92095988-deca-41f4-ab03-ff5addeefad9 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:59.993132 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa6d19-a84a-4538-8584-ffb29ac88449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:59.993759 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa6d19-a84a-4538-8584-ffb29ac88449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:59.994043 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa6d19-a84a-4538-8584-ffb29ac88449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:59.994317 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa6d19-a84a-4538-8584-ffb29ac88449 admin admin] PATH_INFO: `/v3/users/73ef3490c0584ada8a15b896505fa0ac` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:59.995771 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa6d19-a84a-4538-8584-ffb29ac88449 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73ef3490c0584ada8a15b896505fa0ac)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:59.997845 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa6d19-a84a-4538-8584-ffb29ac88449 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:00.379907 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:00.592277 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-50fa6d19-a84a-4538-8584-ffb29ac88449 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73ef3490c0584ada8a15b896505fa0ac'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:13:00.598904 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-21ef4611-404c-47b1-be96-de9de527c609 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38894b69804d4822918e7183d8b1e3b4'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:13:00.721208 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-50fa6d19-a84a-4538-8584-ffb29ac88449 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73ef3490c0584ada8a15b896505fa0ac'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:13:00.742635 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-50fa6d19-a84a-4538-8584-ffb29ac88449 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73ef3490c0584ada8a15b896505fa0ac'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:13:00.744800 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-50fa6d19-a84a-4538-8584-ffb29ac88449 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73ef3490c0584ada8a15b896505fa0ac'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:13:00.754788 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-50fa6d19-a84a-4538-8584-ffb29ac88449 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73ef3490c0584ada8a15b896505fa0ac'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:13:00.763670 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1011/2019] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:12:59 2022] DELETE /identity/v3/users/73ef3490c0584ada8a15b896505fa0ac => generated 0 bytes in 805 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:13:00.768080 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114dd318-06a6-42aa-9cff-1fffd315cffe None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:00.768597 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114dd318-06a6-42aa-9cff-1fffd315cffe None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:00.769043 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114dd318-06a6-42aa-9cff-1fffd315cffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:00.794370 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-114dd318-06a6-42aa-9cff-1fffd315cffe None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:13:00.794370 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-114dd318-06a6-42aa-9cff-1fffd315cffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:00.809725 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-21ef4611-404c-47b1-be96-de9de527c609 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38894b69804d4822918e7183d8b1e3b4'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:13:00.828960 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-21ef4611-404c-47b1-be96-de9de527c609 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38894b69804d4822918e7183d8b1e3b4'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:13:00.845113 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-21ef4611-404c-47b1-be96-de9de527c609 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38894b69804d4822918e7183d8b1e3b4'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:13:00.846159 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-21ef4611-404c-47b1-be96-de9de527c609 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38894b69804d4822918e7183d8b1e3b4'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:13:00.872786 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1009/2020] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:12:59 2022] DELETE /identity/v3/users/38894b69804d4822918e7183d8b1e3b4 => generated 0 bytes in 1231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:13:00.874266 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ee7d0-26ad-4aaa-89a2-1c80e8fc8114 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:00.874564 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ee7d0-26ad-4aaa-89a2-1c80e8fc8114 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:00.874848 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ee7d0-26ad-4aaa-89a2-1c80e8fc8114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:00.910752 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-b34ee7d0-26ad-4aaa-89a2-1c80e8fc8114 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:13:00.912358 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b34ee7d0-26ad-4aaa-89a2-1c80e8fc8114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:00.939498 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1012/2021] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:13:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:13:00.949156 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114dd318-06a6-42aa-9cff-1fffd315cffe None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:00.953930 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-114dd318-06a6-42aa-9cff-1fffd315cffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:01.025552 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1010/2022] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:13:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:13:01.039616 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ee7d0-26ad-4aaa-89a2-1c80e8fc8114 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:01.041760 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b34ee7d0-26ad-4aaa-89a2-1c80e8fc8114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:01.075981 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114dd318-06a6-42aa-9cff-1fffd315cffe None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:01.156529 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ee7d0-26ad-4aaa-89a2-1c80e8fc8114 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:01.166536 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cefc9a-c8cd-4ff8-8874-09b34777f4c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:01.167176 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cefc9a-c8cd-4ff8-8874-09b34777f4c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:01.167459 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cefc9a-c8cd-4ff8-8874-09b34777f4c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:01.167742 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cefc9a-c8cd-4ff8-8874-09b34777f4c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:01.169643 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6cae3-51b9-43ad-819d-f5efe15a6a6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:01.170486 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6cae3-51b9-43ad-819d-f5efe15a6a6d service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:01.170940 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6cae3-51b9-43ad-819d-f5efe15a6a6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:01.172745 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6cae3-51b9-43ad-819d-f5efe15a6a6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:01.179804 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cefc9a-c8cd-4ff8-8874-09b34777f4c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:01.182157 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cefc9a-c8cd-4ff8-8874-09b34777f4c0 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:01.188672 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6cae3-51b9-43ad-819d-f5efe15a6a6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:01.191182 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6cae3-51b9-43ad-819d-f5efe15a6a6d service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:01.204537 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:01.206558 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1013/2023] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:13:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:13:01.214052 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1011/2024] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:13:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:13:01.727067 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:01.998661 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6cae3-51b9-43ad-819d-f5efe15a6a6d service neutron] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:02.001662 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-64c6cae3-51b9-43ad-819d-f5efe15a6a6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:02.019727 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6cae3-51b9-43ad-819d-f5efe15a6a6d service neutron] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:02.031779 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ef16e-ba6b-4124-9fb8-d1460afb1c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:02.033168 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cefc9a-c8cd-4ff8-8874-09b34777f4c0 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:02.041059 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-64cefc9a-c8cd-4ff8-8874-09b34777f4c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:02.052272 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ef16e-ba6b-4124-9fb8-d1460afb1c7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:02.060280 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ef16e-ba6b-4124-9fb8-d1460afb1c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:02.060576 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ef16e-ba6b-4124-9fb8-d1460afb1c7c admin admin] PATH_INFO: `/v3/projects/709d2a92c44044eb99b6eb0b49e55e5e` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:02.063350 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ef16e-ba6b-4124-9fb8-d1460afb1c7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=709d2a92c44044eb99b6eb0b49e55e5e)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:02.067887 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ef16e-ba6b-4124-9fb8-d1460afb1c7c admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:02.073692 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cefc9a-c8cd-4ff8-8874-09b34777f4c0 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:02.079988 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c86b74-434d-4287-877c-60febca95ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:02.081322 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c86b74-434d-4287-877c-60febca95ad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:02.081687 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c86b74-434d-4287-877c-60febca95ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:02.082024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c86b74-434d-4287-877c-60febca95ad9 admin admin] PATH_INFO: `/v3/projects/1716d0bd65664ad7bffdab382b2786d4` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:02.083666 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c86b74-434d-4287-877c-60febca95ad9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1716d0bd65664ad7bffdab382b2786d4)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:02.098600 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c86b74-434d-4287-877c-60febca95ad9 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:02.258234 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-68c86b74-434d-4287-877c-60febca95ad9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1716d0bd65664ad7bffdab382b2786d4', 'request_id': 'req-68c86b74-434d-4287-877c-60febca95ad9'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:13:02.261670 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-061ef16e-ba6b-4124-9fb8-d1460afb1c7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '709d2a92c44044eb99b6eb0b49e55e5e', 'request_id': 'req-061ef16e-ba6b-4124-9fb8-d1460afb1c7c'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:13:02.270501 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-68c86b74-434d-4287-877c-60febca95ad9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1716d0bd65664ad7bffdab382b2786d4', 'request_id': 'req-68c86b74-434d-4287-877c-60febca95ad9'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:13:02.407136 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-061ef16e-ba6b-4124-9fb8-d1460afb1c7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '709d2a92c44044eb99b6eb0b49e55e5e', 'request_id': 'req-061ef16e-ba6b-4124-9fb8-d1460afb1c7c'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:13:02.414663 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-061ef16e-ba6b-4124-9fb8-d1460afb1c7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '709d2a92c44044eb99b6eb0b49e55e5e', 'request_id': 'req-061ef16e-ba6b-4124-9fb8-d1460afb1c7c'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:13:02.433969 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-061ef16e-ba6b-4124-9fb8-d1460afb1c7c admin admin] The token cache is being invalidate because project 709d2a92c44044eb99b6eb0b49e55e5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:13:02.434529 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-061ef16e-ba6b-4124-9fb8-d1460afb1c7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:13:02.435348 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-061ef16e-ba6b-4124-9fb8-d1460afb1c7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:13:02.437780 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1014/2025] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:13:01 2022] DELETE /identity/v3/projects/709d2a92c44044eb99b6eb0b49e55e5e => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:13:02.443234 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6ebe4-fc39-422e-abe3-3d376e235393 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:02.443806 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6ebe4-fc39-422e-abe3-3d376e235393 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:02.444324 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6ebe4-fc39-422e-abe3-3d376e235393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:02.474149 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-55d6ebe4-fc39-422e-abe3-3d376e235393 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:13:02.475700 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-55d6ebe4-fc39-422e-abe3-3d376e235393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:02.523775 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-68c86b74-434d-4287-877c-60febca95ad9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1716d0bd65664ad7bffdab382b2786d4', 'request_id': 'req-68c86b74-434d-4287-877c-60febca95ad9'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:13:02.537016 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-68c86b74-434d-4287-877c-60febca95ad9 admin admin] The token cache is being invalidate because project 1716d0bd65664ad7bffdab382b2786d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:13:02.537578 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-68c86b74-434d-4287-877c-60febca95ad9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:13:02.539019 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-68c86b74-434d-4287-877c-60febca95ad9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:13:02.541995 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1012/2026] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:13:02 2022] DELETE /identity/v3/projects/1716d0bd65664ad7bffdab382b2786d4 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:13:02.590108 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1015/2027] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:13:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:13:02.594876 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:02.598502 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405ad0c-972d-41b1-beda-9813fc5dcdde None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:02.598860 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405ad0c-972d-41b1-beda-9813fc5dcdde None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:02.599220 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405ad0c-972d-41b1-beda-9813fc5dcdde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:02.624018 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-9405ad0c-972d-41b1-beda-9813fc5dcdde None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:13:02.625525 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9405ad0c-972d-41b1-beda-9813fc5dcdde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:02.630444 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:02.654501 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1013/2028] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:13:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:13:02.659402 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6ebe4-fc39-422e-abe3-3d376e235393 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:02.673741 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6ebe4-fc39-422e-abe3-3d376e235393 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:02.680937 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90130be-3830-40a6-97b2-161ede3558a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:02.682408 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90130be-3830-40a6-97b2-161ede3558a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:02.682933 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90130be-3830-40a6-97b2-161ede3558a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:02.683308 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90130be-3830-40a6-97b2-161ede3558a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:02.684395 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90130be-3830-40a6-97b2-161ede3558a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:13:02.684966 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90130be-3830-40a6-97b2-161ede3558a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:02.686777 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90130be-3830-40a6-97b2-161ede3558a9 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:02.709307 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405ad0c-972d-41b1-beda-9813fc5dcdde None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:02.715606 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1016/2029] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:13:02.725494 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405ad0c-972d-41b1-beda-9813fc5dcdde None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:02.732389 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14254463-b679-4b0e-ad93-b6d7e218cd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:02.733488 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14254463-b679-4b0e-ad93-b6d7e218cd39 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:02.734207 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14254463-b679-4b0e-ad93-b6d7e218cd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:02.734741 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14254463-b679-4b0e-ad93-b6d7e218cd39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:02.735744 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14254463-b679-4b0e-ad93-b6d7e218cd39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:02.738590 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14254463-b679-4b0e-ad93-b6d7e218cd39 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:02.869760 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1014/2030] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:13:02 2022] POST /identity/v3/projects => generated 373 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:13:02.871692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90130be-3830-40a6-97b2-161ede3558a9 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:02.882401 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90130be-3830-40a6-97b2-161ede3558a9 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:02.947969 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80e233-dda4-4730-ac34-9229940244bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:02.948910 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80e233-dda4-4730-ac34-9229940244bf admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:02.949191 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80e233-dda4-4730-ac34-9229940244bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:02.949467 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80e233-dda4-4730-ac34-9229940244bf admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:02.950106 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab80e233-dda4-4730-ac34-9229940244bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:02.952141 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab80e233-dda4-4730-ac34-9229940244bf admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:03.044665 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1017/2031] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:13:02 2022] POST /identity/v3/users => generated 287 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:13:03.049219 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14254463-b679-4b0e-ad93-b6d7e218cd39 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:03.061060 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14254463-b679-4b0e-ad93-b6d7e218cd39 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:03.066181 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd834a6-34a2-48ec-88ed-b21ef69cffe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:03.066806 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd834a6-34a2-48ec-88ed-b21ef69cffe4 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:03.067087 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd834a6-34a2-48ec-88ed-b21ef69cffe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:03.067480 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd834a6-34a2-48ec-88ed-b21ef69cffe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:03.068163 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd834a6-34a2-48ec-88ed-b21ef69cffe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:03.069770 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd834a6-34a2-48ec-88ed-b21ef69cffe4 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:03.081791 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1015/2032] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:13:03.090771 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80e233-dda4-4730-ac34-9229940244bf admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:03.108564 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80e233-dda4-4730-ac34-9229940244bf admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:03.114108 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe8987-2ec6-40eb-a548-324ec966d6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:03.114900 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe8987-2ec6-40eb-a548-324ec966d6f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:03.115370 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe8987-2ec6-40eb-a548-324ec966d6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:03.115923 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe8987-2ec6-40eb-a548-324ec966d6f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:03.117130 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe8987-2ec6-40eb-a548-324ec966d6f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:03.119348 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe8987-2ec6-40eb-a548-324ec966d6f9 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:03.132593 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1018/2033] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:13:03.138648 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd834a6-34a2-48ec-88ed-b21ef69cffe4 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:03.150285 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd834a6-34a2-48ec-88ed-b21ef69cffe4 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:03.156077 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d70b80-800f-4e51-9492-0ec760c3cc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:03.162191 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d70b80-800f-4e51-9492-0ec760c3cc5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:03.162191 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d70b80-800f-4e51-9492-0ec760c3cc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:03.162191 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d70b80-800f-4e51-9492-0ec760c3cc5f admin admin] PATH_INFO: `/v3/projects/0ad996fc626841a8ae82fd8891084a3a/users/efbaebe9814441faa4efed0b4e4c7181/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:03.188042 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d70b80-800f-4e51-9492-0ec760c3cc5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ad996fc626841a8ae82fd8891084a3a, user_id=efbaebe9814441faa4efed0b4e4c7181, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:03.191451 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d70b80-800f-4e51-9492-0ec760c3cc5f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:03.402701 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1016/2034] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:13:03 2022] PUT /identity/v3/projects/0ad996fc626841a8ae82fd8891084a3a/users/efbaebe9814441faa4efed0b4e4c7181/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:13:03.404449 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aabf27-04bb-465e-ab85-661297b84734 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:03.404989 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aabf27-04bb-465e-ab85-661297b84734 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:03.405134 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aabf27-04bb-465e-ab85-661297b84734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:03.429467 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-88aabf27-04bb-465e-ab85-661297b84734 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:13:03.430778 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-88aabf27-04bb-465e-ab85-661297b84734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:03.516810 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:03.540110 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1019/2035] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:13:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:13:03.553322 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d70b80-800f-4e51-9492-0ec760c3cc5f admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:03.557918 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-96d70b80-800f-4e51-9492-0ec760c3cc5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:03.706060 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d70b80-800f-4e51-9492-0ec760c3cc5f admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:03.711551 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb39da-42fb-4423-830a-1a56e7520db9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:03.714027 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb39da-42fb-4423-830a-1a56e7520db9 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:03.714027 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb39da-42fb-4423-830a-1a56e7520db9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:03.714027 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb39da-42fb-4423-830a-1a56e7520db9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:03.732111 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb39da-42fb-4423-830a-1a56e7520db9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:03.732111 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb39da-42fb-4423-830a-1a56e7520db9 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:03.748765 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1017/2036] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:13:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:13:05.250218 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168d5f7-cfc1-4f46-825f-4d8758003407 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:05.250767 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168d5f7-cfc1-4f46-825f-4d8758003407 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:05.250767 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168d5f7-cfc1-4f46-825f-4d8758003407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:05.275834 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-1168d5f7-cfc1-4f46-825f-4d8758003407 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:13:05.277139 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-1168d5f7-cfc1-4f46-825f-4d8758003407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:05.286997 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1020/2037] 10.222.0.46 () {58 vars in 1016 bytes} [Wed Oct 26 11:13:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:13:05.306428 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb39da-42fb-4423-830a-1a56e7520db9 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:05.307894 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-75eb39da-42fb-4423-830a-1a56e7520db9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:05.398061 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb39da-42fb-4423-830a-1a56e7520db9 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:05.410612 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa8880-e170-4ce2-9bde-cbd91a842576 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:05.411259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa8880-e170-4ce2-9bde-cbd91a842576 service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:05.411549 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa8880-e170-4ce2-9bde-cbd91a842576 service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:05.411838 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa8880-e170-4ce2-9bde-cbd91a842576 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:05.424751 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa8880-e170-4ce2-9bde-cbd91a842576 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:05.426510 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa8880-e170-4ce2-9bde-cbd91a842576 service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:05.438067 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1018/2038] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:13:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:13:06.521693 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:07.276546 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:08.176668 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:09.993414 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:10.738300 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268b544-05a2-4d82-89be-d7b73e473c43 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:10.738511 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268b544-05a2-4d82-89be-d7b73e473c43 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:10.738953 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268b544-05a2-4d82-89be-d7b73e473c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:10.771741 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-7268b544-05a2-4d82-89be-d7b73e473c43 None None] MFA Rules not processed for user `efbaebe9814441faa4efed0b4e4c7181`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:13:10.773117 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-7268b544-05a2-4d82-89be-d7b73e473c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:10.787038 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:10.880998 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1021/2039] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:13:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:13:10.888614 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa8880-e170-4ce2-9bde-cbd91a842576 service nova] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:10.909931 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa8880-e170-4ce2-9bde-cbd91a842576 service nova] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:10.919384 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ace48c-704b-43c6-b06c-ffffb5a0740c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:10.920517 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ace48c-704b-43c6-b06c-ffffb5a0740c admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:10.921042 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ace48c-704b-43c6-b06c-ffffb5a0740c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:10.921722 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ace48c-704b-43c6-b06c-ffffb5a0740c admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:10.922611 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ace48c-704b-43c6-b06c-ffffb5a0740c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:10.925415 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ace48c-704b-43c6-b06c-ffffb5a0740c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:11.046458 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1019/2040] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:13:10 2022] POST /identity/v3/projects => generated 371 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:13:11.050586 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268b544-05a2-4d82-89be-d7b73e473c43 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:11.063172 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268b544-05a2-4d82-89be-d7b73e473c43 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:11.125766 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e8f8a6-a97f-4ccd-bf36-3afd430aa9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:11.129338 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8f8a6-a97f-4ccd-bf36-3afd430aa9e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:11.129338 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8f8a6-a97f-4ccd-bf36-3afd430aa9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:11.129338 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8f8a6-a97f-4ccd-bf36-3afd430aa9e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:11.129338 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e8f8a6-a97f-4ccd-bf36-3afd430aa9e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:11.130269 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e8f8a6-a97f-4ccd-bf36-3afd430aa9e9 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:11.239328 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c5e2e-2b8e-48ab-a611-ad3acae882e1 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:11.239779 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c5e2e-2b8e-48ab-a611-ad3acae882e1 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:11.240278 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c5e2e-2b8e-48ab-a611-ad3acae882e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:11.277255 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1022/2041] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:13:11 2022] POST /identity/v3/users => generated 292 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:13:11.280948 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e8f8a6-a97f-4ccd-bf36-3afd430aa9e9 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:11.301253 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-4f1c5e2e-2b8e-48ab-a611-ad3acae882e1 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:13:11.303879 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4f1c5e2e-2b8e-48ab-a611-ad3acae882e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:11.316306 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1020/2042] 10.222.0.46 () {58 vars in 1016 bytes} [Wed Oct 26 11:13:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:13:11.324551 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e8f8a6-a97f-4ccd-bf36-3afd430aa9e9 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:11.332927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c5e2e-2b8e-48ab-a611-ad3acae882e1 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:11.335072 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4f1c5e2e-2b8e-48ab-a611-ad3acae882e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:11.348483 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a62f618-5ab2-4aca-8876-62bd433520b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:11.349306 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62f618-5ab2-4aca-8876-62bd433520b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:11.349739 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62f618-5ab2-4aca-8876-62bd433520b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:11.350169 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62f618-5ab2-4aca-8876-62bd433520b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:11.350999 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a62f618-5ab2-4aca-8876-62bd433520b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:11.354800 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a62f618-5ab2-4aca-8876-62bd433520b6 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:11.371540 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1023/2043] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:13:11.377042 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a62f618-5ab2-4aca-8876-62bd433520b6 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:11.398139 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a62f618-5ab2-4aca-8876-62bd433520b6 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:11.408977 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80ca5b-4e99-4fed-844a-c8e7978c57d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:11.408977 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80ca5b-4e99-4fed-844a-c8e7978c57d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:11.408977 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80ca5b-4e99-4fed-844a-c8e7978c57d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:11.408977 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80ca5b-4e99-4fed-844a-c8e7978c57d8 admin admin] PATH_INFO: `/v3/projects/d6c4059f3f0e4b85ac633f17b2a2658b/users/e73b94ef47a44d249ffc3539bd480142/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:11.427268 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80ca5b-4e99-4fed-844a-c8e7978c57d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6c4059f3f0e4b85ac633f17b2a2658b, user_id=e73b94ef47a44d249ffc3539bd480142, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:11.431700 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80ca5b-4e99-4fed-844a-c8e7978c57d8 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:11.475290 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c5e2e-2b8e-48ab-a611-ad3acae882e1 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:11.485571 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af4fdf-5377-4319-bf88-244cd78fcec3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:11.485571 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af4fdf-5377-4319-bf88-244cd78fcec3 service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:11.485571 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af4fdf-5377-4319-bf88-244cd78fcec3 service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:11.487074 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af4fdf-5377-4319-bf88-244cd78fcec3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:11.501627 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af4fdf-5377-4319-bf88-244cd78fcec3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:11.501846 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af4fdf-5377-4319-bf88-244cd78fcec3 service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:11.517720 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1021/2044] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:13:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:13:11.600291 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1024/2045] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:13:11 2022] PUT /identity/v3/projects/d6c4059f3f0e4b85ac633f17b2a2658b/users/e73b94ef47a44d249ffc3539bd480142/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:13:11.602337 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af4fdf-5377-4319-bf88-244cd78fcec3 service nova] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:11.627017 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af4fdf-5377-4319-bf88-244cd78fcec3 service nova] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:11.721699 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb7ff4-9f83-402d-b0e0-036023d775cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:11.722349 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb7ff4-9f83-402d-b0e0-036023d775cd admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:11.725998 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb7ff4-9f83-402d-b0e0-036023d775cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:11.725998 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb7ff4-9f83-402d-b0e0-036023d775cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:11.725998 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb7ff4-9f83-402d-b0e0-036023d775cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:11.725998 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb7ff4-9f83-402d-b0e0-036023d775cd admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:11.745522 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1022/2046] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:13:11.747586 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80ca5b-4e99-4fed-844a-c8e7978c57d8 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:11.759853 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80ca5b-4e99-4fed-844a-c8e7978c57d8 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:11.771374 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19231cd9-2079-4af4-a215-37c1e57ab1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:11.772096 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19231cd9-2079-4af4-a215-37c1e57ab1b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:11.772377 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19231cd9-2079-4af4-a215-37c1e57ab1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:11.772676 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19231cd9-2079-4af4-a215-37c1e57ab1b5 admin admin] PATH_INFO: `/v3/projects/d6c4059f3f0e4b85ac633f17b2a2658b/users/e73b94ef47a44d249ffc3539bd480142/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:11.774676 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19231cd9-2079-4af4-a215-37c1e57ab1b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6c4059f3f0e4b85ac633f17b2a2658b, user_id=e73b94ef47a44d249ffc3539bd480142, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:11.781213 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19231cd9-2079-4af4-a215-37c1e57ab1b5 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:11.804127 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1025/2047] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:13:11 2022] PUT /identity/v3/projects/d6c4059f3f0e4b85ac633f17b2a2658b/users/e73b94ef47a44d249ffc3539bd480142/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:13:12.047870 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:12.961995 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:13.836557 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:15.166387 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c398a66-8bac-41eb-8a88-04001d6c2eb1 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:15.167453 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c398a66-8bac-41eb-8a88-04001d6c2eb1 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:15.168418 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c398a66-8bac-41eb-8a88-04001d6c2eb1 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:15.171516 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1023/2048] 10.222.0.45 () {54 vars in 921 bytes} [Wed Oct 26 11:13:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:13:15.177769 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870fc0d-0e2f-451c-9107-b600a801aed3 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:15.178274 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870fc0d-0e2f-451c-9107-b600a801aed3 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:15.178523 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870fc0d-0e2f-451c-9107-b600a801aed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:15.213833 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-8870fc0d-0e2f-451c-9107-b600a801aed3 None None] MFA Rules not processed for user `a852a777cb6a4863bebdb949cc71ea65`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:13:15.217754 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-8870fc0d-0e2f-451c-9107-b600a801aed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:15.380246 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1026/2049] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Oct 26 11:13:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:13:15.393333 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c398a66-8bac-41eb-8a88-04001d6c2eb1 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:15.395457 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2c398a66-8bac-41eb-8a88-04001d6c2eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:15.483143 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c398a66-8bac-41eb-8a88-04001d6c2eb1 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:15.488590 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9fc86d-9fc5-46cd-bbca-0439393b7782 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d0e8cc074b4e36acc2162aebeac169', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:15.489413 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fc86d-9fc5-46cd-bbca-0439393b7782 service glance] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:15.489773 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fc86d-9fc5-46cd-bbca-0439393b7782 service glance] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:15.490118 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fc86d-9fc5-46cd-bbca-0439393b7782 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:15.513388 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9fc86d-9fc5-46cd-bbca-0439393b7782 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:15.513388 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9fc86d-9fc5-46cd-bbca-0439393b7782 service glance] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:15.525698 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1024/2050] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:13:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:13:15.781837 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76f1da-db48-4f96-9a08-167f148f7c6b None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:15.782144 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76f1da-db48-4f96-9a08-167f148f7c6b None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:15.783158 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76f1da-db48-4f96-9a08-167f148f7c6b None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:15.784105 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1027/2051] 10.222.0.45 () {54 vars in 921 bytes} [Wed Oct 26 11:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:13:15.789400 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c3a78-ccf7-4f8a-bdd5-b397154a4be3 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:15.789990 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c3a78-ccf7-4f8a-bdd5-b397154a4be3 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:15.789990 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c3a78-ccf7-4f8a-bdd5-b397154a4be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:15.801884 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:15.823177 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-8c5c3a78-ccf7-4f8a-bdd5-b397154a4be3 None None] MFA Rules not processed for user `522b4232cb4d430988d76a1cdb281e72`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:13:15.824660 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8c5c3a78-ccf7-4f8a-bdd5-b397154a4be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:15.979337 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1025/2052] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Oct 26 11:13:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:13:15.988296 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76f1da-db48-4f96-9a08-167f148f7c6b None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:15.990501 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-7a76f1da-db48-4f96-9a08-167f148f7c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:16.016942 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76f1da-db48-4f96-9a08-167f148f7c6b None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:16.018807 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6788bb-dd93-421b-aba8-59af23ce231b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:16.019722 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6788bb-dd93-421b-aba8-59af23ce231b service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:16.020238 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6788bb-dd93-421b-aba8-59af23ce231b service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:16.020749 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6788bb-dd93-421b-aba8-59af23ce231b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:16.030435 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6788bb-dd93-421b-aba8-59af23ce231b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:16.031592 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6d4a3-2c20-4117-b355-1c601928f685 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:16.032017 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6788bb-dd93-421b-aba8-59af23ce231b service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:16.032151 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6d4a3-2c20-4117-b355-1c601928f685 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:16.032483 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6d4a3-2c20-4117-b355-1c601928f685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:16.050502 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1028/2053] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:13:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:13:16.075136 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-6be6d4a3-2c20-4117-b355-1c601928f685 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:13:16.076868 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6be6d4a3-2c20-4117-b355-1c601928f685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:16.164407 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53471ab6-8a45-4425-9798-afe1405aac9a None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:16.164875 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53471ab6-8a45-4425-9798-afe1405aac9a None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:16.165312 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53471ab6-8a45-4425-9798-afe1405aac9a None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:16.167543 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1029/2054] 10.222.0.45 () {54 vars in 921 bytes} [Wed Oct 26 11:13:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 11:13:16.172291 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1026/2055] 10.222.0.46 () {58 vars in 1016 bytes} [Wed Oct 26 11:13:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:13:16.173705 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a7872-8452-4a1c-9b56-fdf968f12116 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:16.174339 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a7872-8452-4a1c-9b56-fdf968f12116 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:16.174615 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a7872-8452-4a1c-9b56-fdf968f12116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:16.194125 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be6d4a3-2c20-4117-b355-1c601928f685 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:16.198042 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-eb7a7872-8452-4a1c-9b56-fdf968f12116 None None] MFA Rules not processed for user `a852a777cb6a4863bebdb949cc71ea65`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:13:16.200438 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-eb7a7872-8452-4a1c-9b56-fdf968f12116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:16.211672 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be6d4a3-2c20-4117-b355-1c601928f685 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:16.214873 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1030/2056] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Oct 26 11:13:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:13:16.220860 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c75d87-468b-431c-bc06-e7788e5a1b8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:16.228559 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c75d87-468b-431c-bc06-e7788e5a1b8c service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:16.228559 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c75d87-468b-431c-bc06-e7788e5a1b8c service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:16.228559 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c75d87-468b-431c-bc06-e7788e5a1b8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:16.228885 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a7872-8452-4a1c-9b56-fdf968f12116 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:16.238877 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a7872-8452-4a1c-9b56-fdf968f12116 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:16.242937 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df1c1b-c39e-444f-bdc6-e84aa322fcdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:16.243571 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df1c1b-c39e-444f-bdc6-e84aa322fcdb service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:16.243916 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df1c1b-c39e-444f-bdc6-e84aa322fcdb service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:16.244236 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df1c1b-c39e-444f-bdc6-e84aa322fcdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:16.257160 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c75d87-468b-431c-bc06-e7788e5a1b8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:16.261673 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df1c1b-c39e-444f-bdc6-e84aa322fcdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:16.264415 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df1c1b-c39e-444f-bdc6-e84aa322fcdb service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:16.264955 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c75d87-468b-431c-bc06-e7788e5a1b8c service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:16.278968 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1027/2057] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:13:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:13:16.292690 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1031/2058] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:13:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:13:16.958251 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:18.811858 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f85d6-9c21-4ad9-b091-a86179d45275 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:18.812435 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f85d6-9c21-4ad9-b091-a86179d45275 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:18.812516 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f85d6-9c21-4ad9-b091-a86179d45275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:18.879209 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-387f85d6-9c21-4ad9-b091-a86179d45275 None None] MFA Rules not processed for user `e73b94ef47a44d249ffc3539bd480142`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:13:18.880398 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-387f85d6-9c21-4ad9-b091-a86179d45275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:19.003516 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1028/2059] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:13:18 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:13:19.024178 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df1c1b-c39e-444f-bdc6-e84aa322fcdb service neutron] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:19.038477 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df1c1b-c39e-444f-bdc6-e84aa322fcdb service neutron] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:19.044750 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9415c1-cc78-4ecb-b94d-a59d55f50b20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:19.045425 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9415c1-cc78-4ecb-b94d-a59d55f50b20 service nova] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:19.045708 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9415c1-cc78-4ecb-b94d-a59d55f50b20 service nova] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:19.045980 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9415c1-cc78-4ecb-b94d-a59d55f50b20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:19.135716 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9415c1-cc78-4ecb-b94d-a59d55f50b20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:19.138161 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9415c1-cc78-4ecb-b94d-a59d55f50b20 service nova] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:19.158131 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1032/2060] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:13:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:13:19.967848 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:20.748393 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:20.938706 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1d14b-0cdf-4588-bfde-3c5b39674bcf None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:20.939006 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1d14b-0cdf-4588-bfde-3c5b39674bcf None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:20.939264 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1d14b-0cdf-4588-bfde-3c5b39674bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:20.960740 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-6ec1d14b-0cdf-4588-bfde-3c5b39674bcf None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:13:20.962287 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6ec1d14b-0cdf-4588-bfde-3c5b39674bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:20.971127 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1029/2061] 10.222.0.46 () {58 vars in 1016 bytes} [Wed Oct 26 11:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:13:20.989614 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9415c1-cc78-4ecb-b94d-a59d55f50b20 service nova] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:21.003419 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9415c1-cc78-4ecb-b94d-a59d55f50b20 service nova] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:21.009496 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5b3a4-ccd2-4470-80a6-19e5f8e873e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:21.010331 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5b3a4-ccd2-4470-80a6-19e5f8e873e4 service nova] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:21.010726 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5b3a4-ccd2-4470-80a6-19e5f8e873e4 service nova] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:21.011159 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5b3a4-ccd2-4470-80a6-19e5f8e873e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:21.020926 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c5b3a4-ccd2-4470-80a6-19e5f8e873e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:21.022513 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c5b3a4-ccd2-4470-80a6-19e5f8e873e4 service nova] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:21.038153 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1033/2062] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:13:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:13:22.016194 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31780733-75e3-447b-b3e4-3f2f3d56d00e None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:22.017860 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31780733-75e3-447b-b3e4-3f2f3d56d00e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:22.017860 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31780733-75e3-447b-b3e4-3f2f3d56d00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:22.042911 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-31780733-75e3-447b-b3e4-3f2f3d56d00e None None] MFA Rules not processed for user `3c90765757a34c6291c9980a7d5d5c79`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:13:22.045530 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-31780733-75e3-447b-b3e4-3f2f3d56d00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:22.114167 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1030/2063] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Oct 26 11:13:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:13:22.128324 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5b3a4-ccd2-4470-80a6-19e5f8e873e4 service nova] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:22.129740 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-e2c5b3a4-ccd2-4470-80a6-19e5f8e873e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:22.209271 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5b3a4-ccd2-4470-80a6-19e5f8e873e4 service nova] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:22.214465 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26504e-967b-4bb8-9df1-8a6ea1d4a28d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21b84cc38a848de8d19a41e1eb04a58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:22.215087 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26504e-967b-4bb8-9df1-8a6ea1d4a28d service swift] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:22.215370 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26504e-967b-4bb8-9df1-8a6ea1d4a28d service swift] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:22.215654 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26504e-967b-4bb8-9df1-8a6ea1d4a28d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:22.224660 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26504e-967b-4bb8-9df1-8a6ea1d4a28d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:22.226266 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26504e-967b-4bb8-9df1-8a6ea1d4a28d service swift] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:22.235214 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1034/2064] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Oct 26 11:13:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 26 11:13:22.933759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8ef08-6123-4a15-9fcf-be9c338662c6 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:22.934365 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8ef08-6123-4a15-9fcf-be9c338662c6 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:22.934861 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8ef08-6123-4a15-9fcf-be9c338662c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:22.958638 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-5ad8ef08-6123-4a15-9fcf-be9c338662c6 None None] MFA Rules not processed for user `efbaebe9814441faa4efed0b4e4c7181`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:13:22.960357 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5ad8ef08-6123-4a15-9fcf-be9c338662c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:22.980624 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1031/2065] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:13:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:13:23.048764 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:23.529283 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26504e-967b-4bb8-9df1-8a6ea1d4a28d service swift] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:23.535426 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-fc26504e-967b-4bb8-9df1-8a6ea1d4a28d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:23.546511 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:23.565748 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26504e-967b-4bb8-9df1-8a6ea1d4a28d service swift] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:23.574364 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694c1f3-3c9a-4d0c-8fb0-a2eeeeab5287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:23.575365 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694c1f3-3c9a-4d0c-8fb0-a2eeeeab5287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:23.575846 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694c1f3-3c9a-4d0c-8fb0-a2eeeeab5287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:23.576366 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694c1f3-3c9a-4d0c-8fb0-a2eeeeab5287 admin admin] PATH_INFO: `/v3/users/9543242fbcad412ba81466a826241e1b` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:23.578061 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694c1f3-3c9a-4d0c-8fb0-a2eeeeab5287 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9543242fbcad412ba81466a826241e1b)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:23.580646 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694c1f3-3c9a-4d0c-8fb0-a2eeeeab5287 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:24.133868 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-e694c1f3-3c9a-4d0c-8fb0-a2eeeeab5287 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9543242fbcad412ba81466a826241e1b'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:13:24.231083 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-e694c1f3-3c9a-4d0c-8fb0-a2eeeeab5287 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9543242fbcad412ba81466a826241e1b'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:13:24.252179 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-e694c1f3-3c9a-4d0c-8fb0-a2eeeeab5287 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9543242fbcad412ba81466a826241e1b'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:13:24.252818 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-e694c1f3-3c9a-4d0c-8fb0-a2eeeeab5287 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9543242fbcad412ba81466a826241e1b'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:13:24.274660 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-e694c1f3-3c9a-4d0c-8fb0-a2eeeeab5287 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9543242fbcad412ba81466a826241e1b'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:13:24.293383 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1035/2066] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:13:23 2022] DELETE /identity/v3/users/9543242fbcad412ba81466a826241e1b => generated 0 bytes in 769 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:13:24.298056 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254eeed-3ad2-458f-b633-1572690b4a93 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:24.298550 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254eeed-3ad2-458f-b633-1572690b4a93 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:24.298652 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254eeed-3ad2-458f-b633-1572690b4a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:24.324125 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-1254eeed-3ad2-458f-b633-1572690b4a93 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:13:24.326520 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1254eeed-3ad2-458f-b633-1572690b4a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:24.432870 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1032/2067] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:13:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:13:24.442618 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694c1f3-3c9a-4d0c-8fb0-a2eeeeab5287 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:24.444500 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-e694c1f3-3c9a-4d0c-8fb0-a2eeeeab5287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:24.524436 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694c1f3-3c9a-4d0c-8fb0-a2eeeeab5287 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:24.524436 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d710b-4c3b-47d7-b114-22303898bee1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:24.524436 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d710b-4c3b-47d7-b114-22303898bee1 service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:24.524436 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d710b-4c3b-47d7-b114-22303898bee1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:24.524808 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d710b-4c3b-47d7-b114-22303898bee1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:24.537923 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d710b-4c3b-47d7-b114-22303898bee1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:24.539649 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d710b-4c3b-47d7-b114-22303898bee1 service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:24.567793 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1036/2068] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:13:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:13:25.138084 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254eeed-3ad2-458f-b633-1572690b4a93 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:25.140406 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1254eeed-3ad2-458f-b633-1572690b4a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:25.183893 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254eeed-3ad2-458f-b633-1572690b4a93 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:25.196580 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154d53e-8acc-46e4-a61d-c78ccba7f588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:25.207809 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154d53e-8acc-46e4-a61d-c78ccba7f588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:25.211598 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154d53e-8acc-46e4-a61d-c78ccba7f588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:25.213101 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154d53e-8acc-46e4-a61d-c78ccba7f588 admin admin] PATH_INFO: `/v3/projects/06c8ce728d104b9ebfb92feb084daa01` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:25.215471 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154d53e-8acc-46e4-a61d-c78ccba7f588 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06c8ce728d104b9ebfb92feb084daa01)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:25.220281 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154d53e-8acc-46e4-a61d-c78ccba7f588 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:25.471800 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3154d53e-8acc-46e4-a61d-c78ccba7f588 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06c8ce728d104b9ebfb92feb084daa01', 'request_id': 'req-3154d53e-8acc-46e4-a61d-c78ccba7f588'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:13:25.489256 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3154d53e-8acc-46e4-a61d-c78ccba7f588 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06c8ce728d104b9ebfb92feb084daa01', 'request_id': 'req-3154d53e-8acc-46e4-a61d-c78ccba7f588'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:13:25.657118 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3154d53e-8acc-46e4-a61d-c78ccba7f588 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06c8ce728d104b9ebfb92feb084daa01', 'request_id': 'req-3154d53e-8acc-46e4-a61d-c78ccba7f588'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:13:25.660971 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:25.675811 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3154d53e-8acc-46e4-a61d-c78ccba7f588 admin admin] The token cache is being invalidate because project 06c8ce728d104b9ebfb92feb084daa01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:13:25.676134 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3154d53e-8acc-46e4-a61d-c78ccba7f588 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:13:25.680205 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3154d53e-8acc-46e4-a61d-c78ccba7f588 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:13:25.688287 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1033/2069] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:13:25 2022] DELETE /identity/v3/projects/06c8ce728d104b9ebfb92feb084daa01 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:13:25.694465 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c868c62-2a6f-4dd4-9156-516c9b380c6b None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:25.696087 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c868c62-2a6f-4dd4-9156-516c9b380c6b None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:25.696699 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c868c62-2a6f-4dd4-9156-516c9b380c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:25.731878 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-7c868c62-2a6f-4dd4-9156-516c9b380c6b None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:13:25.733536 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-7c868c62-2a6f-4dd4-9156-516c9b380c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:25.835098 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1037/2070] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:13:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:13:25.846023 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df585ba-db77-44ee-b4b3-07609d0efef7 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:25.846888 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df585ba-db77-44ee-b4b3-07609d0efef7 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:25.847614 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df585ba-db77-44ee-b4b3-07609d0efef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:25.880657 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-6df585ba-db77-44ee-b4b3-07609d0efef7 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:13:25.882055 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6df585ba-db77-44ee-b4b3-07609d0efef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:25.903218 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1034/2071] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:13:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:13:25.907476 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c868c62-2a6f-4dd4-9156-516c9b380c6b None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:25.922835 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c868c62-2a6f-4dd4-9156-516c9b380c6b None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:25.932563 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96f101-4a96-46ba-ae5c-d2a162ecfdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:25.932563 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96f101-4a96-46ba-ae5c-d2a162ecfdd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:25.932563 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96f101-4a96-46ba-ae5c-d2a162ecfdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:25.932563 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96f101-4a96-46ba-ae5c-d2a162ecfdd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:25.933085 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c96f101-4a96-46ba-ae5c-d2a162ecfdd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:13:25.933353 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c96f101-4a96-46ba-ae5c-d2a162ecfdd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:25.934968 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c96f101-4a96-46ba-ae5c-d2a162ecfdd8 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:25.952951 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1038/2072] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:13:25.954075 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df585ba-db77-44ee-b4b3-07609d0efef7 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:25.969607 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df585ba-db77-44ee-b4b3-07609d0efef7 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:25.978682 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e334442-109e-4a6d-a8d3-46139201d8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:25.978682 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e334442-109e-4a6d-a8d3-46139201d8a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:25.978682 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e334442-109e-4a6d-a8d3-46139201d8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:25.978682 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e334442-109e-4a6d-a8d3-46139201d8a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:25.979145 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e334442-109e-4a6d-a8d3-46139201d8a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:25.981682 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e334442-109e-4a6d-a8d3-46139201d8a6 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:26.094158 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1035/2073] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:13:25 2022] POST /identity/v3/projects => generated 375 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:13:26.097964 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96f101-4a96-46ba-ae5c-d2a162ecfdd8 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:26.122371 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96f101-4a96-46ba-ae5c-d2a162ecfdd8 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:26.200661 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf702149-d6c9-4048-a4b1-0e08f6154410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:26.201711 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf702149-d6c9-4048-a4b1-0e08f6154410 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:26.202273 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf702149-d6c9-4048-a4b1-0e08f6154410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:26.203058 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf702149-d6c9-4048-a4b1-0e08f6154410 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:26.204397 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf702149-d6c9-4048-a4b1-0e08f6154410 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:26.206897 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf702149-d6c9-4048-a4b1-0e08f6154410 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:26.380554 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d37c8-a1fc-41fb-9581-168f339d8808 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:26.380847 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d37c8-a1fc-41fb-9581-168f339d8808 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:26.381128 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d37c8-a1fc-41fb-9581-168f339d8808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:26.425934 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1039/2074] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:13:26 2022] POST /identity/v3/users => generated 288 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:13:26.431185 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf702149-d6c9-4048-a4b1-0e08f6154410 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:26.432034 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-c60d37c8-a1fc-41fb-9581-168f339d8808 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:13:26.436528 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c60d37c8-a1fc-41fb-9581-168f339d8808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:26.454273 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf702149-d6c9-4048-a4b1-0e08f6154410 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:26.470823 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1036/2075] 10.222.0.46 () {58 vars in 1016 bytes} [Wed Oct 26 11:13:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:13:26.476164 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95507a93-a32c-417f-9781-8a9589d524c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:26.477066 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95507a93-a32c-417f-9781-8a9589d524c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:26.479250 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95507a93-a32c-417f-9781-8a9589d524c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:26.479747 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95507a93-a32c-417f-9781-8a9589d524c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:26.480627 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95507a93-a32c-417f-9781-8a9589d524c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:26.482272 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95507a93-a32c-417f-9781-8a9589d524c7 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:26.489423 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d37c8-a1fc-41fb-9581-168f339d8808 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:26.490858 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c60d37c8-a1fc-41fb-9581-168f339d8808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:26.516332 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1040/2076] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:13:26.519307 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95507a93-a32c-417f-9781-8a9589d524c7 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:26.551102 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95507a93-a32c-417f-9781-8a9589d524c7 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:26.558821 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920ff5c-0d33-4581-8f35-389bd6084371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:26.559796 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920ff5c-0d33-4581-8f35-389bd6084371 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:26.560337 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920ff5c-0d33-4581-8f35-389bd6084371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:26.562183 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920ff5c-0d33-4581-8f35-389bd6084371 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:26.563276 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920ff5c-0d33-4581-8f35-389bd6084371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:26.565045 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920ff5c-0d33-4581-8f35-389bd6084371 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:26.580649 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1041/2077] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:13:26.583270 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920ff5c-0d33-4581-8f35-389bd6084371 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:26.598062 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920ff5c-0d33-4581-8f35-389bd6084371 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:26.605394 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d37c8-a1fc-41fb-9581-168f339d8808 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:26.610460 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca9d54-a4ea-4024-be63-1dcfa5175f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:26.611443 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca9d54-a4ea-4024-be63-1dcfa5175f59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:26.611947 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca9d54-a4ea-4024-be63-1dcfa5175f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:26.612448 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca9d54-a4ea-4024-be63-1dcfa5175f59 admin admin] PATH_INFO: `/v3/projects/dcec8e878d5d4a2c91c2785f4302a5ce/users/58e10db28332499890a27fb066fc475c/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:26.615250 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5ee2e-cfc2-4b2b-afe1-4d3c9fe131ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:26.617876 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5ee2e-cfc2-4b2b-afe1-4d3c9fe131ab service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:26.618319 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5ee2e-cfc2-4b2b-afe1-4d3c9fe131ab service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:26.618780 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5ee2e-cfc2-4b2b-afe1-4d3c9fe131ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:26.631762 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad5ee2e-cfc2-4b2b-afe1-4d3c9fe131ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:26.635811 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad5ee2e-cfc2-4b2b-afe1-4d3c9fe131ab service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:26.641674 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca9d54-a4ea-4024-be63-1dcfa5175f59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcec8e878d5d4a2c91c2785f4302a5ce, user_id=58e10db28332499890a27fb066fc475c, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:26.658700 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca9d54-a4ea-4024-be63-1dcfa5175f59 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:26.664883 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:26.670610 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1037/2078] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:13:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:13:26.764087 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1042/2079] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:13:26 2022] PUT /identity/v3/projects/dcec8e878d5d4a2c91c2785f4302a5ce/users/58e10db28332499890a27fb066fc475c/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:13:26.777070 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5b99a-a3f9-4898-b320-771eedc77d2c None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:26.777618 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5b99a-a3f9-4898-b320-771eedc77d2c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:26.780760 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5b99a-a3f9-4898-b320-771eedc77d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:26.829908 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-13b5b99a-a3f9-4898-b320-771eedc77d2c None None] MFA Rules not processed for user `58e10db28332499890a27fb066fc475c`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:13:26.831160 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-13b5b99a-a3f9-4898-b320-771eedc77d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:26.965001 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1038/2080] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:13:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:13:26.976569 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca9d54-a4ea-4024-be63-1dcfa5175f59 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:26.979051 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-1dca9d54-a4ea-4024-be63-1dcfa5175f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:27.046959 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca9d54-a4ea-4024-be63-1dcfa5175f59 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:27.050978 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97735c-8dfc-4cc4-ac68-0608baff1ae1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:27.051627 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97735c-8dfc-4cc4-ac68-0608baff1ae1 service cinder] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:27.052131 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97735c-8dfc-4cc4-ac68-0608baff1ae1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:27.052426 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97735c-8dfc-4cc4-ac68-0608baff1ae1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:27.062845 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f97735c-8dfc-4cc4-ac68-0608baff1ae1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:27.064793 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f97735c-8dfc-4cc4-ac68-0608baff1ae1 service cinder] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:27.075398 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1043/2081] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:13:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:13:27.539158 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:30.371259 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:30.961913 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:31.322215 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446a71d-72d9-46fe-aefd-b443a1341202 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:31.322508 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446a71d-72d9-46fe-aefd-b443a1341202 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:31.322794 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446a71d-72d9-46fe-aefd-b443a1341202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:31.349985 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-2446a71d-72d9-46fe-aefd-b443a1341202 None None] MFA Rules not processed for user `58e10db28332499890a27fb066fc475c`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:13:31.351517 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2446a71d-72d9-46fe-aefd-b443a1341202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:31.360721 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1039/2082] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:13:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:13:31.502886 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:31.647909 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:32.333561 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:32.445412 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:33.318216 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:33.502577 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:33.988414 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:34.102520 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:34.310983 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:34.799450 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:34.959386 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:35.633997 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:36.287727 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:37.482764 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:37.921667 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c62d7f-58c2-404a-a6fe-ffee3f16bc79 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:37.922151 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c62d7f-58c2-404a-a6fe-ffee3f16bc79 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:37.922552 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c62d7f-58c2-404a-a6fe-ffee3f16bc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:37.949666 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-91c62d7f-58c2-404a-a6fe-ffee3f16bc79 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:13:37.962522 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:37.964193 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-91c62d7f-58c2-404a-a6fe-ffee3f16bc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:38.052391 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1044/2083] 10.222.0.46 () {58 vars in 1016 bytes} [Wed Oct 26 11:13:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:13:38.067751 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446a71d-72d9-46fe-aefd-b443a1341202 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:38.069574 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2446a71d-72d9-46fe-aefd-b443a1341202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:38.162907 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446a71d-72d9-46fe-aefd-b443a1341202 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:38.169348 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0fd61c-c007-49f7-b9d7-7eac9b6c438f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:38.169980 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fd61c-c007-49f7-b9d7-7eac9b6c438f service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:38.170264 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fd61c-c007-49f7-b9d7-7eac9b6c438f service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:38.170538 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fd61c-c007-49f7-b9d7-7eac9b6c438f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:38.180878 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0fd61c-c007-49f7-b9d7-7eac9b6c438f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:38.182912 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0fd61c-c007-49f7-b9d7-7eac9b6c438f service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:38.208994 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1040/2084] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:13:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:13:38.931814 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:39.636543 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:39.902452 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:40.219353 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:40.654774 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:40.687101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f7570-bd12-4424-822a-2e7394cd2e8b None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:40.687537 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f7570-bd12-4424-822a-2e7394cd2e8b None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:40.687811 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f7570-bd12-4424-822a-2e7394cd2e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:40.707587 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-754f7570-bd12-4424-822a-2e7394cd2e8b None None] MFA Rules not processed for user `3c90765757a34c6291c9980a7d5d5c79`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:13:40.708828 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-754f7570-bd12-4424-822a-2e7394cd2e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:40.764879 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1045/2085] 10.222.0.45 () {58 vars in 967 bytes} [Wed Oct 26 11:13:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:13:40.777550 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0fd61c-c007-49f7-b9d7-7eac9b6c438f service nova] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:40.779611 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8e0fd61c-c007-49f7-b9d7-7eac9b6c438f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:40.853076 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0fd61c-c007-49f7-b9d7-7eac9b6c438f service nova] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:40.858684 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44992b51-5358-4e9d-9cf8-53d5f030fbc8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21b84cc38a848de8d19a41e1eb04a58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:40.859308 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44992b51-5358-4e9d-9cf8-53d5f030fbc8 service swift] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:40.859608 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44992b51-5358-4e9d-9cf8-53d5f030fbc8 service swift] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:40.859863 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44992b51-5358-4e9d-9cf8-53d5f030fbc8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:40.868212 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44992b51-5358-4e9d-9cf8-53d5f030fbc8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:40.869812 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44992b51-5358-4e9d-9cf8-53d5f030fbc8 service swift] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:40.877756 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1041/2086] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Oct 26 11:13:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 26 11:13:41.003001 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:41.594333 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:41.796668 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:42.485271 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:42.536923 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:42.789767 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:43.120452 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:43.260763 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f7570-bd12-4424-822a-2e7394cd2e8b None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:43.262945 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-754f7570-bd12-4424-822a-2e7394cd2e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:43.305432 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:43.325400 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44992b51-5358-4e9d-9cf8-53d5f030fbc8 service swift] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:43.326799 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-44992b51-5358-4e9d-9cf8-53d5f030fbc8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:43.342192 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f7570-bd12-4424-822a-2e7394cd2e8b None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:43.347171 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d78e26-a87d-4d3d-a9f9-17adc89973e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4f9a2bba0e748b6a98fa7dea2482ddf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:43.347791 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d78e26-a87d-4d3d-a9f9-17adc89973e6 service placement] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:43.348096 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d78e26-a87d-4d3d-a9f9-17adc89973e6 service placement] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:43.348405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d78e26-a87d-4d3d-a9f9-17adc89973e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:43.350566 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-f8d78e26-a87d-4d3d-a9f9-17adc89973e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:43.362363 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d78e26-a87d-4d3d-a9f9-17adc89973e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:43.363977 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d78e26-a87d-4d3d-a9f9-17adc89973e6 service placement] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:43.374904 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1046/2087] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:13:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:13:43.399416 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44992b51-5358-4e9d-9cf8-53d5f030fbc8 service swift] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:43.405177 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7959b-ea2b-45cb-8e0d-c5b38a1025d2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4f9a2bba0e748b6a98fa7dea2482ddf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:43.412238 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7959b-ea2b-45cb-8e0d-c5b38a1025d2 service placement] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:43.412238 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7959b-ea2b-45cb-8e0d-c5b38a1025d2 service placement] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:43.412238 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7959b-ea2b-45cb-8e0d-c5b38a1025d2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:43.414874 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd7959b-ea2b-45cb-8e0d-c5b38a1025d2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:43.416536 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd7959b-ea2b-45cb-8e0d-c5b38a1025d2 service placement] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:43.426575 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1042/2088] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:13:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:13:43.902674 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:43.924221 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:44.499354 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:44.585997 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:45.377485 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:45.403828 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:46.214139 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:46.245990 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:46.517144 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:46.548504 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:46.670832 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:46.739089 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:46.885349 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:46.973695 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:47.068488 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:47.173353 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:47.213587 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:47.236321 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:47.363841 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:47.389684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:47.482753 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:47.534396 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:47.997463 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:48.080250 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:48.357320 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:48.388572 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:48.576980 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:48.605522 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:48.737289 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:48.762266 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:48.853825 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:48.951579 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:49.036794 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:49.120233 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:49.185276 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:49.217840 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:49.382616 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:49.457153 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:49.653919 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:49.679823 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:49.843085 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:49.874246 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:49.983750 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:50.125916 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:50.154904 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:50.385241 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:50.549375 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:50.623407 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:51.494235 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:58.841377 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54656e-a638-4208-aaca-dda301749b1f None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:58.841889 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54656e-a638-4208-aaca-dda301749b1f None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:58.841889 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54656e-a638-4208-aaca-dda301749b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:58.861013 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-8b54656e-a638-4208-aaca-dda301749b1f None None] MFA Rules not processed for user `56a2ac5de83a43f68e8d70f843d6b0a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:13:58.862211 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-8b54656e-a638-4208-aaca-dda301749b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:58.886829 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:58.916308 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1047/2089] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:13:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:13:59.348378 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724440b-27c1-4f9e-8ffb-717397c46def None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:59.348847 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724440b-27c1-4f9e-8ffb-717397c46def None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:59.349132 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724440b-27c1-4f9e-8ffb-717397c46def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:59.373572 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-6724440b-27c1-4f9e-8ffb-717397c46def None None] MFA Rules not processed for user `3c90765757a34c6291c9980a7d5d5c79`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:13:59.374937 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6724440b-27c1-4f9e-8ffb-717397c46def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:59.382810 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1043/2090] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Oct 26 11:13:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:13:59.405981 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b54656e-a638-4208-aaca-dda301749b1f None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:59.418560 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b54656e-a638-4208-aaca-dda301749b1f None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:59.424436 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2506580-2709-4397-9f97-8844e1b7323e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21b84cc38a848de8d19a41e1eb04a58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:59.430015 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2506580-2709-4397-9f97-8844e1b7323e service swift] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:59.430015 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2506580-2709-4397-9f97-8844e1b7323e service swift] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:59.430015 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2506580-2709-4397-9f97-8844e1b7323e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:59.436010 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2506580-2709-4397-9f97-8844e1b7323e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:59.437673 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2506580-2709-4397-9f97-8844e1b7323e service swift] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:59.446725 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1048/2091] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Oct 26 11:13:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 26 11:14:00.628482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf0951-bdad-443c-bc06-fdf61976d4b8 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:00.629037 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf0951-bdad-443c-bc06-fdf61976d4b8 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:00.629184 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf0951-bdad-443c-bc06-fdf61976d4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:00.652827 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-2aaf0951-bdad-443c-bc06-fdf61976d4b8 None None] MFA Rules not processed for user `3c90765757a34c6291c9980a7d5d5c79`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:14:00.654098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2aaf0951-bdad-443c-bc06-fdf61976d4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:00.661767 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1044/2092] 10.222.0.45 () {58 vars in 967 bytes} [Wed Oct 26 11:14:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:14:00.675529 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2506580-2709-4397-9f97-8844e1b7323e service swift] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:00.687212 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2506580-2709-4397-9f97-8844e1b7323e service swift] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:00.692568 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518746f-145f-4429-960d-3283cc1502db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21b84cc38a848de8d19a41e1eb04a58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:00.699138 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518746f-145f-4429-960d-3283cc1502db service swift] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:00.699138 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518746f-145f-4429-960d-3283cc1502db service swift] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:00.699138 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518746f-145f-4429-960d-3283cc1502db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:00.703184 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d518746f-145f-4429-960d-3283cc1502db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:00.704868 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d518746f-145f-4429-960d-3283cc1502db service swift] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:00.717451 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1049/2093] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Oct 26 11:14:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 26 11:14:01.444744 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae373a4-55e2-4c1b-9695-62463415e2c1 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:01.449293 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae373a4-55e2-4c1b-9695-62463415e2c1 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:01.449293 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae373a4-55e2-4c1b-9695-62463415e2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:01.464112 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-4ae373a4-55e2-4c1b-9695-62463415e2c1 None None] MFA Rules not processed for user `3c90765757a34c6291c9980a7d5d5c79`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:14:01.465307 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4ae373a4-55e2-4c1b-9695-62463415e2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:01.473022 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1045/2094] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Oct 26 11:14:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:14:01.485564 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518746f-145f-4429-960d-3283cc1502db service swift] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:01.496471 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518746f-145f-4429-960d-3283cc1502db service swift] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:01.501577 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b522cf-43a6-49dd-8219-c59b43f0383f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21b84cc38a848de8d19a41e1eb04a58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:01.502175 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b522cf-43a6-49dd-8219-c59b43f0383f service swift] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:01.502459 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b522cf-43a6-49dd-8219-c59b43f0383f service swift] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:01.502736 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b522cf-43a6-49dd-8219-c59b43f0383f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:01.510698 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b522cf-43a6-49dd-8219-c59b43f0383f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:01.512293 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b522cf-43a6-49dd-8219-c59b43f0383f service swift] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:01.520851 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1050/2095] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Oct 26 11:14:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 26 11:14:02.211425 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a80d17-8e0d-41a2-8be7-74a72f895835 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:02.211906 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a80d17-8e0d-41a2-8be7-74a72f895835 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:02.212006 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a80d17-8e0d-41a2-8be7-74a72f895835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:02.232268 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-26a80d17-8e0d-41a2-8be7-74a72f895835 None None] MFA Rules not processed for user `3c90765757a34c6291c9980a7d5d5c79`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:14:02.240165 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-26a80d17-8e0d-41a2-8be7-74a72f895835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:02.240901 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1046/2096] 10.222.0.45 () {58 vars in 967 bytes} [Wed Oct 26 11:14:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:14:02.254275 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b522cf-43a6-49dd-8219-c59b43f0383f service swift] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:02.265490 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b522cf-43a6-49dd-8219-c59b43f0383f service swift] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:02.270441 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc6d43-9253-4768-970d-4582d1d067ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21b84cc38a848de8d19a41e1eb04a58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:02.271031 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc6d43-9253-4768-970d-4582d1d067ae service swift] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:02.271313 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc6d43-9253-4768-970d-4582d1d067ae service swift] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:02.271589 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc6d43-9253-4768-970d-4582d1d067ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:02.279899 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc6d43-9253-4768-970d-4582d1d067ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:02.281702 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc6d43-9253-4768-970d-4582d1d067ae service swift] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:02.292511 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1051/2097] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Oct 26 11:14:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 26 11:14:03.623487 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a80d17-8e0d-41a2-8be7-74a72f895835 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:03.630003 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-26a80d17-8e0d-41a2-8be7-74a72f895835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:03.639080 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:14:03.698043 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a80d17-8e0d-41a2-8be7-74a72f895835 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:03.713069 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e71db-7c1e-467e-b7d9-b5b48140a439 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:03.713069 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e71db-7c1e-467e-b7d9-b5b48140a439 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:03.713069 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e71db-7c1e-467e-b7d9-b5b48140a439 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:03.713069 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e71db-7c1e-467e-b7d9-b5b48140a439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:03.713490 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7d5e71db-7c1e-467e-b7d9-b5b48140a439 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:03.796552 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e71db-7c1e-467e-b7d9-b5b48140a439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:03.798430 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e71db-7c1e-467e-b7d9-b5b48140a439 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:03.811015 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1047/2098] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:14:03 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:14:05.369731 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc6d43-9253-4768-970d-4582d1d067ae service swift] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:05.383016 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc6d43-9253-4768-970d-4582d1d067ae service swift] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:05.390303 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55409e-c854-4785-a890-57998dc8d17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:05.391322 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55409e-c854-4785-a890-57998dc8d17c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:05.391802 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55409e-c854-4785-a890-57998dc8d17c admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:05.392472 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55409e-c854-4785-a890-57998dc8d17c admin admin] PATH_INFO: `/v3/users/58e10db28332499890a27fb066fc475c` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:05.394569 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55409e-c854-4785-a890-57998dc8d17c admin admin] RBAC: Authorizing `identity:delete_user(user_id=58e10db28332499890a27fb066fc475c)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:05.397211 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55409e-c854-4785-a890-57998dc8d17c admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:05.644772 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-1d55409e-c854-4785-a890-57998dc8d17c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58e10db28332499890a27fb066fc475c'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:05.721783 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-1d55409e-c854-4785-a890-57998dc8d17c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58e10db28332499890a27fb066fc475c'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:05.740733 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-1d55409e-c854-4785-a890-57998dc8d17c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58e10db28332499890a27fb066fc475c'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:05.742245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-1d55409e-c854-4785-a890-57998dc8d17c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58e10db28332499890a27fb066fc475c'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:05.751625 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-1d55409e-c854-4785-a890-57998dc8d17c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58e10db28332499890a27fb066fc475c'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:05.758400 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1052/2099] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:14:05 2022] DELETE /identity/v3/users/58e10db28332499890a27fb066fc475c => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:14:05.763040 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bda241-00c2-474a-9c76-bbc5d9289ccb None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:05.763558 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bda241-00c2-474a-9c76-bbc5d9289ccb None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:05.763660 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bda241-00c2-474a-9c76-bbc5d9289ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:05.790176 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-31bda241-00c2-474a-9c76-bbc5d9289ccb None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:14:05.791597 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-31bda241-00c2-474a-9c76-bbc5d9289ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:05.901266 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1048/2100] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:14:05.921159 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55409e-c854-4785-a890-57998dc8d17c admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:05.935612 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-1d55409e-c854-4785-a890-57998dc8d17c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:06.008250 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55409e-c854-4785-a890-57998dc8d17c admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:06.012500 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee180a-5656-491d-9e5f-27c2ab32db13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:06.013409 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee180a-5656-491d-9e5f-27c2ab32db13 service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:06.013851 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee180a-5656-491d-9e5f-27c2ab32db13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:06.014331 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee180a-5656-491d-9e5f-27c2ab32db13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:06.026554 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee180a-5656-491d-9e5f-27c2ab32db13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:06.028069 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee180a-5656-491d-9e5f-27c2ab32db13 service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:06.033046 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:14:06.039175 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1053/2101] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:14:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:14:06.490288 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bda241-00c2-474a-9c76-bbc5d9289ccb None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:06.491843 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-31bda241-00c2-474a-9c76-bbc5d9289ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:06.509717 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bda241-00c2-474a-9c76-bbc5d9289ccb None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:06.519940 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd93a5a-fe88-4a90-abd6-938d9d39ee5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:06.521750 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd93a5a-fe88-4a90-abd6-938d9d39ee5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:06.521750 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd93a5a-fe88-4a90-abd6-938d9d39ee5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:06.521750 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd93a5a-fe88-4a90-abd6-938d9d39ee5f admin admin] PATH_INFO: `/v3/projects/dcec8e878d5d4a2c91c2785f4302a5ce` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:06.523224 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd93a5a-fe88-4a90-abd6-938d9d39ee5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcec8e878d5d4a2c91c2785f4302a5ce)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:06.525468 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd93a5a-fe88-4a90-abd6-938d9d39ee5f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:06.649198 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3dd93a5a-fe88-4a90-abd6-938d9d39ee5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcec8e878d5d4a2c91c2785f4302a5ce', 'request_id': 'req-3dd93a5a-fe88-4a90-abd6-938d9d39ee5f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:06.676803 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3dd93a5a-fe88-4a90-abd6-938d9d39ee5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcec8e878d5d4a2c91c2785f4302a5ce', 'request_id': 'req-3dd93a5a-fe88-4a90-abd6-938d9d39ee5f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:06.679091 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:14:06.777300 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3dd93a5a-fe88-4a90-abd6-938d9d39ee5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcec8e878d5d4a2c91c2785f4302a5ce', 'request_id': 'req-3dd93a5a-fe88-4a90-abd6-938d9d39ee5f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:06.797489 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3dd93a5a-fe88-4a90-abd6-938d9d39ee5f admin admin] The token cache is being invalidate because project dcec8e878d5d4a2c91c2785f4302a5ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:14:06.798053 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3dd93a5a-fe88-4a90-abd6-938d9d39ee5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:06.799068 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3dd93a5a-fe88-4a90-abd6-938d9d39ee5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:06.802833 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1049/2102] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:14:06 2022] DELETE /identity/v3/projects/dcec8e878d5d4a2c91c2785f4302a5ce => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:14:16.394630 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:14:16.842975 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:14:18.371982 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22e81b-ec07-4c0e-bd23-0ebbdf2e0c78 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:18.372491 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22e81b-ec07-4c0e-bd23-0ebbdf2e0c78 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:18.372596 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22e81b-ec07-4c0e-bd23-0ebbdf2e0c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:18.392943 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-7e22e81b-ec07-4c0e-bd23-0ebbdf2e0c78 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:14:18.394160 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-7e22e81b-ec07-4c0e-bd23-0ebbdf2e0c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:18.455880 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1054/2103] 10.222.0.46 () {58 vars in 1016 bytes} [Wed Oct 26 11:14:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:14:18.490170 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd93a5a-fe88-4a90-abd6-938d9d39ee5f admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:18.491733 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3dd93a5a-fe88-4a90-abd6-938d9d39ee5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:18.566376 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd93a5a-fe88-4a90-abd6-938d9d39ee5f admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:18.571833 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb602f-ffcd-40af-8e75-1529dd57e12f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:18.572501 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb602f-ffcd-40af-8e75-1529dd57e12f service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:18.572784 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb602f-ffcd-40af-8e75-1529dd57e12f service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:18.573060 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb602f-ffcd-40af-8e75-1529dd57e12f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:18.581213 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeb602f-ffcd-40af-8e75-1529dd57e12f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:18.582797 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeb602f-ffcd-40af-8e75-1529dd57e12f service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:18.592762 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1050/2104] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:14:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:14:21.887871 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7e58c-923c-4c29-847b-e9d631819ea9 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:21.888317 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7e58c-923c-4c29-847b-e9d631819ea9 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:21.888478 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7e58c-923c-4c29-847b-e9d631819ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:21.910923 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-11e7e58c-923c-4c29-847b-e9d631819ea9 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:14:21.912185 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-11e7e58c-923c-4c29-847b-e9d631819ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:21.920018 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1055/2105] 10.222.0.46 () {58 vars in 1016 bytes} [Wed Oct 26 11:14:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:14:21.939444 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb602f-ffcd-40af-8e75-1529dd57e12f service nova] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:21.950641 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb602f-ffcd-40af-8e75-1529dd57e12f service nova] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:21.956740 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f92e2-79cf-4490-89ab-513e526331ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:21.957939 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f92e2-79cf-4490-89ab-513e526331ba service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:21.958232 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f92e2-79cf-4490-89ab-513e526331ba service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:21.958508 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f92e2-79cf-4490-89ab-513e526331ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:21.967004 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f92e2-79cf-4490-89ab-513e526331ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:21.968624 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f92e2-79cf-4490-89ab-513e526331ba service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:21.979393 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1051/2106] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:14:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:14:24.406433 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d0b63-62b3-464a-bedf-3dfcb6559ed3 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:24.407391 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d0b63-62b3-464a-bedf-3dfcb6559ed3 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:24.407772 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d0b63-62b3-464a-bedf-3dfcb6559ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:24.428046 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-744d0b63-62b3-464a-bedf-3dfcb6559ed3 None None] MFA Rules not processed for user `bfef80e955344073a2a35c569e199f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:14:24.429282 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-744d0b63-62b3-464a-bedf-3dfcb6559ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:24.485346 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1056/2107] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:14:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:14:25.801251 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d415c-192c-4b17-b720-fed49cb6e0fc None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:25.801780 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d415c-192c-4b17-b720-fed49cb6e0fc None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:25.802028 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d415c-192c-4b17-b720-fed49cb6e0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:25.823279 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-827d415c-192c-4b17-b720-fed49cb6e0fc None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:14:25.824547 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-827d415c-192c-4b17-b720-fed49cb6e0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:25.832819 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1052/2108] 10.222.0.46 () {58 vars in 1016 bytes} [Wed Oct 26 11:14:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:14:25.847281 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d0b63-62b3-464a-bedf-3dfcb6559ed3 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:25.848970 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-744d0b63-62b3-464a-bedf-3dfcb6559ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:25.867373 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d0b63-62b3-464a-bedf-3dfcb6559ed3 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:25.876309 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee7ee4-f06e-4a2b-835a-ddc83db3590b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:25.876927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee7ee4-f06e-4a2b-835a-ddc83db3590b service nova] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:25.877221 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee7ee4-f06e-4a2b-835a-ddc83db3590b service nova] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:25.878059 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee7ee4-f06e-4a2b-835a-ddc83db3590b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:25.887318 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee7ee4-f06e-4a2b-835a-ddc83db3590b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:25.888988 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee7ee4-f06e-4a2b-835a-ddc83db3590b service nova] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:25.899038 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1057/2109] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:14:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:14:33.185461 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b87ed-7edd-4ecb-8c0b-fd19b1b47fd8 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:33.186054 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b87ed-7edd-4ecb-8c0b-fd19b1b47fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:33.186314 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b87ed-7edd-4ecb-8c0b-fd19b1b47fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:33.210452 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-fe8b87ed-7edd-4ecb-8c0b-fd19b1b47fd8 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:14:33.211718 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-fe8b87ed-7edd-4ecb-8c0b-fd19b1b47fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:33.220598 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1053/2110] 10.222.0.46 () {58 vars in 1016 bytes} [Wed Oct 26 11:14:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:14:33.241040 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee7ee4-f06e-4a2b-835a-ddc83db3590b service nova] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:33.254596 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee7ee4-f06e-4a2b-835a-ddc83db3590b service nova] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:33.260817 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf39eae-99ed-4b30-a12d-43cb2f44484c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:33.261434 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf39eae-99ed-4b30-a12d-43cb2f44484c service nova] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:33.261758 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf39eae-99ed-4b30-a12d-43cb2f44484c service nova] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:33.262038 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf39eae-99ed-4b30-a12d-43cb2f44484c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:33.282587 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf39eae-99ed-4b30-a12d-43cb2f44484c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:33.284290 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf39eae-99ed-4b30-a12d-43cb2f44484c service nova] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:33.296332 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1058/2111] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:14:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:14:37.486450 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb747b3-d0d2-4c6b-b6f9-7d42bc22d85c None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:37.486969 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb747b3-d0d2-4c6b-b6f9-7d42bc22d85c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:37.487054 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb747b3-d0d2-4c6b-b6f9-7d42bc22d85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:37.508404 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-2eb747b3-d0d2-4c6b-b6f9-7d42bc22d85c None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:14:37.509878 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2eb747b3-d0d2-4c6b-b6f9-7d42bc22d85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:37.518114 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1054/2112] 10.222.0.46 () {58 vars in 1016 bytes} [Wed Oct 26 11:14:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:14:37.534090 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf39eae-99ed-4b30-a12d-43cb2f44484c service nova] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:37.546209 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf39eae-99ed-4b30-a12d-43cb2f44484c service nova] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:37.553408 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a9b96-1e5f-470b-bb2f-dc1d2224985f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:37.554027 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a9b96-1e5f-470b-bb2f-dc1d2224985f service nova] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:37.554304 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a9b96-1e5f-470b-bb2f-dc1d2224985f service nova] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:37.555195 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a9b96-1e5f-470b-bb2f-dc1d2224985f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:37.565529 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a9b96-1e5f-470b-bb2f-dc1d2224985f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:37.567656 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a9b96-1e5f-470b-bb2f-dc1d2224985f service nova] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:37.577370 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1059/2113] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:14:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:14:38.245085 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b644a7-6369-4b0c-baee-a1ddde8a5bc5 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:38.245377 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b644a7-6369-4b0c-baee-a1ddde8a5bc5 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:38.245656 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b644a7-6369-4b0c-baee-a1ddde8a5bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:38.264565 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-13b644a7-6369-4b0c-baee-a1ddde8a5bc5 None None] MFA Rules not processed for user `1519c41b8f9e4724b520bab8f741b783`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:14:38.265770 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-13b644a7-6369-4b0c-baee-a1ddde8a5bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:38.320405 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1055/2114] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:14:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:14:47.573091 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=73 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:14:48.313797 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=74 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:15:13.563016 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a9b96-1e5f-470b-bb2f-dc1d2224985f service nova] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:13.565409 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-f37a9b96-1e5f-470b-bb2f-dc1d2224985f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:13.577297 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a9b96-1e5f-470b-bb2f-dc1d2224985f service nova] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:13.581966 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98304b-7b36-4ed2-8abb-dc03503e19f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:13.582595 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98304b-7b36-4ed2-8abb-dc03503e19f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:13.582824 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98304b-7b36-4ed2-8abb-dc03503e19f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:13.583100 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98304b-7b36-4ed2-8abb-dc03503e19f0 admin admin] PATH_INFO: `/v3/users/56a2ac5de83a43f68e8d70f843d6b0a3` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:13.584241 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98304b-7b36-4ed2-8abb-dc03503e19f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56a2ac5de83a43f68e8d70f843d6b0a3)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:13.586164 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98304b-7b36-4ed2-8abb-dc03503e19f0 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:13.810105 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-aa98304b-7b36-4ed2-8abb-dc03503e19f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56a2ac5de83a43f68e8d70f843d6b0a3'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:13.912649 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-aa98304b-7b36-4ed2-8abb-dc03503e19f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56a2ac5de83a43f68e8d70f843d6b0a3'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:13.925606 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-aa98304b-7b36-4ed2-8abb-dc03503e19f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56a2ac5de83a43f68e8d70f843d6b0a3'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:13.926257 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-aa98304b-7b36-4ed2-8abb-dc03503e19f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56a2ac5de83a43f68e8d70f843d6b0a3'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:13.933189 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-aa98304b-7b36-4ed2-8abb-dc03503e19f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56a2ac5de83a43f68e8d70f843d6b0a3'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:13.940008 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1060/2115] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:15:13 2022] DELETE /identity/v3/users/56a2ac5de83a43f68e8d70f843d6b0a3 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:15:14.234722 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b644a7-6369-4b0c-baee-a1ddde8a5bc5 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:14.246020 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b644a7-6369-4b0c-baee-a1ddde8a5bc5 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:14.305346 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a083d1-a491-4783-a422-069e2df82a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:14.305994 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a083d1-a491-4783-a422-069e2df82a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:14.306283 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a083d1-a491-4783-a422-069e2df82a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:14.306560 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a083d1-a491-4783-a422-069e2df82a55 admin admin] PATH_INFO: `/v3/projects/760f117e45f845ca94401b98e0270860` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:14.307714 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a083d1-a491-4783-a422-069e2df82a55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=760f117e45f845ca94401b98e0270860)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:14.309841 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a083d1-a491-4783-a422-069e2df82a55 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:14.485155 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-a8a083d1-a491-4783-a422-069e2df82a55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '760f117e45f845ca94401b98e0270860', 'request_id': 'req-a8a083d1-a491-4783-a422-069e2df82a55'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:14.491400 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-a8a083d1-a491-4783-a422-069e2df82a55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '760f117e45f845ca94401b98e0270860', 'request_id': 'req-a8a083d1-a491-4783-a422-069e2df82a55'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:14.620805 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-a8a083d1-a491-4783-a422-069e2df82a55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '760f117e45f845ca94401b98e0270860', 'request_id': 'req-a8a083d1-a491-4783-a422-069e2df82a55'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:14.631764 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-a8a083d1-a491-4783-a422-069e2df82a55 admin admin] The token cache is being invalidate because project 760f117e45f845ca94401b98e0270860 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:15:14.632071 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-a8a083d1-a491-4783-a422-069e2df82a55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:14.632710 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-a8a083d1-a491-4783-a422-069e2df82a55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:14.634247 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1056/2116] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:15:14 2022] DELETE /identity/v3/projects/760f117e45f845ca94401b98e0270860 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:15:14.639663 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1c630-641a-4f19-ac64-4e4d51fef313 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:14.643943 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1c630-641a-4f19-ac64-4e4d51fef313 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:14.643943 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1c630-641a-4f19-ac64-4e4d51fef313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:14.660309 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-7af1c630-641a-4f19-ac64-4e4d51fef313 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:15:14.661531 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-7af1c630-641a-4f19-ac64-4e4d51fef313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:14.720250 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1061/2117] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:15:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:15:14.727733 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe07df-2900-473f-acc6-a9634f5162ba None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:14.728025 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe07df-2900-473f-acc6-a9634f5162ba None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:14.728332 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe07df-2900-473f-acc6-a9634f5162ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:14.748596 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-2cfe07df-2900-473f-acc6-a9634f5162ba None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:15:14.749736 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2cfe07df-2900-473f-acc6-a9634f5162ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:14.757643 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1057/2118] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:15:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:15:14.762154 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1c630-641a-4f19-ac64-4e4d51fef313 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:14.771892 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1c630-641a-4f19-ac64-4e4d51fef313 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:14.776516 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467c727-83d8-49b6-a59d-841c06ae87a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:14.777115 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467c727-83d8-49b6-a59d-841c06ae87a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:14.777954 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467c727-83d8-49b6-a59d-841c06ae87a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:14.778236 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467c727-83d8-49b6-a59d-841c06ae87a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:14.778880 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467c727-83d8-49b6-a59d-841c06ae87a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:15:14.779185 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467c727-83d8-49b6-a59d-841c06ae87a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:14.780817 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467c727-83d8-49b6-a59d-841c06ae87a7 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:14.792320 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1062/2119] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:15:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:15:14.796392 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe07df-2900-473f-acc6-a9634f5162ba None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:14.805576 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe07df-2900-473f-acc6-a9634f5162ba None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:14.810217 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0326073-6d95-47c4-bfbc-8afe246cb8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:14.810823 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0326073-6d95-47c4-bfbc-8afe246cb8cd admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:14.811100 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0326073-6d95-47c4-bfbc-8afe246cb8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:14.811373 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0326073-6d95-47c4-bfbc-8afe246cb8cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:14.812002 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0326073-6d95-47c4-bfbc-8afe246cb8cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:14.813938 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0326073-6d95-47c4-bfbc-8afe246cb8cd admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:14.901995 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1058/2120] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:15:14 2022] POST /identity/v3/projects => generated 399 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:15:14.906030 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467c727-83d8-49b6-a59d-841c06ae87a7 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:14.916185 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467c727-83d8-49b6-a59d-841c06ae87a7 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:14.972552 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780bf901-1249-4728-82eb-583081f1e199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:14.973157 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bf901-1249-4728-82eb-583081f1e199 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:14.973444 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bf901-1249-4728-82eb-583081f1e199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:14.973719 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bf901-1249-4728-82eb-583081f1e199 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:14.974345 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780bf901-1249-4728-82eb-583081f1e199 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:14.976292 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780bf901-1249-4728-82eb-583081f1e199 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:14.984559 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:15:15.089118 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1063/2121] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:15:14 2022] POST /identity/v3/users => generated 300 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:15:15.093667 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0326073-6d95-47c4-bfbc-8afe246cb8cd admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:15.104220 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0326073-6d95-47c4-bfbc-8afe246cb8cd admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:15.118294 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf5322-42f7-430c-bd71-21180dfcc6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:15.118923 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf5322-42f7-430c-bd71-21180dfcc6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:15.119207 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf5322-42f7-430c-bd71-21180dfcc6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:15.119525 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf5322-42f7-430c-bd71-21180dfcc6b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:15.120217 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf5322-42f7-430c-bd71-21180dfcc6b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:15.121822 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf5322-42f7-430c-bd71-21180dfcc6b5 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:15.132157 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1059/2122] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:15:15.137397 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780bf901-1249-4728-82eb-583081f1e199 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:15.147493 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780bf901-1249-4728-82eb-583081f1e199 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:15.152115 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c788b91-4792-4d88-8cce-7d0d12d5588a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:15.153216 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c788b91-4792-4d88-8cce-7d0d12d5588a admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:15.153492 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c788b91-4792-4d88-8cce-7d0d12d5588a admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:15.153760 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c788b91-4792-4d88-8cce-7d0d12d5588a admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:15.154421 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c788b91-4792-4d88-8cce-7d0d12d5588a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:15.156005 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c788b91-4792-4d88-8cce-7d0d12d5588a admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:15.166598 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1064/2123] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:15:15.172307 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf5322-42f7-430c-bd71-21180dfcc6b5 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:15.182289 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf5322-42f7-430c-bd71-21180dfcc6b5 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:15.186877 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41ff53-690d-4ca1-a57d-2c1c6a4e9057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:15.187527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41ff53-690d-4ca1-a57d-2c1c6a4e9057 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:15.187812 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41ff53-690d-4ca1-a57d-2c1c6a4e9057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:15.188120 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41ff53-690d-4ca1-a57d-2c1c6a4e9057 admin admin] PATH_INFO: `/v3/projects/09d29f783c334d6ead55c5d0ff19a0a5/users/ce696fa38fcc4287a7830d595823d339/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:15.206040 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e41ff53-690d-4ca1-a57d-2c1c6a4e9057 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09d29f783c334d6ead55c5d0ff19a0a5, user_id=ce696fa38fcc4287a7830d595823d339, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:15.210774 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e41ff53-690d-4ca1-a57d-2c1c6a4e9057 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:15.359173 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1060/2124] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:15:15 2022] PUT /identity/v3/projects/09d29f783c334d6ead55c5d0ff19a0a5/users/ce696fa38fcc4287a7830d595823d339/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:15:15.425708 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb298f-6023-482f-a013-d46fad425159 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:15.425991 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb298f-6023-482f-a013-d46fad425159 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:15.426272 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb298f-6023-482f-a013-d46fad425159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:15.454756 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-43eb298f-6023-482f-a013-d46fad425159 None None] MFA Rules not processed for user `ce696fa38fcc4287a7830d595823d339`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:15:15.455994 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-43eb298f-6023-482f-a013-d46fad425159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:15.525010 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1065/2125] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:15:15 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:15:15.537044 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41ff53-690d-4ca1-a57d-2c1c6a4e9057 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:15.538821 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0e41ff53-690d-4ca1-a57d-2c1c6a4e9057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:15.573702 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:15:15.603261 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41ff53-690d-4ca1-a57d-2c1c6a4e9057 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:15.607558 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25926de7-6dce-4625-ab7e-5466d0b266ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:15.608315 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25926de7-6dce-4625-ab7e-5466d0b266ba service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:15.608704 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25926de7-6dce-4625-ab7e-5466d0b266ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:15.609083 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25926de7-6dce-4625-ab7e-5466d0b266ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:15.619642 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25926de7-6dce-4625-ab7e-5466d0b266ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:15.621836 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25926de7-6dce-4625-ab7e-5466d0b266ba service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:15.631255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1061/2126] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:15:15 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:15:21.948469 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb298f-6023-482f-a013-d46fad425159 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:22.011516 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb298f-6023-482f-a013-d46fad425159 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:22.016200 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b53da7-35df-4b8e-9923-23b084a12f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:22.016835 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b53da7-35df-4b8e-9923-23b084a12f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:22.017113 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b53da7-35df-4b8e-9923-23b084a12f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:22.017384 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b53da7-35df-4b8e-9923-23b084a12f50 admin admin] PATH_INFO: `/v3/users/ce696fa38fcc4287a7830d595823d339` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:22.018546 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b53da7-35df-4b8e-9923-23b084a12f50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce696fa38fcc4287a7830d595823d339)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:22.020502 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b53da7-35df-4b8e-9923-23b084a12f50 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:22.233672 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-c5b53da7-35df-4b8e-9923-23b084a12f50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce696fa38fcc4287a7830d595823d339'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:22.312269 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-c5b53da7-35df-4b8e-9923-23b084a12f50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce696fa38fcc4287a7830d595823d339'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:22.323624 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:15:22.324969 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-c5b53da7-35df-4b8e-9923-23b084a12f50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce696fa38fcc4287a7830d595823d339'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:22.325634 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-c5b53da7-35df-4b8e-9923-23b084a12f50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce696fa38fcc4287a7830d595823d339'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:22.332606 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-c5b53da7-35df-4b8e-9923-23b084a12f50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce696fa38fcc4287a7830d595823d339'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:22.338509 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1066/2127] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:15:21 2022] DELETE /identity/v3/users/ce696fa38fcc4287a7830d595823d339 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:15:22.343505 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820168d-a37f-4cd8-8ced-053102efab9f None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:22.343957 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820168d-a37f-4cd8-8ced-053102efab9f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:22.344102 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820168d-a37f-4cd8-8ced-053102efab9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:22.363513 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-b820168d-a37f-4cd8-8ced-053102efab9f None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:15:22.364740 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b820168d-a37f-4cd8-8ced-053102efab9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:22.423244 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1062/2128] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:15:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:15:22.432920 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b53da7-35df-4b8e-9923-23b084a12f50 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:22.435031 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-c5b53da7-35df-4b8e-9923-23b084a12f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:22.492028 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b53da7-35df-4b8e-9923-23b084a12f50 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:22.495558 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f6a7e-6a6f-44ac-944e-52480e2ee790 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:22.496229 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f6a7e-6a6f-44ac-944e-52480e2ee790 service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:22.496512 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f6a7e-6a6f-44ac-944e-52480e2ee790 service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:22.496786 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f6a7e-6a6f-44ac-944e-52480e2ee790 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:22.505649 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f6a7e-6a6f-44ac-944e-52480e2ee790 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:22.507068 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f6a7e-6a6f-44ac-944e-52480e2ee790 service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:22.516442 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1067/2129] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:15:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:15:23.021402 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820168d-a37f-4cd8-8ced-053102efab9f None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:23.021402 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b820168d-a37f-4cd8-8ced-053102efab9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:23.032497 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820168d-a37f-4cd8-8ced-053102efab9f None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:23.037279 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea8f2d-63b1-4d60-9b6c-fcaa1f4bdb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:23.037926 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea8f2d-63b1-4d60-9b6c-fcaa1f4bdb3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:23.038212 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea8f2d-63b1-4d60-9b6c-fcaa1f4bdb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:23.038490 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea8f2d-63b1-4d60-9b6c-fcaa1f4bdb3e admin admin] PATH_INFO: `/v3/projects/09d29f783c334d6ead55c5d0ff19a0a5` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:23.039655 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea8f2d-63b1-4d60-9b6c-fcaa1f4bdb3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=09d29f783c334d6ead55c5d0ff19a0a5)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:23.041622 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea8f2d-63b1-4d60-9b6c-fcaa1f4bdb3e admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:23.194790 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1fea8f2d-63b1-4d60-9b6c-fcaa1f4bdb3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09d29f783c334d6ead55c5d0ff19a0a5', 'request_id': 'req-1fea8f2d-63b1-4d60-9b6c-fcaa1f4bdb3e'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:23.204291 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1fea8f2d-63b1-4d60-9b6c-fcaa1f4bdb3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09d29f783c334d6ead55c5d0ff19a0a5', 'request_id': 'req-1fea8f2d-63b1-4d60-9b6c-fcaa1f4bdb3e'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:23.324706 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1fea8f2d-63b1-4d60-9b6c-fcaa1f4bdb3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09d29f783c334d6ead55c5d0ff19a0a5', 'request_id': 'req-1fea8f2d-63b1-4d60-9b6c-fcaa1f4bdb3e'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:23.349698 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1fea8f2d-63b1-4d60-9b6c-fcaa1f4bdb3e admin admin] The token cache is being invalidate because project 09d29f783c334d6ead55c5d0ff19a0a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:15:23.350345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1fea8f2d-63b1-4d60-9b6c-fcaa1f4bdb3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:23.350750 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1fea8f2d-63b1-4d60-9b6c-fcaa1f4bdb3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:23.352384 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1063/2130] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:15:23 2022] DELETE /identity/v3/projects/09d29f783c334d6ead55c5d0ff19a0a5 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:15:23.357624 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c94570-0c08-4f01-961c-393fd6a16e3a None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:23.358188 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c94570-0c08-4f01-961c-393fd6a16e3a None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:23.358188 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c94570-0c08-4f01-961c-393fd6a16e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:23.378243 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-d9c94570-0c08-4f01-961c-393fd6a16e3a None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:15:23.379441 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-d9c94570-0c08-4f01-961c-393fd6a16e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:23.439101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1068/2131] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:15:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:15:23.446924 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135bbcb-c3b0-46ba-8a87-793f4fd357ec None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:23.447208 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135bbcb-c3b0-46ba-8a87-793f4fd357ec None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:23.447484 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135bbcb-c3b0-46ba-8a87-793f4fd357ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:23.468903 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-6135bbcb-c3b0-46ba-8a87-793f4fd357ec None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:15:23.470132 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6135bbcb-c3b0-46ba-8a87-793f4fd357ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:23.478425 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1064/2132] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:15:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:15:23.483406 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c94570-0c08-4f01-961c-393fd6a16e3a None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:23.493405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c94570-0c08-4f01-961c-393fd6a16e3a None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:23.498490 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc5c90-e21c-4af1-9edc-d4bb960bac2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:23.499080 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc5c90-e21c-4af1-9edc-d4bb960bac2d admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:23.499396 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc5c90-e21c-4af1-9edc-d4bb960bac2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:23.499680 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc5c90-e21c-4af1-9edc-d4bb960bac2d admin admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:23.500362 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc5c90-e21c-4af1-9edc-d4bb960bac2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:15:23.500671 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc5c90-e21c-4af1-9edc-d4bb960bac2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:23.502249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc5c90-e21c-4af1-9edc-d4bb960bac2d admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:23.513738 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1069/2133] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:15:23.531855 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135bbcb-c3b0-46ba-8a87-793f4fd357ec None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:23.541267 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135bbcb-c3b0-46ba-8a87-793f4fd357ec None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:23.546446 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707b984-9c6c-4741-91c9-b33475647f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:23.547044 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707b984-9c6c-4741-91c9-b33475647f53 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:23.547330 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707b984-9c6c-4741-91c9-b33475647f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:23.547605 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707b984-9c6c-4741-91c9-b33475647f53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:23.548279 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707b984-9c6c-4741-91c9-b33475647f53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:23.550175 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707b984-9c6c-4741-91c9-b33475647f53 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:23.667371 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1065/2134] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:15:23 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:15:23.672108 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc5c90-e21c-4af1-9edc-d4bb960bac2d admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:23.682433 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc5c90-e21c-4af1-9edc-d4bb960bac2d admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:23.738977 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3a251-cf9e-479d-bbe5-daca32b863d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:23.739585 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3a251-cf9e-479d-bbe5-daca32b863d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:23.739869 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3a251-cf9e-479d-bbe5-daca32b863d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:23.740186 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3a251-cf9e-479d-bbe5-daca32b863d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:23.740819 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3a251-cf9e-479d-bbe5-daca32b863d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:23.742741 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3a251-cf9e-479d-bbe5-daca32b863d4 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:23.831125 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1070/2135] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:15:23 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:15:23.835193 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707b984-9c6c-4741-91c9-b33475647f53 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:23.846132 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707b984-9c6c-4741-91c9-b33475647f53 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:23.850823 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bfe632-73c5-4d69-82bb-bdefab45f5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:23.851429 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfe632-73c5-4d69-82bb-bdefab45f5bc admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:23.851711 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfe632-73c5-4d69-82bb-bdefab45f5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:23.851985 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfe632-73c5-4d69-82bb-bdefab45f5bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:23.852668 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bfe632-73c5-4d69-82bb-bdefab45f5bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:23.854301 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bfe632-73c5-4d69-82bb-bdefab45f5bc admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:23.865405 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1066/2136] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:15:23.869259 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3a251-cf9e-479d-bbe5-daca32b863d4 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:23.880206 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3a251-cf9e-479d-bbe5-daca32b863d4 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:23.884979 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaac15c-d208-45f4-8536-6817d7ebd36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:23.885577 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaac15c-d208-45f4-8536-6817d7ebd36a admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:23.885859 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaac15c-d208-45f4-8536-6817d7ebd36a admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:23.886140 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaac15c-d208-45f4-8536-6817d7ebd36a admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:23.886783 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaac15c-d208-45f4-8536-6817d7ebd36a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:23.888457 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaac15c-d208-45f4-8536-6817d7ebd36a admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:23.889732 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:15:23.899717 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1071/2137] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:15:23.907899 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bfe632-73c5-4d69-82bb-bdefab45f5bc admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:23.914283 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bfe632-73c5-4d69-82bb-bdefab45f5bc admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:23.919568 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9cbbc-7623-400b-90ec-17be099699be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:23.920259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9cbbc-7623-400b-90ec-17be099699be admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:23.920543 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9cbbc-7623-400b-90ec-17be099699be admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:23.920823 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9cbbc-7623-400b-90ec-17be099699be admin admin] PATH_INFO: `/v3/projects/6cac0dfe7a724b3d9b72a317e8edce68/users/f6448e0a06444705abd41215526e939c/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:23.931747 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:15:23.938250 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc9cbbc-7623-400b-90ec-17be099699be admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cac0dfe7a724b3d9b72a317e8edce68, user_id=f6448e0a06444705abd41215526e939c, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:23.938505 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc9cbbc-7623-400b-90ec-17be099699be admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:24.050562 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1067/2138] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:15:23 2022] PUT /identity/v3/projects/6cac0dfe7a724b3d9b72a317e8edce68/users/f6448e0a06444705abd41215526e939c/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:15:24.055787 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87f5b7-9cfb-4d3f-a64b-3e622901dab2 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:24.056120 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87f5b7-9cfb-4d3f-a64b-3e622901dab2 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:24.056420 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87f5b7-9cfb-4d3f-a64b-3e622901dab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:24.075062 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-de87f5b7-9cfb-4d3f-a64b-3e622901dab2 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:15:24.076294 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-de87f5b7-9cfb-4d3f-a64b-3e622901dab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:24.134950 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1072/2139] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:15:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:15:24.144499 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9cbbc-7623-400b-90ec-17be099699be admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:24.146174 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-bfc9cbbc-7623-400b-90ec-17be099699be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:24.203172 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9cbbc-7623-400b-90ec-17be099699be admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:24.206754 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b35174-5fa4-43ed-a621-280d72cf929f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:24.207354 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b35174-5fa4-43ed-a621-280d72cf929f service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:24.207633 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b35174-5fa4-43ed-a621-280d72cf929f service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:24.207901 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b35174-5fa4-43ed-a621-280d72cf929f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:24.217257 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b35174-5fa4-43ed-a621-280d72cf929f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:24.218668 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b35174-5fa4-43ed-a621-280d72cf929f service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:24.227967 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1068/2140] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:15:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:15:29.958730 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d890f-ca34-4c61-a207-b0a5a401fb4d None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:29.959205 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d890f-ca34-4c61-a207-b0a5a401fb4d None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:29.959289 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d890f-ca34-4c61-a207-b0a5a401fb4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:29.989156 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-c88d890f-ca34-4c61-a207-b0a5a401fb4d None None] MFA Rules not processed for user `f6448e0a06444705abd41215526e939c`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:15:29.990385 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-c88d890f-ca34-4c61-a207-b0a5a401fb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:30.065266 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1073/2141] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:15:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:15:30.069911 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b35174-5fa4-43ed-a621-280d72cf929f service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:30.079500 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b35174-5fa4-43ed-a621-280d72cf929f service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:30.084277 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3a656-ef1b-4c4b-8020-c7f60283eaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:30.084871 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3a656-ef1b-4c4b-8020-c7f60283eaa0 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:30.085151 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3a656-ef1b-4c4b-8020-c7f60283eaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:30.085424 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3a656-ef1b-4c4b-8020-c7f60283eaa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:30.086060 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3a656-ef1b-4c4b-8020-c7f60283eaa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:30.088079 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3a656-ef1b-4c4b-8020-c7f60283eaa0 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:30.288445 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1069/2142] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:15:30 2022] POST /identity/v3/projects => generated 381 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:15:30.289978 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d890f-ca34-4c61-a207-b0a5a401fb4d None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:30.301334 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d890f-ca34-4c61-a207-b0a5a401fb4d None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:30.362994 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2dfd0b-2818-4d60-a9df-f2c69af6ea51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:30.363610 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2dfd0b-2818-4d60-a9df-f2c69af6ea51 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:30.363893 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2dfd0b-2818-4d60-a9df-f2c69af6ea51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:30.364207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2dfd0b-2818-4d60-a9df-f2c69af6ea51 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:30.364857 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2dfd0b-2818-4d60-a9df-f2c69af6ea51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:30.366771 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2dfd0b-2818-4d60-a9df-f2c69af6ea51 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:30.531330 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1074/2143] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:15:30 2022] POST /identity/v3/users => generated 297 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:15:30.535729 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3a656-ef1b-4c4b-8020-c7f60283eaa0 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:30.547016 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3a656-ef1b-4c4b-8020-c7f60283eaa0 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:30.551558 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af551160-d15d-4e21-a189-9a83983ad61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:30.552185 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af551160-d15d-4e21-a189-9a83983ad61e admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:30.552491 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af551160-d15d-4e21-a189-9a83983ad61e admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:30.552764 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af551160-d15d-4e21-a189-9a83983ad61e admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:30.553400 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af551160-d15d-4e21-a189-9a83983ad61e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:30.554986 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af551160-d15d-4e21-a189-9a83983ad61e admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:30.565402 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1070/2144] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:15:30.571080 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2dfd0b-2818-4d60-a9df-f2c69af6ea51 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:30.582627 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2dfd0b-2818-4d60-a9df-f2c69af6ea51 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:30.587689 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845f112-6cdd-4a6a-acb3-3466e5814b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:30.588407 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845f112-6cdd-4a6a-acb3-3466e5814b90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:30.588801 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845f112-6cdd-4a6a-acb3-3466e5814b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:30.589155 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845f112-6cdd-4a6a-acb3-3466e5814b90 admin admin] PATH_INFO: `/v3/projects/b27d16291cb345849b5e2aeab2c2b04b/users/36d611dad36c44d3940ac6db7e0acac4/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:30.603730 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:15:30.606997 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845f112-6cdd-4a6a-acb3-3466e5814b90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b27d16291cb345849b5e2aeab2c2b04b, user_id=36d611dad36c44d3940ac6db7e0acac4, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:30.609939 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845f112-6cdd-4a6a-acb3-3466e5814b90 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:30.696183 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1075/2145] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:15:30 2022] PUT /identity/v3/projects/b27d16291cb345849b5e2aeab2c2b04b/users/36d611dad36c44d3940ac6db7e0acac4/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:15:30.700756 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af551160-d15d-4e21-a189-9a83983ad61e admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:30.711499 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af551160-d15d-4e21-a189-9a83983ad61e admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:30.769334 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd1767f-47aa-46b3-98ad-4f609604fd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:30.769950 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1767f-47aa-46b3-98ad-4f609604fd78 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:30.770231 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1767f-47aa-46b3-98ad-4f609604fd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:30.770505 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1767f-47aa-46b3-98ad-4f609604fd78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:30.771143 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd1767f-47aa-46b3-98ad-4f609604fd78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:30.772772 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd1767f-47aa-46b3-98ad-4f609604fd78 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:30.782726 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1071/2146] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:15:30.787362 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845f112-6cdd-4a6a-acb3-3466e5814b90 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:30.799695 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845f112-6cdd-4a6a-acb3-3466e5814b90 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:30.804557 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b4997-3ec6-4cbd-96e5-4cdaeb6af046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:30.805252 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b4997-3ec6-4cbd-96e5-4cdaeb6af046 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:30.805508 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b4997-3ec6-4cbd-96e5-4cdaeb6af046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:30.806200 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b4997-3ec6-4cbd-96e5-4cdaeb6af046 admin admin] PATH_INFO: `/v3/projects/b27d16291cb345849b5e2aeab2c2b04b/users/36d611dad36c44d3940ac6db7e0acac4/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:30.808086 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b4997-3ec6-4cbd-96e5-4cdaeb6af046 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b27d16291cb345849b5e2aeab2c2b04b, user_id=36d611dad36c44d3940ac6db7e0acac4, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:30.810994 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b4997-3ec6-4cbd-96e5-4cdaeb6af046 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:30.821934 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1076/2147] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:15:30 2022] PUT /identity/v3/projects/b27d16291cb345849b5e2aeab2c2b04b/users/36d611dad36c44d3940ac6db7e0acac4/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:15:38.188168 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995af79-82ff-4e79-b57c-d484c717342f None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:38.188694 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995af79-82ff-4e79-b57c-d484c717342f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:38.188794 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995af79-82ff-4e79-b57c-d484c717342f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:38.219011 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-d995af79-82ff-4e79-b57c-d484c717342f None None] MFA Rules not processed for user `36d611dad36c44d3940ac6db7e0acac4`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:15:38.220252 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d995af79-82ff-4e79-b57c-d484c717342f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:38.265456 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:15:38.288921 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b4997-3ec6-4cbd-96e5-4cdaeb6af046 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:38.291236 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-5e5b4997-3ec6-4cbd-96e5-4cdaeb6af046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:38.295222 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1072/2148] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:15:38 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:15:38.307486 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995af79-82ff-4e79-b57c-d484c717342f None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:38.308849 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d995af79-82ff-4e79-b57c-d484c717342f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:38.357043 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b4997-3ec6-4cbd-96e5-4cdaeb6af046 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:38.361152 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09a4e6-fdfd-4c87-8650-63ef049ca1da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:38.361910 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09a4e6-fdfd-4c87-8650-63ef049ca1da service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:38.362286 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09a4e6-fdfd-4c87-8650-63ef049ca1da service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:38.362597 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09a4e6-fdfd-4c87-8650-63ef049ca1da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:38.364449 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-7f09a4e6-fdfd-4c87-8650-63ef049ca1da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:38.371096 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995af79-82ff-4e79-b57c-d484c717342f None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:38.374918 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22cc62-6760-40be-b3b7-b72917bb9399 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d0e8cc074b4e36acc2162aebeac169', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:38.375608 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22cc62-6760-40be-b3b7-b72917bb9399 service glance] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:38.375949 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22cc62-6760-40be-b3b7-b72917bb9399 service glance] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:38.376198 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22cc62-6760-40be-b3b7-b72917bb9399 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:38.428831 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f09a4e6-fdfd-4c87-8650-63ef049ca1da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:38.430261 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f09a4e6-fdfd-4c87-8650-63ef049ca1da service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:38.433639 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22cc62-6760-40be-b3b7-b72917bb9399 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:38.435234 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22cc62-6760-40be-b3b7-b72917bb9399 service glance] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:38.440173 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1077/2149] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:15:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:15:38.444563 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1073/2150] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:15:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:15:38.722701 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805f016-a65e-4f59-89f0-f3ea524e6145 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:38.723114 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805f016-a65e-4f59-89f0-f3ea524e6145 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:38.723442 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805f016-a65e-4f59-89f0-f3ea524e6145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:38.743367 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-b805f016-a65e-4f59-89f0-f3ea524e6145 None None] MFA Rules not processed for user `3c90765757a34c6291c9980a7d5d5c79`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:15:38.744708 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-b805f016-a65e-4f59-89f0-f3ea524e6145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:38.806860 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1078/2151] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Oct 26 11:15:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:15:38.981872 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22cc62-6760-40be-b3b7-b72917bb9399 service glance] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:38.983311 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9e22cc62-6760-40be-b3b7-b72917bb9399 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:39.065873 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22cc62-6760-40be-b3b7-b72917bb9399 service glance] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:39.072367 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36abb02a-37e5-4041-b171-363d165b3fb4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21b84cc38a848de8d19a41e1eb04a58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:39.073079 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abb02a-37e5-4041-b171-363d165b3fb4 service swift] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:39.073306 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abb02a-37e5-4041-b171-363d165b3fb4 service swift] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:39.073578 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abb02a-37e5-4041-b171-363d165b3fb4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:39.083441 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36abb02a-37e5-4041-b171-363d165b3fb4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:39.085155 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36abb02a-37e5-4041-b171-363d165b3fb4 service swift] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:39.098127 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1074/2152] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Oct 26 11:15:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 26 11:15:39.909650 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805f016-a65e-4f59-89f0-f3ea524e6145 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:39.911768 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-b805f016-a65e-4f59-89f0-f3ea524e6145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:39.945699 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805f016-a65e-4f59-89f0-f3ea524e6145 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:39.955519 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73791b-4693-40bd-bd3c-77cb8d0158dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:39.956655 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73791b-4693-40bd-bd3c-77cb8d0158dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:39.957273 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73791b-4693-40bd-bd3c-77cb8d0158dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:39.957730 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73791b-4693-40bd-bd3c-77cb8d0158dc admin admin] PATH_INFO: `/v3/users/bfef80e955344073a2a35c569e199f24` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:39.959686 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce73791b-4693-40bd-bd3c-77cb8d0158dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfef80e955344073a2a35c569e199f24)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:39.962337 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce73791b-4693-40bd-bd3c-77cb8d0158dc admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:40.089592 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:15:40.302796 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-ce73791b-4693-40bd-bd3c-77cb8d0158dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfef80e955344073a2a35c569e199f24'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:40.429612 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-ce73791b-4693-40bd-bd3c-77cb8d0158dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfef80e955344073a2a35c569e199f24'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:40.445654 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-ce73791b-4693-40bd-bd3c-77cb8d0158dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfef80e955344073a2a35c569e199f24'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:40.446534 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-ce73791b-4693-40bd-bd3c-77cb8d0158dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfef80e955344073a2a35c569e199f24'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:40.456683 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-ce73791b-4693-40bd-bd3c-77cb8d0158dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfef80e955344073a2a35c569e199f24'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:40.464174 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1079/2153] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:15:39 2022] DELETE /identity/v3/users/bfef80e955344073a2a35c569e199f24 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:15:40.867666 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36abb02a-37e5-4041-b171-363d165b3fb4 service swift] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:40.891472 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36abb02a-37e5-4041-b171-363d165b3fb4 service swift] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:40.935110 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:15:41.001649 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8cb08f-f7e1-4d8c-b7ba-d2aba826f40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:41.003961 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8cb08f-f7e1-4d8c-b7ba-d2aba826f40f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:41.003961 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8cb08f-f7e1-4d8c-b7ba-d2aba826f40f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:41.003961 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8cb08f-f7e1-4d8c-b7ba-d2aba826f40f admin admin] PATH_INFO: `/v3/projects/35adffd47f334db69701a48b5f11b1a2` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:41.005706 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8cb08f-f7e1-4d8c-b7ba-d2aba826f40f admin admin] RBAC: Authorizing `identity:delete_project(project_id=35adffd47f334db69701a48b5f11b1a2)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:41.007752 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8cb08f-f7e1-4d8c-b7ba-d2aba826f40f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:41.154156 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-be8cb08f-f7e1-4d8c-b7ba-d2aba826f40f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35adffd47f334db69701a48b5f11b1a2', 'request_id': 'req-be8cb08f-f7e1-4d8c-b7ba-d2aba826f40f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:41.185689 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-be8cb08f-f7e1-4d8c-b7ba-d2aba826f40f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35adffd47f334db69701a48b5f11b1a2', 'request_id': 'req-be8cb08f-f7e1-4d8c-b7ba-d2aba826f40f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:41.306653 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-be8cb08f-f7e1-4d8c-b7ba-d2aba826f40f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35adffd47f334db69701a48b5f11b1a2', 'request_id': 'req-be8cb08f-f7e1-4d8c-b7ba-d2aba826f40f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:41.350697 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-be8cb08f-f7e1-4d8c-b7ba-d2aba826f40f admin admin] The token cache is being invalidate because project 35adffd47f334db69701a48b5f11b1a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:15:41.351007 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-be8cb08f-f7e1-4d8c-b7ba-d2aba826f40f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:41.352650 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-be8cb08f-f7e1-4d8c-b7ba-d2aba826f40f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:41.358130 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1075/2154] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:15:40 2022] DELETE /identity/v3/projects/35adffd47f334db69701a48b5f11b1a2 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:15:41.363148 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfaa0e-ccf0-4835-90cd-f5e2069f2013 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:41.368502 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfaa0e-ccf0-4835-90cd-f5e2069f2013 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:41.368502 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfaa0e-ccf0-4835-90cd-f5e2069f2013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:41.389072 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-36dfaa0e-ccf0-4835-90cd-f5e2069f2013 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:15:41.390315 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-36dfaa0e-ccf0-4835-90cd-f5e2069f2013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:41.461376 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1080/2155] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:15:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:15:41.469616 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c0361-9d98-477d-8963-cf6a57fffc94 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:41.469898 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c0361-9d98-477d-8963-cf6a57fffc94 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:41.470177 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c0361-9d98-477d-8963-cf6a57fffc94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:41.495600 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-571c0361-9d98-477d-8963-cf6a57fffc94 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:15:41.497483 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-571c0361-9d98-477d-8963-cf6a57fffc94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:41.509714 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1076/2156] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:15:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:15:41.518568 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfaa0e-ccf0-4835-90cd-f5e2069f2013 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:41.530908 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfaa0e-ccf0-4835-90cd-f5e2069f2013 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:41.535938 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7d4c4-163f-4025-8fcd-7a6008132e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:41.536808 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7d4c4-163f-4025-8fcd-7a6008132e70 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:41.537086 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7d4c4-163f-4025-8fcd-7a6008132e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:41.537360 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7d4c4-163f-4025-8fcd-7a6008132e70 admin admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:41.538101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc7d4c4-163f-4025-8fcd-7a6008132e70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:15:41.538435 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc7d4c4-163f-4025-8fcd-7a6008132e70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:41.540093 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc7d4c4-163f-4025-8fcd-7a6008132e70 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:41.560394 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c0361-9d98-477d-8963-cf6a57fffc94 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:41.563030 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1081/2157] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 11:15:41.587931 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c0361-9d98-477d-8963-cf6a57fffc94 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:41.598763 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8899aad-457c-421a-b8ff-629a8b05cf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:41.599332 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8899aad-457c-421a-b8ff-629a8b05cf37 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:41.599619 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8899aad-457c-421a-b8ff-629a8b05cf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:41.599898 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8899aad-457c-421a-b8ff-629a8b05cf37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:41.600573 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8899aad-457c-421a-b8ff-629a8b05cf37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:41.602658 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8899aad-457c-421a-b8ff-629a8b05cf37 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:41.746204 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1077/2158] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:15:41 2022] POST /identity/v3/projects => generated 375 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:15:41.750752 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7d4c4-163f-4025-8fcd-7a6008132e70 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:41.767621 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7d4c4-163f-4025-8fcd-7a6008132e70 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:41.865089 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66302eca-982b-45b6-8372-a9f6fd84e51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:41.866032 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66302eca-982b-45b6-8372-a9f6fd84e51a admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:41.866420 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66302eca-982b-45b6-8372-a9f6fd84e51a admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:41.866705 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66302eca-982b-45b6-8372-a9f6fd84e51a admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:41.867357 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66302eca-982b-45b6-8372-a9f6fd84e51a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:41.869332 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66302eca-982b-45b6-8372-a9f6fd84e51a admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:42.009502 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8899aad-457c-421a-b8ff-629a8b05cf37 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:42.014878 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e8899aad-457c-421a-b8ff-629a8b05cf37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:42.015021 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1082/2159] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:15:41 2022] POST /identity/v3/users => generated 288 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:15:42.016702 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66302eca-982b-45b6-8372-a9f6fd84e51a admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:42.032820 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66302eca-982b-45b6-8372-a9f6fd84e51a admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:42.038730 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f5717-b288-4601-ae36-e38ce4c68142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:42.039525 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f5717-b288-4601-ae36-e38ce4c68142 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:42.039954 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f5717-b288-4601-ae36-e38ce4c68142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:42.040374 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f5717-b288-4601-ae36-e38ce4c68142 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:42.041167 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f5717-b288-4601-ae36-e38ce4c68142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:42.043470 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f5717-b288-4601-ae36-e38ce4c68142 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:42.063426 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1083/2160] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:15:42.067186 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f5717-b288-4601-ae36-e38ce4c68142 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:42.084958 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f5717-b288-4601-ae36-e38ce4c68142 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:42.092436 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e251225-081f-48b9-9c52-1c407329743a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:42.093591 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e251225-081f-48b9-9c52-1c407329743a admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:42.096191 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e251225-081f-48b9-9c52-1c407329743a admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:42.097036 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e251225-081f-48b9-9c52-1c407329743a admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:42.101122 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e251225-081f-48b9-9c52-1c407329743a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:42.101438 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e251225-081f-48b9-9c52-1c407329743a admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:42.112519 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:15:42.116553 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8899aad-457c-421a-b8ff-629a8b05cf37 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:42.120771 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b16d60-2e7b-453a-8dab-0e4e40467331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:42.122064 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b16d60-2e7b-453a-8dab-0e4e40467331 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:42.122357 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b16d60-2e7b-453a-8dab-0e4e40467331 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:42.122634 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b16d60-2e7b-453a-8dab-0e4e40467331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:42.124505 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d8b16d60-2e7b-453a-8dab-0e4e40467331 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:42.131493 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1084/2161] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:15:42.136579 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e251225-081f-48b9-9c52-1c407329743a admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:42.161158 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e251225-081f-48b9-9c52-1c407329743a admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:42.172371 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e7f075-f9e2-4672-9f75-9ca2c30b2783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:42.173565 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7f075-f9e2-4672-9f75-9ca2c30b2783 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:42.175319 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7f075-f9e2-4672-9f75-9ca2c30b2783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:42.175918 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7f075-f9e2-4672-9f75-9ca2c30b2783 admin admin] PATH_INFO: `/v3/projects/701c8bac44244fd49e1194275a6e6b09/users/f484abfc918f47ff8531fb52cf1c3bb7/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:42.205254 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:15:42.223810 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e7f075-f9e2-4672-9f75-9ca2c30b2783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=701c8bac44244fd49e1194275a6e6b09, user_id=f484abfc918f47ff8531fb52cf1c3bb7, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:42.227407 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e7f075-f9e2-4672-9f75-9ca2c30b2783 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:42.258834 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b16d60-2e7b-453a-8dab-0e4e40467331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:42.260371 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b16d60-2e7b-453a-8dab-0e4e40467331 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:42.273795 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1078/2162] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:15:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:15:42.320967 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ea653-9357-4bb5-ae50-ffc92aeb6efc None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:42.326489 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ea653-9357-4bb5-ae50-ffc92aeb6efc None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:42.326489 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ea653-9357-4bb5-ae50-ffc92aeb6efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:42.326849 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1085/2163] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:15:42 2022] PUT /identity/v3/projects/701c8bac44244fd49e1194275a6e6b09/users/f484abfc918f47ff8531fb52cf1c3bb7/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:15:42.377187 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-cc1ea653-9357-4bb5-ae50-ffc92aeb6efc None None] MFA Rules not processed for user `f484abfc918f47ff8531fb52cf1c3bb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:15:42.378778 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-cc1ea653-9357-4bb5-ae50-ffc92aeb6efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:42.477539 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1079/2164] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:15:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:15:42.489686 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e7f075-f9e2-4672-9f75-9ca2c30b2783 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:42.491513 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-14e7f075-f9e2-4672-9f75-9ca2c30b2783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:42.580367 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e7f075-f9e2-4672-9f75-9ca2c30b2783 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:42.588115 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77c927-ea71-4377-a588-c8cc6ffa93bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:42.588115 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77c927-ea71-4377-a588-c8cc6ffa93bc service nova] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:42.588115 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77c927-ea71-4377-a588-c8cc6ffa93bc service nova] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:42.588115 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77c927-ea71-4377-a588-c8cc6ffa93bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:42.598742 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad77c927-ea71-4377-a588-c8cc6ffa93bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:42.600757 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad77c927-ea71-4377-a588-c8cc6ffa93bc service nova] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:42.612432 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1086/2165] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:15:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:15:42.850146 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ea653-9357-4bb5-ae50-ffc92aeb6efc None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:42.924160 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ea653-9357-4bb5-ae50-ffc92aeb6efc None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:42.929169 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd73758-8848-4bb5-88cc-fd1674abfe62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:42.929854 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd73758-8848-4bb5-88cc-fd1674abfe62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:42.930131 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd73758-8848-4bb5-88cc-fd1674abfe62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:42.930403 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd73758-8848-4bb5-88cc-fd1674abfe62 admin admin] PATH_INFO: `/v3/users/f484abfc918f47ff8531fb52cf1c3bb7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:42.931569 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd73758-8848-4bb5-88cc-fd1674abfe62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f484abfc918f47ff8531fb52cf1c3bb7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:42.933681 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd73758-8848-4bb5-88cc-fd1674abfe62 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:43.524833 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3cd73758-8848-4bb5-88cc-fd1674abfe62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f484abfc918f47ff8531fb52cf1c3bb7'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:43.557520 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77c927-ea71-4377-a588-c8cc6ffa93bc service nova] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:43.560525 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-ad77c927-ea71-4377-a588-c8cc6ffa93bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:43.616456 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3cd73758-8848-4bb5-88cc-fd1674abfe62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f484abfc918f47ff8531fb52cf1c3bb7'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:43.623409 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:15:43.640722 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3cd73758-8848-4bb5-88cc-fd1674abfe62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f484abfc918f47ff8531fb52cf1c3bb7'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:43.661125 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3cd73758-8848-4bb5-88cc-fd1674abfe62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f484abfc918f47ff8531fb52cf1c3bb7'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:43.661974 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3cd73758-8848-4bb5-88cc-fd1674abfe62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f484abfc918f47ff8531fb52cf1c3bb7'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:43.673277 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1080/2166] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:15:42 2022] DELETE /identity/v3/users/f484abfc918f47ff8531fb52cf1c3bb7 => generated 0 bytes in 824 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:15:43.675103 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77c927-ea71-4377-a588-c8cc6ffa93bc service nova] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:43.690437 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8bdf2-b42b-45d9-8fe7-b9a3f2714a6e None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:43.690864 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8bdf2-b42b-45d9-8fe7-b9a3f2714a6e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:43.691380 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8bdf2-b42b-45d9-8fe7-b9a3f2714a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:43.734689 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-28a8bdf2-b42b-45d9-8fe7-b9a3f2714a6e None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:15:43.738538 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-28a8bdf2-b42b-45d9-8fe7-b9a3f2714a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:43.830765 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0905001a-873c-4956-a8d7-44a6a16af2e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:43.848606 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905001a-873c-4956-a8d7-44a6a16af2e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:43.848606 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905001a-873c-4956-a8d7-44a6a16af2e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:43.848606 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905001a-873c-4956-a8d7-44a6a16af2e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:43.848606 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-0905001a-873c-4956-a8d7-44a6a16af2e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:43.886283 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:15:43.899639 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1081/2167] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:15:43.905676 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8bdf2-b42b-45d9-8fe7-b9a3f2714a6e None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:43.909085 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-28a8bdf2-b42b-45d9-8fe7-b9a3f2714a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:43.935361 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8bdf2-b42b-45d9-8fe7-b9a3f2714a6e None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:43.947431 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc10d8-5490-44b5-bb16-129cf75f5063 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:43.957451 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc10d8-5490-44b5-bb16-129cf75f5063 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:43.957451 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc10d8-5490-44b5-bb16-129cf75f5063 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:43.957451 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc10d8-5490-44b5-bb16-129cf75f5063 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:43.959385 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0905001a-873c-4956-a8d7-44a6a16af2e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:43.961209 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0905001a-873c-4956-a8d7-44a6a16af2e2 service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:43.974055 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc10d8-5490-44b5-bb16-129cf75f5063 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:43.977493 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc10d8-5490-44b5-bb16-129cf75f5063 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:43.980475 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1087/2168] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:15:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:15:44.006981 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1082/2169] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:15:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:15:44.607663 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0905001a-873c-4956-a8d7-44a6a16af2e2 service neutron] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:44.610127 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-0905001a-873c-4956-a8d7-44a6a16af2e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:44.629188 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0905001a-873c-4956-a8d7-44a6a16af2e2 service neutron] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:44.635077 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a564c-8881-483e-86ab-e5994cd1bdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:44.635890 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a564c-8881-483e-86ab-e5994cd1bdba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:44.636215 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a564c-8881-483e-86ab-e5994cd1bdba admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:44.636492 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a564c-8881-483e-86ab-e5994cd1bdba admin admin] PATH_INFO: `/v3/projects/701c8bac44244fd49e1194275a6e6b09` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:44.639378 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a564c-8881-483e-86ab-e5994cd1bdba admin admin] RBAC: Authorizing `identity:delete_project(project_id=701c8bac44244fd49e1194275a6e6b09)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:44.641544 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a564c-8881-483e-86ab-e5994cd1bdba admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:44.760531 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-3b6a564c-8881-483e-86ab-e5994cd1bdba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '701c8bac44244fd49e1194275a6e6b09', 'request_id': 'req-3b6a564c-8881-483e-86ab-e5994cd1bdba'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:44.833261 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-3b6a564c-8881-483e-86ab-e5994cd1bdba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '701c8bac44244fd49e1194275a6e6b09', 'request_id': 'req-3b6a564c-8881-483e-86ab-e5994cd1bdba'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:44.841254 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-3b6a564c-8881-483e-86ab-e5994cd1bdba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '701c8bac44244fd49e1194275a6e6b09', 'request_id': 'req-3b6a564c-8881-483e-86ab-e5994cd1bdba'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:44.854827 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-3b6a564c-8881-483e-86ab-e5994cd1bdba admin admin] The token cache is being invalidate because project 701c8bac44244fd49e1194275a6e6b09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:15:44.855039 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-3b6a564c-8881-483e-86ab-e5994cd1bdba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:44.855826 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-3b6a564c-8881-483e-86ab-e5994cd1bdba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:44.858190 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1088/2170] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:15:44 2022] DELETE /identity/v3/projects/701c8bac44244fd49e1194275a6e6b09 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:15:44.863232 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4e968-9efb-417b-a341-7e5ce4262f2b None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:44.863698 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4e968-9efb-417b-a341-7e5ce4262f2b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:44.863783 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4e968-9efb-417b-a341-7e5ce4262f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:44.886544 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-99c4e968-9efb-417b-a341-7e5ce4262f2b None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:15:44.887172 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-99c4e968-9efb-417b-a341-7e5ce4262f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:44.957011 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1083/2171] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:15:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:15:44.965126 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d0517-42f1-4a39-9756-d54794f0aae3 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:44.965946 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d0517-42f1-4a39-9756-d54794f0aae3 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:44.966219 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d0517-42f1-4a39-9756-d54794f0aae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:44.991700 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-af3d0517-42f1-4a39-9756-d54794f0aae3 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:15:44.993092 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-af3d0517-42f1-4a39-9756-d54794f0aae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:45.005181 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1089/2172] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:15:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:15:45.009202 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4e968-9efb-417b-a341-7e5ce4262f2b None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:45.024045 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4e968-9efb-417b-a341-7e5ce4262f2b None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:45.031091 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fee03f-c8ee-4ffe-8f90-b455d488d3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:45.031841 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fee03f-c8ee-4ffe-8f90-b455d488d3be admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:45.032276 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fee03f-c8ee-4ffe-8f90-b455d488d3be admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:45.032848 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fee03f-c8ee-4ffe-8f90-b455d488d3be admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:45.033616 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fee03f-c8ee-4ffe-8f90-b455d488d3be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:15:45.034020 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fee03f-c8ee-4ffe-8f90-b455d488d3be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:45.035721 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fee03f-c8ee-4ffe-8f90-b455d488d3be admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:45.056107 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1084/2173] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:15:45.058128 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d0517-42f1-4a39-9756-d54794f0aae3 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:45.080855 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d0517-42f1-4a39-9756-d54794f0aae3 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:45.095902 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae017b62-1424-4a46-a055-c5797e642dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:45.096858 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae017b62-1424-4a46-a055-c5797e642dc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:45.097329 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae017b62-1424-4a46-a055-c5797e642dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:45.097991 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae017b62-1424-4a46-a055-c5797e642dc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:45.098740 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae017b62-1424-4a46-a055-c5797e642dc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:45.100953 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae017b62-1424-4a46-a055-c5797e642dc9 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:45.211233 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1090/2174] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:15:45 2022] POST /identity/v3/projects => generated 381 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:15:45.225064 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fee03f-c8ee-4ffe-8f90-b455d488d3be admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:45.237204 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fee03f-c8ee-4ffe-8f90-b455d488d3be admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:45.320627 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:15:45.337380 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df2f697-b88d-4588-bc6d-6f1d2128e776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:45.338107 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2f697-b88d-4588-bc6d-6f1d2128e776 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:45.338524 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2f697-b88d-4588-bc6d-6f1d2128e776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:45.338979 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2f697-b88d-4588-bc6d-6f1d2128e776 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:45.339638 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df2f697-b88d-4588-bc6d-6f1d2128e776 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:45.342474 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df2f697-b88d-4588-bc6d-6f1d2128e776 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:45.464171 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1085/2175] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:15:45 2022] POST /identity/v3/users => generated 291 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:15:45.472624 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae017b62-1424-4a46-a055-c5797e642dc9 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:45.485613 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae017b62-1424-4a46-a055-c5797e642dc9 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:45.491348 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7aa417-3768-4738-8686-eda1790b9572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:45.492175 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7aa417-3768-4738-8686-eda1790b9572 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:45.492738 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7aa417-3768-4738-8686-eda1790b9572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:45.493164 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7aa417-3768-4738-8686-eda1790b9572 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:45.494132 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7aa417-3768-4738-8686-eda1790b9572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:45.495900 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7aa417-3768-4738-8686-eda1790b9572 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:45.509239 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1091/2176] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:15:45.513695 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df2f697-b88d-4588-bc6d-6f1d2128e776 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:45.524505 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df2f697-b88d-4588-bc6d-6f1d2128e776 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:45.540111 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059e7f5-3225-4fca-8054-d2c120c7e664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:45.540758 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059e7f5-3225-4fca-8054-d2c120c7e664 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:45.541041 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059e7f5-3225-4fca-8054-d2c120c7e664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:45.541327 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059e7f5-3225-4fca-8054-d2c120c7e664 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:45.541989 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059e7f5-3225-4fca-8054-d2c120c7e664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:45.543647 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059e7f5-3225-4fca-8054-d2c120c7e664 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:45.558506 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1086/2177] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:15:45.560317 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7aa417-3768-4738-8686-eda1790b9572 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:45.578803 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7aa417-3768-4738-8686-eda1790b9572 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:45.593796 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144b796-90f2-4a9d-8408-b62efca8c232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:45.594478 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144b796-90f2-4a9d-8408-b62efca8c232 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:45.594757 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144b796-90f2-4a9d-8408-b62efca8c232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:45.595033 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144b796-90f2-4a9d-8408-b62efca8c232 admin admin] PATH_INFO: `/v3/projects/4e7e2bf534024719b77c31f4bbcb2e1f/users/54046dd22e254db8a76c205e18eac739/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:45.628460 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5144b796-90f2-4a9d-8408-b62efca8c232 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e7e2bf534024719b77c31f4bbcb2e1f, user_id=54046dd22e254db8a76c205e18eac739, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:45.632119 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5144b796-90f2-4a9d-8408-b62efca8c232 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:45.731726 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1092/2178] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:15:45 2022] PUT /identity/v3/projects/4e7e2bf534024719b77c31f4bbcb2e1f/users/54046dd22e254db8a76c205e18eac739/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:15:45.741713 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94f17c-40e9-446f-9567-7f282e994693 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:45.742256 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94f17c-40e9-446f-9567-7f282e994693 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:45.742705 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94f17c-40e9-446f-9567-7f282e994693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:45.784533 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-2d94f17c-40e9-446f-9567-7f282e994693 None None] MFA Rules not processed for user `54046dd22e254db8a76c205e18eac739`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:15:45.788298 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2d94f17c-40e9-446f-9567-7f282e994693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:45.864566 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1087/2179] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:15:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:15:45.865335 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144b796-90f2-4a9d-8408-b62efca8c232 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:45.942342 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:15:45.969555 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144b796-90f2-4a9d-8408-b62efca8c232 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:45.974778 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b70e93-d9ce-462d-b96e-eb39e6df0a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:45.975597 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b70e93-d9ce-462d-b96e-eb39e6df0a32 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:45.975903 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b70e93-d9ce-462d-b96e-eb39e6df0a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:45.976199 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b70e93-d9ce-462d-b96e-eb39e6df0a32 admin admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:45.976851 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b70e93-d9ce-462d-b96e-eb39e6df0a32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:45.979567 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b70e93-d9ce-462d-b96e-eb39e6df0a32 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:46.087038 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94f17c-40e9-446f-9567-7f282e994693 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:46.092780 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1093/2180] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:15:45 2022] POST /identity/v3/projects => generated 387 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:15:46.100176 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94f17c-40e9-446f-9567-7f282e994693 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:46.170125 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13eaff-22fe-4105-b363-9a15127e2eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:46.170869 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13eaff-22fe-4105-b363-9a15127e2eca admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:46.171216 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13eaff-22fe-4105-b363-9a15127e2eca admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:46.171563 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13eaff-22fe-4105-b363-9a15127e2eca admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:46.172309 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a13eaff-22fe-4105-b363-9a15127e2eca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:46.174426 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a13eaff-22fe-4105-b363-9a15127e2eca admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:46.267075 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1088/2181] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:15:46 2022] POST /identity/v3/users => generated 294 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:15:46.268336 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b70e93-d9ce-462d-b96e-eb39e6df0a32 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:46.282657 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b70e93-d9ce-462d-b96e-eb39e6df0a32 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:46.287633 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e0074-cb45-4723-8b00-1850079a95a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:46.288414 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e0074-cb45-4723-8b00-1850079a95a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:46.288693 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e0074-cb45-4723-8b00-1850079a95a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:46.288970 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e0074-cb45-4723-8b00-1850079a95a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:46.289615 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e0074-cb45-4723-8b00-1850079a95a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:46.291227 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e0074-cb45-4723-8b00-1850079a95a0 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:46.305536 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1094/2182] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:15:46.310198 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13eaff-22fe-4105-b363-9a15127e2eca admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:46.321940 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13eaff-22fe-4105-b363-9a15127e2eca admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:46.327292 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3739a2e-fd3e-4643-9fba-686f7b8d4080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:46.327910 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3739a2e-fd3e-4643-9fba-686f7b8d4080 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:46.328242 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3739a2e-fd3e-4643-9fba-686f7b8d4080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:46.328510 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3739a2e-fd3e-4643-9fba-686f7b8d4080 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:46.329171 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3739a2e-fd3e-4643-9fba-686f7b8d4080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:46.330790 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3739a2e-fd3e-4643-9fba-686f7b8d4080 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:46.345901 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1089/2183] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:15:46.349916 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e0074-cb45-4723-8b00-1850079a95a0 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:46.363119 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e0074-cb45-4723-8b00-1850079a95a0 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:46.368027 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d1019-99d7-4a0c-a9ab-3d2dde488691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:46.368763 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d1019-99d7-4a0c-a9ab-3d2dde488691 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:46.369210 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d1019-99d7-4a0c-a9ab-3d2dde488691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:46.369490 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d1019-99d7-4a0c-a9ab-3d2dde488691 admin admin] PATH_INFO: `/v3/projects/c1eee60cfd6b4a2eb8e113e16a18e162/users/17d7f546657a40b18e4dae6a1459e843/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:46.388904 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d1019-99d7-4a0c-a9ab-3d2dde488691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1eee60cfd6b4a2eb8e113e16a18e162, user_id=17d7f546657a40b18e4dae6a1459e843, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:46.391594 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d1019-99d7-4a0c-a9ab-3d2dde488691 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:46.480852 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1095/2184] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:15:46 2022] PUT /identity/v3/projects/c1eee60cfd6b4a2eb8e113e16a18e162/users/17d7f546657a40b18e4dae6a1459e843/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:15:46.492837 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43b99e-c045-4178-bcd6-50d166687a27 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:46.496297 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43b99e-c045-4178-bcd6-50d166687a27 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:46.496297 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43b99e-c045-4178-bcd6-50d166687a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:46.526574 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-fe43b99e-c045-4178-bcd6-50d166687a27 None None] MFA Rules not processed for user `17d7f546657a40b18e4dae6a1459e843`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:15:46.527743 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-fe43b99e-c045-4178-bcd6-50d166687a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:46.565290 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:15:46.617455 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1090/2185] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:15:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:15:46.622459 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d1019-99d7-4a0c-a9ab-3d2dde488691 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:46.687942 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d1019-99d7-4a0c-a9ab-3d2dde488691 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:46.696952 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdcab6c-2c47-4888-b79c-243eb8718cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:46.697593 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdcab6c-2c47-4888-b79c-243eb8718cb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:46.697878 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdcab6c-2c47-4888-b79c-243eb8718cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:46.698150 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdcab6c-2c47-4888-b79c-243eb8718cb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:46.698803 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdcab6c-2c47-4888-b79c-243eb8718cb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:46.701442 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdcab6c-2c47-4888-b79c-243eb8718cb7 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:47.223980 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1096/2186] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:15:46 2022] POST /identity/v3/projects => generated 387 bytes in 602 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:15:47.227989 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe43b99e-c045-4178-bcd6-50d166687a27 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:47.240015 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe43b99e-c045-4178-bcd6-50d166687a27 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:47.296951 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28a87d-81ea-4cf7-bde7-0f9ef5372b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:47.297568 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28a87d-81ea-4cf7-bde7-0f9ef5372b8c admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:47.298908 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28a87d-81ea-4cf7-bde7-0f9ef5372b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:47.298908 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28a87d-81ea-4cf7-bde7-0f9ef5372b8c admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:47.298908 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c28a87d-81ea-4cf7-bde7-0f9ef5372b8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:47.300766 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c28a87d-81ea-4cf7-bde7-0f9ef5372b8c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:47.429044 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1091/2187] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:15:47 2022] POST /identity/v3/users => generated 300 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:15:47.432657 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdcab6c-2c47-4888-b79c-243eb8718cb7 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:47.446440 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdcab6c-2c47-4888-b79c-243eb8718cb7 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:47.452238 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b07ee-fb11-4bbc-b844-4ce1f8ac293e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:47.452845 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b07ee-fb11-4bbc-b844-4ce1f8ac293e admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:47.453587 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b07ee-fb11-4bbc-b844-4ce1f8ac293e admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:47.453921 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b07ee-fb11-4bbc-b844-4ce1f8ac293e admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:47.454531 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2b07ee-fb11-4bbc-b844-4ce1f8ac293e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:47.456138 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2b07ee-fb11-4bbc-b844-4ce1f8ac293e admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:47.470843 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1097/2188] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:15:47.475074 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28a87d-81ea-4cf7-bde7-0f9ef5372b8c admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:47.489185 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28a87d-81ea-4cf7-bde7-0f9ef5372b8c admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:47.493904 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1ce37-67b5-4181-a953-8739dd520c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:47.494580 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1ce37-67b5-4181-a953-8739dd520c07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:47.494858 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1ce37-67b5-4181-a953-8739dd520c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:47.495137 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1ce37-67b5-4181-a953-8739dd520c07 admin admin] PATH_INFO: `/v3/projects/8904cc8efae94abc8c2821e7fcbbc9ef/users/e685b05f25af4ed79fd9f4d861cb129c/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:47.511847 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1ce37-67b5-4181-a953-8739dd520c07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8904cc8efae94abc8c2821e7fcbbc9ef, user_id=e685b05f25af4ed79fd9f4d861cb129c, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:47.515248 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1ce37-67b5-4181-a953-8739dd520c07 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:47.591856 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1092/2189] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:15:47 2022] PUT /identity/v3/projects/8904cc8efae94abc8c2821e7fcbbc9ef/users/e685b05f25af4ed79fd9f4d861cb129c/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:15:47.595763 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b07ee-fb11-4bbc-b844-4ce1f8ac293e admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:47.606586 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b07ee-fb11-4bbc-b844-4ce1f8ac293e admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:47.675822 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f25365-4190-4850-be4d-3b799ab25437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:47.676483 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f25365-4190-4850-be4d-3b799ab25437 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:47.676769 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f25365-4190-4850-be4d-3b799ab25437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:47.677047 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f25365-4190-4850-be4d-3b799ab25437 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:47.677780 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f25365-4190-4850-be4d-3b799ab25437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:47.679418 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f25365-4190-4850-be4d-3b799ab25437 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:47.681657 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:15:47.691378 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1098/2190] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:15:47.695534 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1ce37-67b5-4181-a953-8739dd520c07 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:47.712823 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1ce37-67b5-4181-a953-8739dd520c07 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:47.718422 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdff6e0-b0e2-412d-ba80-3cf0b1569c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:47.719240 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdff6e0-b0e2-412d-ba80-3cf0b1569c98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:47.719553 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdff6e0-b0e2-412d-ba80-3cf0b1569c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:47.719808 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdff6e0-b0e2-412d-ba80-3cf0b1569c98 admin admin] PATH_INFO: `/v3/projects/8904cc8efae94abc8c2821e7fcbbc9ef/users/e685b05f25af4ed79fd9f4d861cb129c/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:47.721787 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdff6e0-b0e2-412d-ba80-3cf0b1569c98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8904cc8efae94abc8c2821e7fcbbc9ef, user_id=e685b05f25af4ed79fd9f4d861cb129c, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:47.727002 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdff6e0-b0e2-412d-ba80-3cf0b1569c98 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:47.739905 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1093/2191] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:15:47 2022] PUT /identity/v3/projects/8904cc8efae94abc8c2821e7fcbbc9ef/users/e685b05f25af4ed79fd9f4d861cb129c/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:15:47.749738 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae93c1b-3384-4cea-9801-b0b8c1a0601d None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:47.750026 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae93c1b-3384-4cea-9801-b0b8c1a0601d None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:47.750305 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae93c1b-3384-4cea-9801-b0b8c1a0601d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:47.785288 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-6ae93c1b-3384-4cea-9801-b0b8c1a0601d None None] MFA Rules not processed for user `e685b05f25af4ed79fd9f4d861cb129c`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:15:47.786766 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-6ae93c1b-3384-4cea-9801-b0b8c1a0601d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:47.878213 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1099/2192] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:15:47 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:15:47.890320 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdff6e0-b0e2-412d-ba80-3cf0b1569c98 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:47.892200 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8fdff6e0-b0e2-412d-ba80-3cf0b1569c98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:47.975751 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdff6e0-b0e2-412d-ba80-3cf0b1569c98 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:47.980490 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29b6b9-7f24-463c-a0a8-1f505867683f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:47.981489 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29b6b9-7f24-463c-a0a8-1f505867683f service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:47.981849 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29b6b9-7f24-463c-a0a8-1f505867683f service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:47.982196 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29b6b9-7f24-463c-a0a8-1f505867683f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:47.992601 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a29b6b9-7f24-463c-a0a8-1f505867683f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:47.994236 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a29b6b9-7f24-463c-a0a8-1f505867683f service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:48.008656 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1094/2193] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:15:47 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:15:49.549128 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae93c1b-3384-4cea-9801-b0b8c1a0601d None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:49.551252 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-6ae93c1b-3384-4cea-9801-b0b8c1a0601d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:49.566240 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae93c1b-3384-4cea-9801-b0b8c1a0601d None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:49.571365 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd23b9-de6e-4007-a447-e6e74a8a23c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:49.572815 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd23b9-de6e-4007-a447-e6e74a8a23c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:49.573314 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd23b9-de6e-4007-a447-e6e74a8a23c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:49.573794 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd23b9-de6e-4007-a447-e6e74a8a23c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:49.660212 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd23b9-de6e-4007-a447-e6e74a8a23c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:49.662066 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd23b9-de6e-4007-a447-e6e74a8a23c8 service cinder] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:49.672865 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1100/2194] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:15:49 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:15:51.190225 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29b6b9-7f24-463c-a0a8-1f505867683f service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:51.190969 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3a29b6b9-7f24-463c-a0a8-1f505867683f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:51.228375 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:15:51.286335 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29b6b9-7f24-463c-a0a8-1f505867683f service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:51.290598 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8740f6-b4d2-426b-869a-30fba204338d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d0e8cc074b4e36acc2162aebeac169', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:51.291918 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8740f6-b4d2-426b-869a-30fba204338d service glance] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:51.292243 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8740f6-b4d2-426b-869a-30fba204338d service glance] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:51.292522 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8740f6-b4d2-426b-869a-30fba204338d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:51.295875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-db8740f6-b4d2-426b-869a-30fba204338d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:51.376267 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8740f6-b4d2-426b-869a-30fba204338d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:51.377796 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8740f6-b4d2-426b-869a-30fba204338d service glance] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:51.388051 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1095/2195] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:15:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:15:52.042648 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8c295-4eaa-4539-b10d-3f439cff0472 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:52.043134 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8c295-4eaa-4539-b10d-3f439cff0472 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:52.043236 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8c295-4eaa-4539-b10d-3f439cff0472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:52.064792 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-b9f8c295-4eaa-4539-b10d-3f439cff0472 None None] MFA Rules not processed for user `3c90765757a34c6291c9980a7d5d5c79`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:15:52.066087 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-b9f8c295-4eaa-4539-b10d-3f439cff0472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:52.152246 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1101/2196] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Oct 26 11:15:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:15:52.169446 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8740f6-b4d2-426b-869a-30fba204338d service glance] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:52.171129 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-db8740f6-b4d2-426b-869a-30fba204338d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:52.258322 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8740f6-b4d2-426b-869a-30fba204338d service glance] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:52.263976 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58ce31-24b6-462b-b8ca-ecbbddb0aaad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21b84cc38a848de8d19a41e1eb04a58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:52.264776 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58ce31-24b6-462b-b8ca-ecbbddb0aaad service swift] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:52.264935 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58ce31-24b6-462b-b8ca-ecbbddb0aaad service swift] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:52.265167 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58ce31-24b6-462b-b8ca-ecbbddb0aaad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:52.274602 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58ce31-24b6-462b-b8ca-ecbbddb0aaad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:52.276257 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58ce31-24b6-462b-b8ca-ecbbddb0aaad service swift] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:52.285389 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1096/2197] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Oct 26 11:15:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 26 11:15:52.358586 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8285f-d850-40ca-a44d-8e82c7550bde None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:52.358969 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8285f-d850-40ca-a44d-8e82c7550bde None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:52.359247 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8285f-d850-40ca-a44d-8e82c7550bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:52.378914 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-c1d8285f-d850-40ca-a44d-8e82c7550bde None None] MFA Rules not processed for user `f6448e0a06444705abd41215526e939c`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:15:52.380487 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-c1d8285f-d850-40ca-a44d-8e82c7550bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:52.414403 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:15:52.453132 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1102/2198] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:15:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:15:52.793219 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58ce31-24b6-462b-b8ca-ecbbddb0aaad service swift] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:52.794683 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8f58ce31-24b6-462b-b8ca-ecbbddb0aaad service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:52.883272 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58ce31-24b6-462b-b8ca-ecbbddb0aaad service swift] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:52.887502 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e19ef-df89-459c-86b3-0cb05b1721fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:52.888830 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e19ef-df89-459c-86b3-0cb05b1721fa service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:52.889106 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e19ef-df89-459c-86b3-0cb05b1721fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:52.889422 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e19ef-df89-459c-86b3-0cb05b1721fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:52.891404 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-242e19ef-df89-459c-86b3-0cb05b1721fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:52.907885 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e19ef-df89-459c-86b3-0cb05b1721fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:52.909521 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e19ef-df89-459c-86b3-0cb05b1721fa service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:52.919723 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1097/2199] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:15:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:15:53.465567 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8285f-d850-40ca-a44d-8e82c7550bde None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:53.468571 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-c1d8285f-d850-40ca-a44d-8e82c7550bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:53.558942 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8285f-d850-40ca-a44d-8e82c7550bde None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:53.576332 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505999c-db22-4c76-951c-831ef5e7a108 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4f9a2bba0e748b6a98fa7dea2482ddf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:53.577072 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505999c-db22-4c76-951c-831ef5e7a108 service placement] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:53.577418 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505999c-db22-4c76-951c-831ef5e7a108 service placement] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:53.577758 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505999c-db22-4c76-951c-831ef5e7a108 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:53.579736 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-0505999c-db22-4c76-951c-831ef5e7a108 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:53.597757 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0505999c-db22-4c76-951c-831ef5e7a108 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:53.599463 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0505999c-db22-4c76-951c-831ef5e7a108 service placement] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:53.617229 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1103/2200] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:15:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:15:55.492843 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26105f6b-b011-443e-9eb7-85dce67f6773 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:55.498932 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26105f6b-b011-443e-9eb7-85dce67f6773 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:55.498932 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26105f6b-b011-443e-9eb7-85dce67f6773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:55.521254 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-26105f6b-b011-443e-9eb7-85dce67f6773 None None] MFA Rules not processed for user `fb3a54a17338499eb16ad4c831c0454b`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:15:55.522560 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-26105f6b-b011-443e-9eb7-85dce67f6773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:55.544883 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:15:55.609324 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1098/2201] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:15:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:15:57.434151 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505999c-db22-4c76-951c-831ef5e7a108 service placement] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:57.447703 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505999c-db22-4c76-951c-831ef5e7a108 service placement] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:57.459006 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1b4c3-80ad-4188-a1b1-dd2c85af9cce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:57.459925 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1b4c3-80ad-4188-a1b1-dd2c85af9cce service cinder] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:57.467242 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1b4c3-80ad-4188-a1b1-dd2c85af9cce service cinder] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:57.467543 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1b4c3-80ad-4188-a1b1-dd2c85af9cce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:57.568183 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f1b4c3-80ad-4188-a1b1-dd2c85af9cce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:57.570815 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f1b4c3-80ad-4188-a1b1-dd2c85af9cce service cinder] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:57.599223 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1104/2202] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:15:57 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:15:58.067448 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33744d3-168d-4b87-8c8b-0a7be03884ae None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:58.067969 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33744d3-168d-4b87-8c8b-0a7be03884ae None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:58.068123 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33744d3-168d-4b87-8c8b-0a7be03884ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:58.100592 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-d33744d3-168d-4b87-8c8b-0a7be03884ae None None] MFA Rules not processed for user `3c90765757a34c6291c9980a7d5d5c79`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:15:58.102258 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d33744d3-168d-4b87-8c8b-0a7be03884ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:58.126894 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1099/2203] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Oct 26 11:15:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:15:58.157713 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1b4c3-80ad-4188-a1b1-dd2c85af9cce service cinder] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:58.179225 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1b4c3-80ad-4188-a1b1-dd2c85af9cce service cinder] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:58.185186 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f0872-0b5f-45a8-92c7-f7c49a886d58 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21b84cc38a848de8d19a41e1eb04a58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:58.185944 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f0872-0b5f-45a8-92c7-f7c49a886d58 service swift] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:58.186684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f0872-0b5f-45a8-92c7-f7c49a886d58 service swift] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:58.186684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f0872-0b5f-45a8-92c7-f7c49a886d58 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:58.201584 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10f0872-0b5f-45a8-92c7-f7c49a886d58 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:58.203704 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10f0872-0b5f-45a8-92c7-f7c49a886d58 service swift] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:58.220092 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1105/2204] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Oct 26 11:15:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 26 11:15:58.640971 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33744d3-168d-4b87-8c8b-0a7be03884ae None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:58.675964 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33744d3-168d-4b87-8c8b-0a7be03884ae None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:58.698419 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e0735-bfb5-4b9d-a16d-f2e279580528 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:58.699656 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e0735-bfb5-4b9d-a16d-f2e279580528 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:58.702425 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e0735-bfb5-4b9d-a16d-f2e279580528 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:58.704564 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e0735-bfb5-4b9d-a16d-f2e279580528 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:58.719088 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-634e0735-bfb5-4b9d-a16d-f2e279580528 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:58.778733 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e0735-bfb5-4b9d-a16d-f2e279580528 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:58.784877 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e0735-bfb5-4b9d-a16d-f2e279580528 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:58.811261 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1100/2205] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:15:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:16:04.073377 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f0872-0b5f-45a8-92c7-f7c49a886d58 service swift] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:04.190279 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:04.219430 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f0872-0b5f-45a8-92c7-f7c49a886d58 service swift] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:04.228500 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61921bb2-9550-407e-99c9-6f6624245bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:04.250332 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61921bb2-9550-407e-99c9-6f6624245bb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:04.250332 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61921bb2-9550-407e-99c9-6f6624245bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:04.250332 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61921bb2-9550-407e-99c9-6f6624245bb6 admin admin] PATH_INFO: `/v3/users/54046dd22e254db8a76c205e18eac739` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:04.250332 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61921bb2-9550-407e-99c9-6f6624245bb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54046dd22e254db8a76c205e18eac739)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:04.250332 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61921bb2-9550-407e-99c9-6f6624245bb6 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:04.847371 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-61921bb2-9550-407e-99c9-6f6624245bb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54046dd22e254db8a76c205e18eac739'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:04.921275 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-61921bb2-9550-407e-99c9-6f6624245bb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54046dd22e254db8a76c205e18eac739'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:04.949492 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-61921bb2-9550-407e-99c9-6f6624245bb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54046dd22e254db8a76c205e18eac739'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:04.950371 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-61921bb2-9550-407e-99c9-6f6624245bb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54046dd22e254db8a76c205e18eac739'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:04.987132 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-61921bb2-9550-407e-99c9-6f6624245bb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54046dd22e254db8a76c205e18eac739'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:05.004744 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1106/2206] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:16:04 2022] DELETE /identity/v3/users/54046dd22e254db8a76c205e18eac739 => generated 0 bytes in 929 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:05.011546 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26c115-068b-4d24-9877-365c6be24674 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:05.011546 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26c115-068b-4d24-9877-365c6be24674 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:05.011546 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26c115-068b-4d24-9877-365c6be24674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:05.034245 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-bf26c115-068b-4d24-9877-365c6be24674 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:16:05.036772 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-bf26c115-068b-4d24-9877-365c6be24674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:05.207354 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1101/2207] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:16:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:16:05.230508 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61921bb2-9550-407e-99c9-6f6624245bb6 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:05.232027 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-61921bb2-9550-407e-99c9-6f6624245bb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:05.391064 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61921bb2-9550-407e-99c9-6f6624245bb6 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:05.403131 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cdeba1-e48c-4e84-9b67-038356fcce50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:05.404581 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cdeba1-e48c-4e84-9b67-038356fcce50 service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:05.405042 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cdeba1-e48c-4e84-9b67-038356fcce50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:05.405464 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cdeba1-e48c-4e84-9b67-038356fcce50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:05.435508 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cdeba1-e48c-4e84-9b67-038356fcce50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:05.437239 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cdeba1-e48c-4e84-9b67-038356fcce50 service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:05.460285 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1107/2208] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:16:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:16:06.675472 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26c115-068b-4d24-9877-365c6be24674 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:06.678005 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-bf26c115-068b-4d24-9877-365c6be24674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:06.691953 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26c115-068b-4d24-9877-365c6be24674 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:06.697830 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881e37b-504c-4b94-80fe-66d0bdb2f3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:06.698811 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881e37b-504c-4b94-80fe-66d0bdb2f3d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:06.699514 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881e37b-504c-4b94-80fe-66d0bdb2f3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:06.700006 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881e37b-504c-4b94-80fe-66d0bdb2f3d8 admin admin] PATH_INFO: `/v3/projects/4e7e2bf534024719b77c31f4bbcb2e1f` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:06.703950 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881e37b-504c-4b94-80fe-66d0bdb2f3d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e7e2bf534024719b77c31f4bbcb2e1f)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:06.706416 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881e37b-504c-4b94-80fe-66d0bdb2f3d8 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:06.964204 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3881e37b-504c-4b94-80fe-66d0bdb2f3d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e7e2bf534024719b77c31f4bbcb2e1f', 'request_id': 'req-3881e37b-504c-4b94-80fe-66d0bdb2f3d8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:06.976923 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3881e37b-504c-4b94-80fe-66d0bdb2f3d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e7e2bf534024719b77c31f4bbcb2e1f', 'request_id': 'req-3881e37b-504c-4b94-80fe-66d0bdb2f3d8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:07.110856 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3881e37b-504c-4b94-80fe-66d0bdb2f3d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e7e2bf534024719b77c31f4bbcb2e1f', 'request_id': 'req-3881e37b-504c-4b94-80fe-66d0bdb2f3d8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:07.151777 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3881e37b-504c-4b94-80fe-66d0bdb2f3d8 admin admin] The token cache is being invalidate because project 4e7e2bf534024719b77c31f4bbcb2e1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:16:07.151777 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3881e37b-504c-4b94-80fe-66d0bdb2f3d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:07.151777 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3881e37b-504c-4b94-80fe-66d0bdb2f3d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:07.156113 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1102/2209] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:16:06 2022] DELETE /identity/v3/projects/4e7e2bf534024719b77c31f4bbcb2e1f => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:07.159138 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cdeba1-e48c-4e84-9b67-038356fcce50 service neutron] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:07.171893 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cdeba1-e48c-4e84-9b67-038356fcce50 service neutron] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:07.335480 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed31579-2409-41d4-a41c-9120cb93c4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:07.337463 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed31579-2409-41d4-a41c-9120cb93c4a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:07.337941 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed31579-2409-41d4-a41c-9120cb93c4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:07.339497 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed31579-2409-41d4-a41c-9120cb93c4a3 admin admin] PATH_INFO: `/v3/users/17d7f546657a40b18e4dae6a1459e843` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:07.343969 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed31579-2409-41d4-a41c-9120cb93c4a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17d7f546657a40b18e4dae6a1459e843)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:07.347865 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed31579-2409-41d4-a41c-9120cb93c4a3 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:07.376645 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:07.777633 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-6ed31579-2409-41d4-a41c-9120cb93c4a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17d7f546657a40b18e4dae6a1459e843'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:07.936988 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-6ed31579-2409-41d4-a41c-9120cb93c4a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17d7f546657a40b18e4dae6a1459e843'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:07.957066 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-6ed31579-2409-41d4-a41c-9120cb93c4a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17d7f546657a40b18e4dae6a1459e843'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:07.957344 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-6ed31579-2409-41d4-a41c-9120cb93c4a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17d7f546657a40b18e4dae6a1459e843'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:07.977196 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-6ed31579-2409-41d4-a41c-9120cb93c4a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17d7f546657a40b18e4dae6a1459e843'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:07.985745 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1108/2210] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:16:07 2022] DELETE /identity/v3/users/17d7f546657a40b18e4dae6a1459e843 => generated 0 bytes in 827 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:09.374206 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881e37b-504c-4b94-80fe-66d0bdb2f3d8 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:09.375910 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3881e37b-504c-4b94-80fe-66d0bdb2f3d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:09.390206 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881e37b-504c-4b94-80fe-66d0bdb2f3d8 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:09.403268 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:09.447780 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fe746-6bd8-4bb1-95c2-9389ccb96d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:09.448461 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fe746-6bd8-4bb1-95c2-9389ccb96d14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:09.448749 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fe746-6bd8-4bb1-95c2-9389ccb96d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:09.449065 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fe746-6bd8-4bb1-95c2-9389ccb96d14 admin admin] PATH_INFO: `/v3/projects/c1eee60cfd6b4a2eb8e113e16a18e162` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:09.450336 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699fe746-6bd8-4bb1-95c2-9389ccb96d14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1eee60cfd6b4a2eb8e113e16a18e162)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:09.452859 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699fe746-6bd8-4bb1-95c2-9389ccb96d14 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:09.510006 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed31579-2409-41d4-a41c-9120cb93c4a3 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:09.511663 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-6ed31579-2409-41d4-a41c-9120cb93c4a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:09.589524 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed31579-2409-41d4-a41c-9120cb93c4a3 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:09.593764 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-699fe746-6bd8-4bb1-95c2-9389ccb96d14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1eee60cfd6b4a2eb8e113e16a18e162', 'request_id': 'req-699fe746-6bd8-4bb1-95c2-9389ccb96d14'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:09.610341 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-699fe746-6bd8-4bb1-95c2-9389ccb96d14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1eee60cfd6b4a2eb8e113e16a18e162', 'request_id': 'req-699fe746-6bd8-4bb1-95c2-9389ccb96d14'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:09.658793 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f33f20-b32a-4eb5-ad4f-90ed9eb5b4ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:09.659643 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f33f20-b32a-4eb5-ad4f-90ed9eb5b4ec service nova] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:09.660112 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f33f20-b32a-4eb5-ad4f-90ed9eb5b4ec service nova] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:09.660497 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f33f20-b32a-4eb5-ad4f-90ed9eb5b4ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:09.662374 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-c0f33f20-b32a-4eb5-ad4f-90ed9eb5b4ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:09.675100 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f33f20-b32a-4eb5-ad4f-90ed9eb5b4ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:09.676750 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f33f20-b32a-4eb5-ad4f-90ed9eb5b4ec service nova] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:09.687690 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1109/2211] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:16:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:16:09.730943 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-699fe746-6bd8-4bb1-95c2-9389ccb96d14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1eee60cfd6b4a2eb8e113e16a18e162', 'request_id': 'req-699fe746-6bd8-4bb1-95c2-9389ccb96d14'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:09.742382 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-699fe746-6bd8-4bb1-95c2-9389ccb96d14 admin admin] The token cache is being invalidate because project c1eee60cfd6b4a2eb8e113e16a18e162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:16:09.751385 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-699fe746-6bd8-4bb1-95c2-9389ccb96d14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:09.751385 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-699fe746-6bd8-4bb1-95c2-9389ccb96d14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:09.751385 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1103/2212] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:16:09 2022] DELETE /identity/v3/projects/c1eee60cfd6b4a2eb8e113e16a18e162 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:09.751770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f33f20-b32a-4eb5-ad4f-90ed9eb5b4ec service nova] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:09.751871 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-c0f33f20-b32a-4eb5-ad4f-90ed9eb5b4ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:09.822736 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f33f20-b32a-4eb5-ad4f-90ed9eb5b4ec service nova] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:09.828550 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08caf969-450b-4860-9655-2e17ce8819af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:09.832322 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08caf969-450b-4860-9655-2e17ce8819af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:09.832322 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08caf969-450b-4860-9655-2e17ce8819af admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:09.832322 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08caf969-450b-4860-9655-2e17ce8819af admin admin] PATH_INFO: `/v3/users/e685b05f25af4ed79fd9f4d861cb129c` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:09.832322 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08caf969-450b-4860-9655-2e17ce8819af admin admin] RBAC: Authorizing `identity:delete_user(user_id=e685b05f25af4ed79fd9f4d861cb129c)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:09.832837 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08caf969-450b-4860-9655-2e17ce8819af admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:10.064916 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-08caf969-450b-4860-9655-2e17ce8819af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e685b05f25af4ed79fd9f4d861cb129c'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:10.154009 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-08caf969-450b-4860-9655-2e17ce8819af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e685b05f25af4ed79fd9f4d861cb129c'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:10.166914 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-08caf969-450b-4860-9655-2e17ce8819af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e685b05f25af4ed79fd9f4d861cb129c'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:10.167608 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-08caf969-450b-4860-9655-2e17ce8819af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e685b05f25af4ed79fd9f4d861cb129c'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:10.174808 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-08caf969-450b-4860-9655-2e17ce8819af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e685b05f25af4ed79fd9f4d861cb129c'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:10.180599 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1110/2213] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:16:09 2022] DELETE /identity/v3/users/e685b05f25af4ed79fd9f4d861cb129c => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:10.480768 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:10.663590 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fe746-6bd8-4bb1-95c2-9389ccb96d14 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:10.665046 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-699fe746-6bd8-4bb1-95c2-9389ccb96d14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:10.682609 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fe746-6bd8-4bb1-95c2-9389ccb96d14 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:10.759411 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c38d7-1095-464f-b5d0-d7577b1e4961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:10.760469 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c38d7-1095-464f-b5d0-d7577b1e4961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:10.760755 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c38d7-1095-464f-b5d0-d7577b1e4961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:10.761032 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c38d7-1095-464f-b5d0-d7577b1e4961 admin admin] PATH_INFO: `/v3/projects/8904cc8efae94abc8c2821e7fcbbc9ef` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:10.762214 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c38d7-1095-464f-b5d0-d7577b1e4961 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8904cc8efae94abc8c2821e7fcbbc9ef)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:10.764912 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c38d7-1095-464f-b5d0-d7577b1e4961 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:10.908222 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f74c38d7-1095-464f-b5d0-d7577b1e4961 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8904cc8efae94abc8c2821e7fcbbc9ef', 'request_id': 'req-f74c38d7-1095-464f-b5d0-d7577b1e4961'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:10.915496 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f74c38d7-1095-464f-b5d0-d7577b1e4961 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8904cc8efae94abc8c2821e7fcbbc9ef', 'request_id': 'req-f74c38d7-1095-464f-b5d0-d7577b1e4961'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:11.005516 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f74c38d7-1095-464f-b5d0-d7577b1e4961 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8904cc8efae94abc8c2821e7fcbbc9ef', 'request_id': 'req-f74c38d7-1095-464f-b5d0-d7577b1e4961'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:11.018648 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f74c38d7-1095-464f-b5d0-d7577b1e4961 admin admin] The token cache is being invalidate because project 8904cc8efae94abc8c2821e7fcbbc9ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:16:11.018944 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f74c38d7-1095-464f-b5d0-d7577b1e4961 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:11.019694 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f74c38d7-1095-464f-b5d0-d7577b1e4961 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:11.021241 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1104/2214] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:16:10 2022] DELETE /identity/v3/projects/8904cc8efae94abc8c2821e7fcbbc9ef => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:11.027000 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56420c2-e5d9-48db-9212-d6a039dbc8a5 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:11.027507 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56420c2-e5d9-48db-9212-d6a039dbc8a5 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:11.027709 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56420c2-e5d9-48db-9212-d6a039dbc8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:11.056396 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-a56420c2-e5d9-48db-9212-d6a039dbc8a5 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:16:11.058181 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-a56420c2-e5d9-48db-9212-d6a039dbc8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:11.148091 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1111/2215] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:16:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:16:11.153125 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79eaa2-6a75-4156-acf5-30e5f45a9a45 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:11.153418 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79eaa2-6a75-4156-acf5-30e5f45a9a45 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:11.153696 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79eaa2-6a75-4156-acf5-30e5f45a9a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:11.176099 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-de79eaa2-6a75-4156-acf5-30e5f45a9a45 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:16:11.177328 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-de79eaa2-6a75-4156-acf5-30e5f45a9a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:11.187458 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1105/2216] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:16:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:16:11.191985 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56420c2-e5d9-48db-9212-d6a039dbc8a5 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:11.202467 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56420c2-e5d9-48db-9212-d6a039dbc8a5 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:11.207448 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68826abc-7d26-49d6-9aeb-155ca55a1e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:11.208168 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68826abc-7d26-49d6-9aeb-155ca55a1e09 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:11.208511 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68826abc-7d26-49d6-9aeb-155ca55a1e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:11.208850 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68826abc-7d26-49d6-9aeb-155ca55a1e09 admin admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:11.209587 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68826abc-7d26-49d6-9aeb-155ca55a1e09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:16:11.209956 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68826abc-7d26-49d6-9aeb-155ca55a1e09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:11.211532 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68826abc-7d26-49d6-9aeb-155ca55a1e09 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:11.223245 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1112/2217] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:16:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:16:11.227590 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79eaa2-6a75-4156-acf5-30e5f45a9a45 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:11.237255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79eaa2-6a75-4156-acf5-30e5f45a9a45 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:11.241944 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98af129-895b-4b2b-b6aa-464927f1b7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:11.242543 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98af129-895b-4b2b-b6aa-464927f1b7f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:11.242856 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98af129-895b-4b2b-b6aa-464927f1b7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:11.243130 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98af129-895b-4b2b-b6aa-464927f1b7f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:11.243772 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98af129-895b-4b2b-b6aa-464927f1b7f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:11.245821 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98af129-895b-4b2b-b6aa-464927f1b7f7 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:11.349425 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1106/2218] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:16:11 2022] POST /identity/v3/projects => generated 393 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:16:11.353630 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68826abc-7d26-49d6-9aeb-155ca55a1e09 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:11.353834 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:11.363809 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68826abc-7d26-49d6-9aeb-155ca55a1e09 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:11.418126 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb8d675-82c1-4dc4-8d5d-fa6841a5cdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:11.418730 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8d675-82c1-4dc4-8d5d-fa6841a5cdf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:11.419010 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8d675-82c1-4dc4-8d5d-fa6841a5cdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:11.419314 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8d675-82c1-4dc4-8d5d-fa6841a5cdf5 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:11.419939 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb8d675-82c1-4dc4-8d5d-fa6841a5cdf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:11.421930 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb8d675-82c1-4dc4-8d5d-fa6841a5cdf5 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:11.569492 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1113/2219] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:16:11 2022] POST /identity/v3/users => generated 297 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:16:11.570626 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98af129-895b-4b2b-b6aa-464927f1b7f7 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:11.581228 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98af129-895b-4b2b-b6aa-464927f1b7f7 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:11.586318 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a1481-87a3-4106-848f-499b0d80f0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:11.586926 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a1481-87a3-4106-848f-499b0d80f0d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:11.587211 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a1481-87a3-4106-848f-499b0d80f0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:11.587487 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a1481-87a3-4106-848f-499b0d80f0d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:11.588191 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a1481-87a3-4106-848f-499b0d80f0d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:11.589836 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a1481-87a3-4106-848f-499b0d80f0d8 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:11.600091 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1107/2220] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:16:11.604317 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb8d675-82c1-4dc4-8d5d-fa6841a5cdf5 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:11.616350 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb8d675-82c1-4dc4-8d5d-fa6841a5cdf5 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:11.623574 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79014b9a-d8a5-4206-851a-3e7961255415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:11.623574 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79014b9a-d8a5-4206-851a-3e7961255415 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:11.623574 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79014b9a-d8a5-4206-851a-3e7961255415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:11.623574 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79014b9a-d8a5-4206-851a-3e7961255415 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:11.624603 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79014b9a-d8a5-4206-851a-3e7961255415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:11.625401 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79014b9a-d8a5-4206-851a-3e7961255415 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:11.637061 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1114/2221] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:16:11.641368 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a1481-87a3-4106-848f-499b0d80f0d8 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:11.653456 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a1481-87a3-4106-848f-499b0d80f0d8 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:11.658594 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41f71b-9aea-476d-8b51-b5eb1d409357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:11.659309 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41f71b-9aea-476d-8b51-b5eb1d409357 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:11.659595 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41f71b-9aea-476d-8b51-b5eb1d409357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:11.659876 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41f71b-9aea-476d-8b51-b5eb1d409357 admin admin] PATH_INFO: `/v3/projects/b8b6725e38bc4131a6d8078621446823/users/7689ce8041504a0daea44568a8268489/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:11.677664 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41f71b-9aea-476d-8b51-b5eb1d409357 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8b6725e38bc4131a6d8078621446823, user_id=7689ce8041504a0daea44568a8268489, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:11.680429 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41f71b-9aea-476d-8b51-b5eb1d409357 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:11.771539 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1108/2222] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:16:11 2022] PUT /identity/v3/projects/b8b6725e38bc4131a6d8078621446823/users/7689ce8041504a0daea44568a8268489/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:11.784155 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868fe1d-8ca9-48d7-8b09-f11c0f008d66 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:11.784444 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868fe1d-8ca9-48d7-8b09-f11c0f008d66 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:11.784715 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868fe1d-8ca9-48d7-8b09-f11c0f008d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:11.812902 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-6868fe1d-8ca9-48d7-8b09-f11c0f008d66 None None] MFA Rules not processed for user `7689ce8041504a0daea44568a8268489`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:16:11.814123 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-6868fe1d-8ca9-48d7-8b09-f11c0f008d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:11.877453 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1115/2223] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:16:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:16:11.881965 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41f71b-9aea-476d-8b51-b5eb1d409357 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:11.943557 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41f71b-9aea-476d-8b51-b5eb1d409357 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:11.948313 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384df05-b222-413e-b3b4-baa0ec98efda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:11.948713 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:11.948931 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384df05-b222-413e-b3b4-baa0ec98efda admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:11.949336 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384df05-b222-413e-b3b4-baa0ec98efda admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:11.949494 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384df05-b222-413e-b3b4-baa0ec98efda admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:11.950141 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1384df05-b222-413e-b3b4-baa0ec98efda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:11.952082 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1384df05-b222-413e-b3b4-baa0ec98efda admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:12.069857 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1109/2224] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:16:11 2022] POST /identity/v3/projects => generated 393 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:16:12.079805 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868fe1d-8ca9-48d7-8b09-f11c0f008d66 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:12.090323 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868fe1d-8ca9-48d7-8b09-f11c0f008d66 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:12.148969 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff75fb-eab2-4b4d-b2ee-2959d0bdd7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:12.149694 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff75fb-eab2-4b4d-b2ee-2959d0bdd7f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:12.150161 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff75fb-eab2-4b4d-b2ee-2959d0bdd7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:12.150292 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff75fb-eab2-4b4d-b2ee-2959d0bdd7f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:12.150900 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff75fb-eab2-4b4d-b2ee-2959d0bdd7f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:12.152870 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff75fb-eab2-4b4d-b2ee-2959d0bdd7f2 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:12.270548 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1116/2225] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:16:12 2022] POST /identity/v3/users => generated 303 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:16:12.274635 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384df05-b222-413e-b3b4-baa0ec98efda admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:12.286563 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384df05-b222-413e-b3b4-baa0ec98efda admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:12.291780 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ecb83-aa23-4107-8e85-70de8993273c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:12.296309 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ecb83-aa23-4107-8e85-70de8993273c admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:12.296309 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ecb83-aa23-4107-8e85-70de8993273c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:12.296309 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ecb83-aa23-4107-8e85-70de8993273c admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:12.296309 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ecb83-aa23-4107-8e85-70de8993273c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:12.296309 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ecb83-aa23-4107-8e85-70de8993273c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:12.309714 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1110/2226] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:16:12.315645 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff75fb-eab2-4b4d-b2ee-2959d0bdd7f2 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:12.335015 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff75fb-eab2-4b4d-b2ee-2959d0bdd7f2 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:12.356872 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f063b3-dc14-49ec-98f3-c132d201a11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:12.357936 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f063b3-dc14-49ec-98f3-c132d201a11a admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:12.358217 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f063b3-dc14-49ec-98f3-c132d201a11a admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:12.358914 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f063b3-dc14-49ec-98f3-c132d201a11a admin admin] PATH_INFO: `/v3/projects/23f69b1edfe947f9a0f6ed7188d9803c/users/3005e23c016e4a5cb98abfdd27f5adab/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:12.375734 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f063b3-dc14-49ec-98f3-c132d201a11a admin admin] RBAC: Authorizing `identity:create_grant(project_id=23f69b1edfe947f9a0f6ed7188d9803c, user_id=3005e23c016e4a5cb98abfdd27f5adab, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:12.378461 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f063b3-dc14-49ec-98f3-c132d201a11a admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:12.491756 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1117/2227] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:16:12 2022] PUT /identity/v3/projects/23f69b1edfe947f9a0f6ed7188d9803c/users/3005e23c016e4a5cb98abfdd27f5adab/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:12.495942 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ecb83-aa23-4107-8e85-70de8993273c admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:12.506210 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ecb83-aa23-4107-8e85-70de8993273c admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:12.566504 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce98343-989c-42cd-818e-2a40fa8f1142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:12.567128 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce98343-989c-42cd-818e-2a40fa8f1142 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:12.567410 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce98343-989c-42cd-818e-2a40fa8f1142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:12.567682 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce98343-989c-42cd-818e-2a40fa8f1142 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:12.568357 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce98343-989c-42cd-818e-2a40fa8f1142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:12.569961 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce98343-989c-42cd-818e-2a40fa8f1142 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:12.581001 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1111/2228] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:16:12.585262 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f063b3-dc14-49ec-98f3-c132d201a11a admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:12.597227 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f063b3-dc14-49ec-98f3-c132d201a11a admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:12.603301 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e2b17-5509-43ba-9a03-2a1b03243f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:12.604423 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e2b17-5509-43ba-9a03-2a1b03243f87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:12.604423 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e2b17-5509-43ba-9a03-2a1b03243f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:12.604590 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e2b17-5509-43ba-9a03-2a1b03243f87 admin admin] PATH_INFO: `/v3/projects/23f69b1edfe947f9a0f6ed7188d9803c/users/3005e23c016e4a5cb98abfdd27f5adab/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:12.606516 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e2b17-5509-43ba-9a03-2a1b03243f87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23f69b1edfe947f9a0f6ed7188d9803c, user_id=3005e23c016e4a5cb98abfdd27f5adab, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:12.609557 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e2b17-5509-43ba-9a03-2a1b03243f87 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:12.620650 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1118/2229] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:16:12 2022] PUT /identity/v3/projects/23f69b1edfe947f9a0f6ed7188d9803c/users/3005e23c016e4a5cb98abfdd27f5adab/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:12.631182 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2e472-550a-4ba0-a4db-88aefa46f0e8 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:12.631482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2e472-550a-4ba0-a4db-88aefa46f0e8 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:12.631787 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2e472-550a-4ba0-a4db-88aefa46f0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:12.661847 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-0ed2e472-550a-4ba0-a4db-88aefa46f0e8 None None] MFA Rules not processed for user `3005e23c016e4a5cb98abfdd27f5adab`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:16:12.663059 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0ed2e472-550a-4ba0-a4db-88aefa46f0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:12.735370 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1112/2230] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:16:12 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:16:12.742561 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e2b17-5509-43ba-9a03-2a1b03243f87 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:12.744516 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-de5e2b17-5509-43ba-9a03-2a1b03243f87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:12.808527 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e2b17-5509-43ba-9a03-2a1b03243f87 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:12.822468 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d4381-8d46-40d6-a571-432741a1c420 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:12.824747 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d4381-8d46-40d6-a571-432741a1c420 service cinder] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:12.825266 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d4381-8d46-40d6-a571-432741a1c420 service cinder] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:12.827124 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d4381-8d46-40d6-a571-432741a1c420 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:12.834907 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:12.842946 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d4381-8d46-40d6-a571-432741a1c420 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:12.844561 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d4381-8d46-40d6-a571-432741a1c420 service cinder] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:12.884619 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1119/2231] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:16:12 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:16:12.952854 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2e472-550a-4ba0-a4db-88aefa46f0e8 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:12.954493 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0ed2e472-550a-4ba0-a4db-88aefa46f0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:12.976042 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2e472-550a-4ba0-a4db-88aefa46f0e8 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:12.980171 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67ee77-6ef2-43b6-835d-5d7b160d4e52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:12.981000 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67ee77-6ef2-43b6-835d-5d7b160d4e52 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:12.981469 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67ee77-6ef2-43b6-835d-5d7b160d4e52 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:12.981862 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67ee77-6ef2-43b6-835d-5d7b160d4e52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:13.043111 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af67ee77-6ef2-43b6-835d-5d7b160d4e52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:13.045162 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af67ee77-6ef2-43b6-835d-5d7b160d4e52 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:13.054122 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1113/2232] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:16:12 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:16:13.319552 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:17.048649 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d5b80-5110-4288-aba7-dd51ee5bbd92 None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:17.053053 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d5b80-5110-4288-aba7-dd51ee5bbd92 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:17.053053 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d5b80-5110-4288-aba7-dd51ee5bbd92 None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:17.053053 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1120/2233] 10.222.0.45 () {54 vars in 921 bytes} [Wed Oct 26 11:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:16:17.062478 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e4f15-a9b0-4375-a729-3b53acbe3015 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:17.062478 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e4f15-a9b0-4375-a729-3b53acbe3015 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:17.062478 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e4f15-a9b0-4375-a729-3b53acbe3015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:17.084512 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-9e0e4f15-a9b0-4375-a729-3b53acbe3015 None None] MFA Rules not processed for user `a852a777cb6a4863bebdb949cc71ea65`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:16:17.086505 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9e0e4f15-a9b0-4375-a729-3b53acbe3015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:17.160488 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:17.170648 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1114/2234] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Oct 26 11:16:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:16:17.182493 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d5b80-5110-4288-aba7-dd51ee5bbd92 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:17.184238 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-927d5b80-5110-4288-aba7-dd51ee5bbd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:17.254090 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d5b80-5110-4288-aba7-dd51ee5bbd92 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:17.257709 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711bfb91-da5c-48ac-a352-09ffe0bd5fc1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d0e8cc074b4e36acc2162aebeac169', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:17.258311 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bfb91-da5c-48ac-a352-09ffe0bd5fc1 service glance] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:17.258678 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bfb91-da5c-48ac-a352-09ffe0bd5fc1 service glance] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:17.258947 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bfb91-da5c-48ac-a352-09ffe0bd5fc1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:17.270103 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711bfb91-da5c-48ac-a352-09ffe0bd5fc1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:17.271698 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711bfb91-da5c-48ac-a352-09ffe0bd5fc1 service glance] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:17.282920 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1121/2235] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:16:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:16:17.509856 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef8011-f665-4e25-a4d5-9b6f451a2b37 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:17.510148 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef8011-f665-4e25-a4d5-9b6f451a2b37 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:17.510324 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef8011-f665-4e25-a4d5-9b6f451a2b37 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:17.511686 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1115/2236] 10.222.0.45 () {54 vars in 921 bytes} [Wed Oct 26 11:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:16:17.516489 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85777c1f-fc7d-4f22-9f20-780af8fdbc44 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:17.519341 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85777c1f-fc7d-4f22-9f20-780af8fdbc44 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:17.519341 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85777c1f-fc7d-4f22-9f20-780af8fdbc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:17.538197 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-85777c1f-fc7d-4f22-9f20-780af8fdbc44 None None] MFA Rules not processed for user `522b4232cb4d430988d76a1cdb281e72`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:16:17.539399 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-85777c1f-fc7d-4f22-9f20-780af8fdbc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:17.600911 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1122/2237] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Oct 26 11:16:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:16:17.634908 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef8011-f665-4e25-a4d5-9b6f451a2b37 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:17.636727 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-96ef8011-f665-4e25-a4d5-9b6f451a2b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:17.658825 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef8011-f665-4e25-a4d5-9b6f451a2b37 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:17.665510 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467cd9f1-b66b-4930-84de-bc3117079a18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:17.668367 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cd9f1-b66b-4930-84de-bc3117079a18 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:17.668911 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cd9f1-b66b-4930-84de-bc3117079a18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:17.669355 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cd9f1-b66b-4930-84de-bc3117079a18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:17.686598 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467cd9f1-b66b-4930-84de-bc3117079a18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:17.688076 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467cd9f1-b66b-4930-84de-bc3117079a18 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:17.696645 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1116/2238] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:16:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:16:17.803149 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3f7fe-a84d-4afb-a203-298468d733ee None None] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:17.803522 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3f7fe-a84d-4afb-a203-298468d733ee None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:17.803915 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3f7fe-a84d-4afb-a203-298468d733ee None None] PATH_INFO: `/` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:17.805396 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1123/2239] 10.222.0.45 () {54 vars in 921 bytes} [Wed Oct 26 11:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:16:17.811721 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dbfef-d9a7-4bd5-93c5-054995156f2c None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:17.812033 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dbfef-d9a7-4bd5-93c5-054995156f2c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:17.812335 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dbfef-d9a7-4bd5-93c5-054995156f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:17.833323 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-f50dbfef-d9a7-4bd5-93c5-054995156f2c None None] MFA Rules not processed for user `a852a777cb6a4863bebdb949cc71ea65`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:16:17.833486 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f50dbfef-d9a7-4bd5-93c5-054995156f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:17.845945 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1117/2240] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Oct 26 11:16:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:16:17.856836 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3f7fe-a84d-4afb-a203-298468d733ee None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:17.874779 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3f7fe-a84d-4afb-a203-298468d733ee None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:17.878841 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af0d4f-3064-470e-8901-9ac3f5edfbc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:17.879515 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af0d4f-3064-470e-8901-9ac3f5edfbc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:17.879860 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af0d4f-3064-470e-8901-9ac3f5edfbc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:17.880244 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af0d4f-3064-470e-8901-9ac3f5edfbc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:17.891105 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52af0d4f-3064-470e-8901-9ac3f5edfbc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:17.892568 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52af0d4f-3064-470e-8901-9ac3f5edfbc4 service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:17.904599 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1124/2241] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:16:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:16:18.504216 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50dbfef-d9a7-4bd5-93c5-054995156f2c None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:18.585111 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50dbfef-d9a7-4bd5-93c5-054995156f2c None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:18.589794 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215757c-6c8b-4eda-a655-fa74b9fdfde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:18.590442 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215757c-6c8b-4eda-a655-fa74b9fdfde2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:18.590726 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215757c-6c8b-4eda-a655-fa74b9fdfde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:18.591002 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215757c-6c8b-4eda-a655-fa74b9fdfde2 admin admin] PATH_INFO: `/v3/users/7689ce8041504a0daea44568a8268489` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:18.593194 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215757c-6c8b-4eda-a655-fa74b9fdfde2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7689ce8041504a0daea44568a8268489)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:18.594885 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215757c-6c8b-4eda-a655-fa74b9fdfde2 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:18.807320 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3215757c-6c8b-4eda-a655-fa74b9fdfde2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7689ce8041504a0daea44568a8268489'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:18.908474 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3215757c-6c8b-4eda-a655-fa74b9fdfde2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7689ce8041504a0daea44568a8268489'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:18.925891 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3215757c-6c8b-4eda-a655-fa74b9fdfde2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7689ce8041504a0daea44568a8268489'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:18.938208 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3215757c-6c8b-4eda-a655-fa74b9fdfde2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7689ce8041504a0daea44568a8268489'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:18.939020 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3215757c-6c8b-4eda-a655-fa74b9fdfde2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7689ce8041504a0daea44568a8268489'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:18.946034 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1118/2242] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:16:18 2022] DELETE /identity/v3/users/7689ce8041504a0daea44568a8268489 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:18.949884 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c82f4-8a7a-4396-ba76-640de0d3f9b3 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:18.950318 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c82f4-8a7a-4396-ba76-640de0d3f9b3 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:18.950535 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c82f4-8a7a-4396-ba76-640de0d3f9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:18.972205 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-828c82f4-8a7a-4396-ba76-640de0d3f9b3 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:16:18.973421 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-828c82f4-8a7a-4396-ba76-640de0d3f9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:18.987159 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:19.034643 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1125/2243] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:16:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:16:19.044254 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215757c-6c8b-4eda-a655-fa74b9fdfde2 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:19.047365 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3215757c-6c8b-4eda-a655-fa74b9fdfde2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:19.105856 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215757c-6c8b-4eda-a655-fa74b9fdfde2 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:19.110239 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1c0ef-4aa8-4b61-8e29-7c58fbfba2c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:19.110868 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1c0ef-4aa8-4b61-8e29-7c58fbfba2c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:19.111131 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1c0ef-4aa8-4b61-8e29-7c58fbfba2c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:19.111401 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1c0ef-4aa8-4b61-8e29-7c58fbfba2c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:19.120380 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c1c0ef-4aa8-4b61-8e29-7c58fbfba2c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:19.121804 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c1c0ef-4aa8-4b61-8e29-7c58fbfba2c7 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:19.132117 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1119/2244] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:16:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:16:19.749964 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c82f4-8a7a-4396-ba76-640de0d3f9b3 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:19.755039 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-828c82f4-8a7a-4396-ba76-640de0d3f9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:19.763279 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c82f4-8a7a-4396-ba76-640de0d3f9b3 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:19.768532 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570181f-e8ac-46fe-9edb-ec003b10eb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:19.769156 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570181f-e8ac-46fe-9edb-ec003b10eb8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:19.769437 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570181f-e8ac-46fe-9edb-ec003b10eb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:19.776234 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570181f-e8ac-46fe-9edb-ec003b10eb8a admin admin] PATH_INFO: `/v3/projects/b8b6725e38bc4131a6d8078621446823` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:19.777522 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570181f-e8ac-46fe-9edb-ec003b10eb8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8b6725e38bc4131a6d8078621446823)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:19.780199 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570181f-e8ac-46fe-9edb-ec003b10eb8a admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:19.892188 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-e570181f-e8ac-46fe-9edb-ec003b10eb8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8b6725e38bc4131a6d8078621446823', 'request_id': 'req-e570181f-e8ac-46fe-9edb-ec003b10eb8a'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:19.954850 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-e570181f-e8ac-46fe-9edb-ec003b10eb8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8b6725e38bc4131a6d8078621446823', 'request_id': 'req-e570181f-e8ac-46fe-9edb-ec003b10eb8a'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:19.987303 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-e570181f-e8ac-46fe-9edb-ec003b10eb8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8b6725e38bc4131a6d8078621446823', 'request_id': 'req-e570181f-e8ac-46fe-9edb-ec003b10eb8a'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:20.008762 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-e570181f-e8ac-46fe-9edb-ec003b10eb8a admin admin] The token cache is being invalidate because project b8b6725e38bc4131a6d8078621446823 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:16:20.009066 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-e570181f-e8ac-46fe-9edb-ec003b10eb8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:20.009842 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-e570181f-e8ac-46fe-9edb-ec003b10eb8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:20.011970 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1126/2245] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:16:19 2022] DELETE /identity/v3/projects/b8b6725e38bc4131a6d8078621446823 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:20.016428 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1c0ef-4aa8-4b61-8e29-7c58fbfba2c7 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:20.021288 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:20.028830 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1c0ef-4aa8-4b61-8e29-7c58fbfba2c7 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:20.106125 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45a39a-d88a-40c4-9c4b-09ad7440a8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:20.106820 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45a39a-d88a-40c4-9c4b-09ad7440a8ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:20.107544 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45a39a-d88a-40c4-9c4b-09ad7440a8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:20.107544 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45a39a-d88a-40c4-9c4b-09ad7440a8ea admin admin] PATH_INFO: `/v3/users/3005e23c016e4a5cb98abfdd27f5adab` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:20.108801 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca45a39a-d88a-40c4-9c4b-09ad7440a8ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=3005e23c016e4a5cb98abfdd27f5adab)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:20.111451 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca45a39a-d88a-40c4-9c4b-09ad7440a8ea admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:20.304920 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ca45a39a-d88a-40c4-9c4b-09ad7440a8ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3005e23c016e4a5cb98abfdd27f5adab'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:20.389775 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ca45a39a-d88a-40c4-9c4b-09ad7440a8ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3005e23c016e4a5cb98abfdd27f5adab'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:20.402961 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ca45a39a-d88a-40c4-9c4b-09ad7440a8ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3005e23c016e4a5cb98abfdd27f5adab'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:20.410163 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ca45a39a-d88a-40c4-9c4b-09ad7440a8ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3005e23c016e4a5cb98abfdd27f5adab'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:20.413774 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ca45a39a-d88a-40c4-9c4b-09ad7440a8ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3005e23c016e4a5cb98abfdd27f5adab'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:20.416994 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1120/2246] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:16:20 2022] DELETE /identity/v3/users/3005e23c016e4a5cb98abfdd27f5adab => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:20.956547 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570181f-e8ac-46fe-9edb-ec003b10eb8a admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:20.957071 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-e570181f-e8ac-46fe-9edb-ec003b10eb8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:20.971214 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570181f-e8ac-46fe-9edb-ec003b10eb8a admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:21.030287 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5affe779-0355-4551-8a3d-8eaadc842486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:21.030930 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5affe779-0355-4551-8a3d-8eaadc842486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:21.031216 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5affe779-0355-4551-8a3d-8eaadc842486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:21.031501 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5affe779-0355-4551-8a3d-8eaadc842486 admin admin] PATH_INFO: `/v3/projects/23f69b1edfe947f9a0f6ed7188d9803c` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:21.032649 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5affe779-0355-4551-8a3d-8eaadc842486 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23f69b1edfe947f9a0f6ed7188d9803c)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:21.034556 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5affe779-0355-4551-8a3d-8eaadc842486 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:21.165239 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:21.168240 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-5affe779-0355-4551-8a3d-8eaadc842486 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23f69b1edfe947f9a0f6ed7188d9803c', 'request_id': 'req-5affe779-0355-4551-8a3d-8eaadc842486'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:21.256249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-5affe779-0355-4551-8a3d-8eaadc842486 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23f69b1edfe947f9a0f6ed7188d9803c', 'request_id': 'req-5affe779-0355-4551-8a3d-8eaadc842486'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:21.264131 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-5affe779-0355-4551-8a3d-8eaadc842486 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23f69b1edfe947f9a0f6ed7188d9803c', 'request_id': 'req-5affe779-0355-4551-8a3d-8eaadc842486'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:21.277159 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-5affe779-0355-4551-8a3d-8eaadc842486 admin admin] The token cache is being invalidate because project 23f69b1edfe947f9a0f6ed7188d9803c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:16:21.277461 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-5affe779-0355-4551-8a3d-8eaadc842486 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:21.278127 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-5affe779-0355-4551-8a3d-8eaadc842486 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:21.280646 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1127/2247] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:16:20 2022] DELETE /identity/v3/projects/23f69b1edfe947f9a0f6ed7188d9803c => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:21.286292 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b402d6c-808f-4419-bece-b0ae6a1485c6 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:21.286803 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b402d6c-808f-4419-bece-b0ae6a1485c6 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:21.293156 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b402d6c-808f-4419-bece-b0ae6a1485c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:21.324546 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-3b402d6c-808f-4419-bece-b0ae6a1485c6 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:16:21.326527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3b402d6c-808f-4419-bece-b0ae6a1485c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:21.406649 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1121/2248] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:16:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:16:21.415114 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8aef8c-b6f4-4a54-9858-b6f07efa6d10 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:21.415408 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8aef8c-b6f4-4a54-9858-b6f07efa6d10 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:21.415716 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8aef8c-b6f4-4a54-9858-b6f07efa6d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:21.458109 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-1a8aef8c-b6f4-4a54-9858-b6f07efa6d10 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:16:21.459324 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-1a8aef8c-b6f4-4a54-9858-b6f07efa6d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:21.468107 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1128/2249] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:16:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:16:21.472279 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b402d6c-808f-4419-bece-b0ae6a1485c6 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:21.482039 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b402d6c-808f-4419-bece-b0ae6a1485c6 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:21.487039 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0dcfb8-30cf-45b6-9767-1854c81f5fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:21.487644 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0dcfb8-30cf-45b6-9767-1854c81f5fad admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:21.487928 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0dcfb8-30cf-45b6-9767-1854c81f5fad admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:21.488242 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0dcfb8-30cf-45b6-9767-1854c81f5fad admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:21.488934 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0dcfb8-30cf-45b6-9767-1854c81f5fad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:16:21.489286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0dcfb8-30cf-45b6-9767-1854c81f5fad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:21.490901 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0dcfb8-30cf-45b6-9767-1854c81f5fad admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:21.502523 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1122/2250] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:16:21.506697 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8aef8c-b6f4-4a54-9858-b6f07efa6d10 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:21.516458 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8aef8c-b6f4-4a54-9858-b6f07efa6d10 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:21.521209 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac304af-ba43-4279-a28c-b7c8a5176a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:21.521814 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac304af-ba43-4279-a28c-b7c8a5176a31 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:21.522096 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac304af-ba43-4279-a28c-b7c8a5176a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:21.522381 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac304af-ba43-4279-a28c-b7c8a5176a31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:21.523049 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac304af-ba43-4279-a28c-b7c8a5176a31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:21.524984 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac304af-ba43-4279-a28c-b7c8a5176a31 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:21.698409 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1129/2251] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:16:21 2022] POST /identity/v3/projects => generated 379 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:16:21.703213 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0dcfb8-30cf-45b6-9767-1854c81f5fad admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:21.713224 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0dcfb8-30cf-45b6-9767-1854c81f5fad admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:21.717744 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:21.814818 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107524e-9f82-4795-9a48-1048324781bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:21.815528 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107524e-9f82-4795-9a48-1048324781bf admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:21.815810 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107524e-9f82-4795-9a48-1048324781bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:21.816119 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107524e-9f82-4795-9a48-1048324781bf admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:21.816795 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a107524e-9f82-4795-9a48-1048324781bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:21.818763 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a107524e-9f82-4795-9a48-1048324781bf admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:21.921165 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1123/2252] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:16:21 2022] POST /identity/v3/users => generated 290 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:16:21.925170 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac304af-ba43-4279-a28c-b7c8a5176a31 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:21.937872 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac304af-ba43-4279-a28c-b7c8a5176a31 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:21.947330 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a92b8-43e2-4f65-a5ee-4e717f484851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:21.948320 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a92b8-43e2-4f65-a5ee-4e717f484851 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:21.948686 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a92b8-43e2-4f65-a5ee-4e717f484851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:21.948910 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a92b8-43e2-4f65-a5ee-4e717f484851 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:21.949573 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a92b8-43e2-4f65-a5ee-4e717f484851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:21.951918 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a92b8-43e2-4f65-a5ee-4e717f484851 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:21.966250 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1130/2253] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:16:21.967709 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107524e-9f82-4795-9a48-1048324781bf admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:21.979111 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107524e-9f82-4795-9a48-1048324781bf admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:21.985138 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1021bde-107e-4135-a084-fbd49853fa0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:21.985858 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1021bde-107e-4135-a084-fbd49853fa0e admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:21.986242 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1021bde-107e-4135-a084-fbd49853fa0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:21.987227 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1021bde-107e-4135-a084-fbd49853fa0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:21.987960 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1021bde-107e-4135-a084-fbd49853fa0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:21.989702 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1021bde-107e-4135-a084-fbd49853fa0e admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:22.001645 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1124/2254] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:16:22.005332 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a92b8-43e2-4f65-a5ee-4e717f484851 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:22.018885 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a92b8-43e2-4f65-a5ee-4e717f484851 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:22.021136 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942de18-beba-4d3e-a013-586a061ed5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:22.021804 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942de18-beba-4d3e-a013-586a061ed5c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:22.022087 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942de18-beba-4d3e-a013-586a061ed5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:22.022366 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942de18-beba-4d3e-a013-586a061ed5c0 admin admin] PATH_INFO: `/v3/projects/8504f787bf844ebab68de45685e26194/users/0124c734581d4ff19707be29b46ebc5a/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:22.037595 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942de18-beba-4d3e-a013-586a061ed5c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8504f787bf844ebab68de45685e26194, user_id=0124c734581d4ff19707be29b46ebc5a, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:22.040544 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942de18-beba-4d3e-a013-586a061ed5c0 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:22.194734 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1131/2255] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:16:22 2022] PUT /identity/v3/projects/8504f787bf844ebab68de45685e26194/users/0124c734581d4ff19707be29b46ebc5a/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:22.205627 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaabafd-1bc3-4981-9bb7-5829e4c9ddc8 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:22.205857 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaabafd-1bc3-4981-9bb7-5829e4c9ddc8 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:22.206135 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaabafd-1bc3-4981-9bb7-5829e4c9ddc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:22.239410 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-bcaabafd-1bc3-4981-9bb7-5829e4c9ddc8 None None] MFA Rules not processed for user `0124c734581d4ff19707be29b46ebc5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:16:22.240854 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-bcaabafd-1bc3-4981-9bb7-5829e4c9ddc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:22.312593 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942de18-beba-4d3e-a013-586a061ed5c0 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:22.314330 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-0942de18-beba-4d3e-a013-586a061ed5c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:22.338771 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1125/2256] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:16:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:16:22.347326 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaabafd-1bc3-4981-9bb7-5829e4c9ddc8 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:22.388937 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942de18-beba-4d3e-a013-586a061ed5c0 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:22.404886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88049a54-fe28-44e4-a5f8-723c922eea0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:22.404886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88049a54-fe28-44e4-a5f8-723c922eea0c service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:22.404886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88049a54-fe28-44e4-a5f8-723c922eea0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:22.404886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88049a54-fe28-44e4-a5f8-723c922eea0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:22.405286 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-88049a54-fe28-44e4-a5f8-723c922eea0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:22.409192 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88049a54-fe28-44e4-a5f8-723c922eea0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:22.411144 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88049a54-fe28-44e4-a5f8-723c922eea0c service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:22.420547 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaabafd-1bc3-4981-9bb7-5829e4c9ddc8 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:22.423167 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1132/2257] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:16:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:16:22.425828 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce050a-018d-47ac-99c5-904dafb28df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:22.426481 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce050a-018d-47ac-99c5-904dafb28df3 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:22.427131 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce050a-018d-47ac-99c5-904dafb28df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:22.427131 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce050a-018d-47ac-99c5-904dafb28df3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:22.427756 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce050a-018d-47ac-99c5-904dafb28df3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:22.429755 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce050a-018d-47ac-99c5-904dafb28df3 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:22.579106 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1126/2258] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:16:22 2022] POST /identity/v3/projects => generated 381 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:16:22.583444 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88049a54-fe28-44e4-a5f8-723c922eea0c service neutron] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:22.595396 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88049a54-fe28-44e4-a5f8-723c922eea0c service neutron] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:22.656691 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7950c4d-6567-492b-8afb-11db4c24f3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:22.657350 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7950c4d-6567-492b-8afb-11db4c24f3f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:22.657629 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7950c4d-6567-492b-8afb-11db4c24f3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:22.657899 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7950c4d-6567-492b-8afb-11db4c24f3f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:22.658566 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7950c4d-6567-492b-8afb-11db4c24f3f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:22.660495 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7950c4d-6567-492b-8afb-11db4c24f3f8 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:22.773171 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1133/2259] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:16:22 2022] POST /identity/v3/users => generated 297 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:16:22.780076 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce050a-018d-47ac-99c5-904dafb28df3 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:22.784850 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:22.792153 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce050a-018d-47ac-99c5-904dafb28df3 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:22.797455 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9787e-85e1-4122-a42d-357d8e6e7cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:22.798289 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9787e-85e1-4122-a42d-357d8e6e7cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:22.798486 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9787e-85e1-4122-a42d-357d8e6e7cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:22.798738 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9787e-85e1-4122-a42d-357d8e6e7cd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:22.799382 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc9787e-85e1-4122-a42d-357d8e6e7cd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:22.801006 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc9787e-85e1-4122-a42d-357d8e6e7cd7 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:22.812564 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1127/2260] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:16:22.817652 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7950c4d-6567-492b-8afb-11db4c24f3f8 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:22.823132 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:DELETE=4,keystone:SELECT=90,keystone:INSERT=6 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:22.829234 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7950c4d-6567-492b-8afb-11db4c24f3f8 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:22.835019 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7408e-a696-4dc8-b4b6-743ed7337cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:22.835700 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7408e-a696-4dc8-b4b6-743ed7337cc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:22.835980 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7408e-a696-4dc8-b4b6-743ed7337cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:22.836347 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7408e-a696-4dc8-b4b6-743ed7337cc4 admin admin] PATH_INFO: `/v3/projects/4b715968c1154d3eae33f2c0775e0e1d/users/1573bf9d68c3483f88f29ffab5ab197c/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:22.842546 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4c938-f308-483e-b551-7188b456c7e0 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:22.842546 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4c938-f308-483e-b551-7188b456c7e0 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:22.842546 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4c938-f308-483e-b551-7188b456c7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:22.875897 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-5fc4c938-f308-483e-b551-7188b456c7e0 None None] MFA Rules not processed for user `3c90765757a34c6291c9980a7d5d5c79`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:16:22.883286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5fc4c938-f308-483e-b551-7188b456c7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:22.886343 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7408e-a696-4dc8-b4b6-743ed7337cc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b715968c1154d3eae33f2c0775e0e1d, user_id=1573bf9d68c3483f88f29ffab5ab197c, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:22.889562 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7408e-a696-4dc8-b4b6-743ed7337cc4 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:22.976382 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1128/2261] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Oct 26 11:16:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:16:22.985682 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc4c938-f308-483e-b551-7188b456c7e0 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:22.987160 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5fc4c938-f308-483e-b551-7188b456c7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:23.027863 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1134/2262] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:16:22 2022] PUT /identity/v3/projects/4b715968c1154d3eae33f2c0775e0e1d/users/1573bf9d68c3483f88f29ffab5ab197c/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:23.032417 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7408e-a696-4dc8-b4b6-743ed7337cc4 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:23.103000 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc4c938-f308-483e-b551-7188b456c7e0 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:23.146178 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7408e-a696-4dc8-b4b6-743ed7337cc4 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:23.170585 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f9bb3-d811-4c97-91f1-7f9f6a862e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:23.170585 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f9bb3-d811-4c97-91f1-7f9f6a862e79 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:23.170585 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f9bb3-d811-4c97-91f1-7f9f6a862e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:23.170585 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f9bb3-d811-4c97-91f1-7f9f6a862e79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:23.170924 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f9bb3-d811-4c97-91f1-7f9f6a862e79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:23.170924 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f9bb3-d811-4c97-91f1-7f9f6a862e79 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:23.198927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1135/2263] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:16:23.203764 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f9bb3-d811-4c97-91f1-7f9f6a862e79 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:23.206083 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225dec5f-16c6-42a9-b5d4-b5455e9651f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21b84cc38a848de8d19a41e1eb04a58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:23.206727 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225dec5f-16c6-42a9-b5d4-b5455e9651f1 service swift] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:23.207015 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225dec5f-16c6-42a9-b5d4-b5455e9651f1 service swift] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:23.207295 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225dec5f-16c6-42a9-b5d4-b5455e9651f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:23.216415 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f9bb3-d811-4c97-91f1-7f9f6a862e79 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:23.223797 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74814e8-9218-49f0-8101-12772a38f3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:23.224614 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74814e8-9218-49f0-8101-12772a38f3a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:23.225423 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74814e8-9218-49f0-8101-12772a38f3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:23.225867 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74814e8-9218-49f0-8101-12772a38f3a5 admin admin] PATH_INFO: `/v3/projects/4b715968c1154d3eae33f2c0775e0e1d/users/1573bf9d68c3483f88f29ffab5ab197c/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:23.228900 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74814e8-9218-49f0-8101-12772a38f3a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b715968c1154d3eae33f2c0775e0e1d, user_id=1573bf9d68c3483f88f29ffab5ab197c, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:23.231618 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74814e8-9218-49f0-8101-12772a38f3a5 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:23.252156 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1136/2264] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:16:23 2022] PUT /identity/v3/projects/4b715968c1154d3eae33f2c0775e0e1d/users/1573bf9d68c3483f88f29ffab5ab197c/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:16:23.258552 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeec4d4-2b7b-46af-a3de-500310506c62 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:23.258898 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeec4d4-2b7b-46af-a3de-500310506c62 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:23.259126 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeec4d4-2b7b-46af-a3de-500310506c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:23.301295 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225dec5f-16c6-42a9-b5d4-b5455e9651f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:23.303784 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225dec5f-16c6-42a9-b5d4-b5455e9651f1 service swift] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:23.316524 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1129/2265] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Oct 26 11:16:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 26 11:16:23.322440 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-caeec4d4-2b7b-46af-a3de-500310506c62 None None] MFA Rules not processed for user `1573bf9d68c3483f88f29ffab5ab197c`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:16:23.323519 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-caeec4d4-2b7b-46af-a3de-500310506c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:23.360450 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:23.426102 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1137/2266] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:16:23 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:16:23.437903 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225dec5f-16c6-42a9-b5d4-b5455e9651f1 service swift] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:23.440223 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-225dec5f-16c6-42a9-b5d4-b5455e9651f1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:23.503468 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225dec5f-16c6-42a9-b5d4-b5455e9651f1 service swift] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:23.564097 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ffcd8-f22d-46ee-b628-7e6e517ea241 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:23.564703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ffcd8-f22d-46ee-b628-7e6e517ea241 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:23.565036 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ffcd8-f22d-46ee-b628-7e6e517ea241 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:23.565312 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ffcd8-f22d-46ee-b628-7e6e517ea241 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:23.578337 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ffcd8-f22d-46ee-b628-7e6e517ea241 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:23.581809 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ffcd8-f22d-46ee-b628-7e6e517ea241 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:23.636601 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1130/2267] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:16:23 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:16:24.347589 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeec4d4-2b7b-46af-a3de-500310506c62 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:24.357611 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ffcd8-f22d-46ee-b628-7e6e517ea241 service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:24.361144 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-922ffcd8-f22d-46ee-b628-7e6e517ea241 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:24.456225 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:24.493458 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeec4d4-2b7b-46af-a3de-500310506c62 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:24.498288 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f3294-69e8-4b59-ac96-b978e2bc09a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:24.499189 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f3294-69e8-4b59-ac96-b978e2bc09a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:24.499475 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f3294-69e8-4b59-ac96-b978e2bc09a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:24.499742 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f3294-69e8-4b59-ac96-b978e2bc09a6 admin admin] PATH_INFO: `/v3/users/0124c734581d4ff19707be29b46ebc5a` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:24.501667 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f3294-69e8-4b59-ac96-b978e2bc09a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0124c734581d4ff19707be29b46ebc5a)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:24.504987 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f3294-69e8-4b59-ac96-b978e2bc09a6 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:24.543968 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ffcd8-f22d-46ee-b628-7e6e517ea241 service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:24.567793 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab57b9-79ff-4074-916c-fa762670e94d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:24.568964 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab57b9-79ff-4074-916c-fa762670e94d service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:24.569467 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab57b9-79ff-4074-916c-fa762670e94d service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:24.570872 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab57b9-79ff-4074-916c-fa762670e94d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:24.574195 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-59ab57b9-79ff-4074-916c-fa762670e94d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:24.606166 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab57b9-79ff-4074-916c-fa762670e94d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:24.611727 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab57b9-79ff-4074-916c-fa762670e94d service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:24.632725 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1131/2268] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:16:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:16:24.731749 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-ab8f3294-69e8-4b59-ac96-b978e2bc09a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0124c734581d4ff19707be29b46ebc5a'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:24.800624 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-ab8f3294-69e8-4b59-ac96-b978e2bc09a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0124c734581d4ff19707be29b46ebc5a'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:24.819482 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-ab8f3294-69e8-4b59-ac96-b978e2bc09a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0124c734581d4ff19707be29b46ebc5a'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:24.820349 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-ab8f3294-69e8-4b59-ac96-b978e2bc09a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0124c734581d4ff19707be29b46ebc5a'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:24.832538 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-ab8f3294-69e8-4b59-ac96-b978e2bc09a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0124c734581d4ff19707be29b46ebc5a'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:24.850090 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1138/2269] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:16:24 2022] DELETE /identity/v3/users/0124c734581d4ff19707be29b46ebc5a => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:24.860867 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef997b-35c6-4d5c-a703-5f9693e40217 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:24.861409 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef997b-35c6-4d5c-a703-5f9693e40217 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:24.861850 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef997b-35c6-4d5c-a703-5f9693e40217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:24.898385 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-aeef997b-35c6-4d5c-a703-5f9693e40217 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:16:24.900162 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-aeef997b-35c6-4d5c-a703-5f9693e40217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:24.933891 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:25.011431 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f3294-69e8-4b59-ac96-b978e2bc09a6 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:25.013255 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-ab8f3294-69e8-4b59-ac96-b978e2bc09a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:25.035930 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1132/2270] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:16:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:16:25.046992 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef997b-35c6-4d5c-a703-5f9693e40217 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:25.048707 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-aeef997b-35c6-4d5c-a703-5f9693e40217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:25.134119 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f3294-69e8-4b59-ac96-b978e2bc09a6 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:25.140374 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224069e2-3ac1-4d79-8ea0-cd13ba76fa2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:25.141171 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224069e2-3ac1-4d79-8ea0-cd13ba76fa2a service nova] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:25.141523 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224069e2-3ac1-4d79-8ea0-cd13ba76fa2a service nova] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:25.141871 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224069e2-3ac1-4d79-8ea0-cd13ba76fa2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:25.144595 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-224069e2-3ac1-4d79-8ea0-cd13ba76fa2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:25.171712 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224069e2-3ac1-4d79-8ea0-cd13ba76fa2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:25.173276 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef997b-35c6-4d5c-a703-5f9693e40217 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:25.175829 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224069e2-3ac1-4d79-8ea0-cd13ba76fa2a service nova] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:25.182278 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35842604-162b-4c04-9dc1-4030f6235344 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:25.186954 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35842604-162b-4c04-9dc1-4030f6235344 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:25.187627 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35842604-162b-4c04-9dc1-4030f6235344 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:25.188069 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35842604-162b-4c04-9dc1-4030f6235344 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:25.201073 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1139/2271] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:16:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:16:25.209742 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35842604-162b-4c04-9dc1-4030f6235344 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:25.211292 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35842604-162b-4c04-9dc1-4030f6235344 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:25.241241 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1133/2272] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:16:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:16:25.712375 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224069e2-3ac1-4d79-8ea0-cd13ba76fa2a service nova] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:25.713996 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-224069e2-3ac1-4d79-8ea0-cd13ba76fa2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:25.745186 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224069e2-3ac1-4d79-8ea0-cd13ba76fa2a service nova] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:25.754811 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6347cd-03ff-4545-ac56-a6ca04abfec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:25.755577 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6347cd-03ff-4545-ac56-a6ca04abfec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:25.755898 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6347cd-03ff-4545-ac56-a6ca04abfec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:25.756273 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6347cd-03ff-4545-ac56-a6ca04abfec4 admin admin] PATH_INFO: `/v3/projects/8504f787bf844ebab68de45685e26194` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:25.758680 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6347cd-03ff-4545-ac56-a6ca04abfec4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8504f787bf844ebab68de45685e26194)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:25.761076 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6347cd-03ff-4545-ac56-a6ca04abfec4 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:25.969546 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:25.975277 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-0f6347cd-03ff-4545-ac56-a6ca04abfec4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8504f787bf844ebab68de45685e26194', 'request_id': 'req-0f6347cd-03ff-4545-ac56-a6ca04abfec4'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:26.087057 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-0f6347cd-03ff-4545-ac56-a6ca04abfec4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8504f787bf844ebab68de45685e26194', 'request_id': 'req-0f6347cd-03ff-4545-ac56-a6ca04abfec4'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:26.098943 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-0f6347cd-03ff-4545-ac56-a6ca04abfec4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8504f787bf844ebab68de45685e26194', 'request_id': 'req-0f6347cd-03ff-4545-ac56-a6ca04abfec4'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:26.115584 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-0f6347cd-03ff-4545-ac56-a6ca04abfec4 admin admin] The token cache is being invalidate because project 8504f787bf844ebab68de45685e26194 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:16:26.115797 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-0f6347cd-03ff-4545-ac56-a6ca04abfec4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:26.116464 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-0f6347cd-03ff-4545-ac56-a6ca04abfec4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:26.128827 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1140/2273] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:16:25 2022] DELETE /identity/v3/projects/8504f787bf844ebab68de45685e26194 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:26.141307 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35842604-162b-4c04-9dc1-4030f6235344 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:26.153961 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35842604-162b-4c04-9dc1-4030f6235344 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:26.237371 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f6426-67fe-437e-88bb-7b3483289ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:26.238115 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f6426-67fe-437e-88bb-7b3483289ec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:26.238431 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f6426-67fe-437e-88bb-7b3483289ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:26.238683 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f6426-67fe-437e-88bb-7b3483289ec3 admin admin] PATH_INFO: `/v3/users/1573bf9d68c3483f88f29ffab5ab197c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:26.239881 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f6426-67fe-437e-88bb-7b3483289ec3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1573bf9d68c3483f88f29ffab5ab197c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:26.241914 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f6426-67fe-437e-88bb-7b3483289ec3 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:26.458795 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c03f6426-67fe-437e-88bb-7b3483289ec3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1573bf9d68c3483f88f29ffab5ab197c'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:26.515152 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c03f6426-67fe-437e-88bb-7b3483289ec3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1573bf9d68c3483f88f29ffab5ab197c'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:26.529224 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:26.530821 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c03f6426-67fe-437e-88bb-7b3483289ec3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1573bf9d68c3483f88f29ffab5ab197c'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:26.544154 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c03f6426-67fe-437e-88bb-7b3483289ec3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1573bf9d68c3483f88f29ffab5ab197c'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:26.548160 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c03f6426-67fe-437e-88bb-7b3483289ec3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1573bf9d68c3483f88f29ffab5ab197c'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:26.565460 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1134/2274] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:16:26 2022] DELETE /identity/v3/users/1573bf9d68c3483f88f29ffab5ab197c => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:27.139053 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6347cd-03ff-4545-ac56-a6ca04abfec4 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:27.141130 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-0f6347cd-03ff-4545-ac56-a6ca04abfec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:27.162213 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6347cd-03ff-4545-ac56-a6ca04abfec4 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:27.272432 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff187825-b18a-490c-9c0f-a7e002224f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:27.273203 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff187825-b18a-490c-9c0f-a7e002224f87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:27.273570 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff187825-b18a-490c-9c0f-a7e002224f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:27.273919 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff187825-b18a-490c-9c0f-a7e002224f87 admin admin] PATH_INFO: `/v3/projects/4b715968c1154d3eae33f2c0775e0e1d` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:27.275486 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff187825-b18a-490c-9c0f-a7e002224f87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b715968c1154d3eae33f2c0775e0e1d)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:27.277590 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff187825-b18a-490c-9c0f-a7e002224f87 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:27.433638 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-ff187825-b18a-490c-9c0f-a7e002224f87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b715968c1154d3eae33f2c0775e0e1d', 'request_id': 'req-ff187825-b18a-490c-9c0f-a7e002224f87'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:27.559932 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-ff187825-b18a-490c-9c0f-a7e002224f87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b715968c1154d3eae33f2c0775e0e1d', 'request_id': 'req-ff187825-b18a-490c-9c0f-a7e002224f87'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:27.567910 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-ff187825-b18a-490c-9c0f-a7e002224f87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b715968c1154d3eae33f2c0775e0e1d', 'request_id': 'req-ff187825-b18a-490c-9c0f-a7e002224f87'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:27.581139 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-ff187825-b18a-490c-9c0f-a7e002224f87 admin admin] The token cache is being invalidate because project 4b715968c1154d3eae33f2c0775e0e1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:16:27.581497 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-ff187825-b18a-490c-9c0f-a7e002224f87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:27.582241 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-ff187825-b18a-490c-9c0f-a7e002224f87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:27.589151 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1141/2275] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:16:27 2022] DELETE /identity/v3/projects/4b715968c1154d3eae33f2c0775e0e1d => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:27.591119 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43e64a-902b-4aee-bb32-a3e27ac05606 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:27.591656 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43e64a-902b-4aee-bb32-a3e27ac05606 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:27.592424 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43e64a-902b-4aee-bb32-a3e27ac05606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:27.614496 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-3c43e64a-902b-4aee-bb32-a3e27ac05606 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:16:27.615847 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3c43e64a-902b-4aee-bb32-a3e27ac05606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:27.685316 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1135/2276] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:16:27.693703 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41ed7b-2b85-499a-bc04-17a70ea60421 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:27.695178 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41ed7b-2b85-499a-bc04-17a70ea60421 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:27.695412 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41ed7b-2b85-499a-bc04-17a70ea60421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:27.718780 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-6b41ed7b-2b85-499a-bc04-17a70ea60421 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:16:27.720021 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-6b41ed7b-2b85-499a-bc04-17a70ea60421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:27.729422 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1142/2277] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:16:27.734027 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c43e64a-902b-4aee-bb32-a3e27ac05606 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:27.744118 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c43e64a-902b-4aee-bb32-a3e27ac05606 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:27.749453 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a222b-b2a9-480d-965a-84d2da88d61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:27.750085 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a222b-b2a9-480d-965a-84d2da88d61f admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:27.750367 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a222b-b2a9-480d-965a-84d2da88d61f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:27.750640 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a222b-b2a9-480d-965a-84d2da88d61f admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:27.751284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a222b-b2a9-480d-965a-84d2da88d61f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:16:27.751589 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a222b-b2a9-480d-965a-84d2da88d61f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:27.753299 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a222b-b2a9-480d-965a-84d2da88d61f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:27.769294 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1136/2278] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:16:27.773632 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41ed7b-2b85-499a-bc04-17a70ea60421 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:27.785826 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41ed7b-2b85-499a-bc04-17a70ea60421 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:27.791283 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99fd113-c236-4a9f-a066-124c77d4da6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:27.792810 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fd113-c236-4a9f-a066-124c77d4da6d admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:27.792810 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fd113-c236-4a9f-a066-124c77d4da6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:27.792810 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fd113-c236-4a9f-a066-124c77d4da6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:27.793479 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99fd113-c236-4a9f-a066-124c77d4da6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:27.795513 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99fd113-c236-4a9f-a066-124c77d4da6d admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:27.905926 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1143/2279] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:16:27 2022] POST /identity/v3/projects => generated 375 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:16:27.909570 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a222b-b2a9-480d-965a-84d2da88d61f admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:27.921152 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a222b-b2a9-480d-965a-84d2da88d61f admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:27.987971 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b2429-43ca-4f86-837c-f84fcc078df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:27.988720 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b2429-43ca-4f86-837c-f84fcc078df6 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:27.989065 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b2429-43ca-4f86-837c-f84fcc078df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:27.989399 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b2429-43ca-4f86-837c-f84fcc078df6 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:27.990130 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b2429-43ca-4f86-837c-f84fcc078df6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:27.992183 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b2429-43ca-4f86-837c-f84fcc078df6 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:28.086794 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1137/2280] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:16:27 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:16:28.090903 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99fd113-c236-4a9f-a066-124c77d4da6d admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:28.102183 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99fd113-c236-4a9f-a066-124c77d4da6d admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:28.107058 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3bc8bb-8271-4717-913e-3849150ea8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:28.108241 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bc8bb-8271-4717-913e-3849150ea8a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:28.108902 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bc8bb-8271-4717-913e-3849150ea8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:28.109174 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bc8bb-8271-4717-913e-3849150ea8a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:28.109821 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3bc8bb-8271-4717-913e-3849150ea8a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:28.111432 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3bc8bb-8271-4717-913e-3849150ea8a3 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:28.122492 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1144/2281] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:16:28.127319 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b2429-43ca-4f86-837c-f84fcc078df6 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:28.143333 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b2429-43ca-4f86-837c-f84fcc078df6 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:28.148774 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2643f7b-41d8-49eb-aace-c2457bb74d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:28.149497 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2643f7b-41d8-49eb-aace-c2457bb74d79 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:28.149913 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2643f7b-41d8-49eb-aace-c2457bb74d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:28.150261 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2643f7b-41d8-49eb-aace-c2457bb74d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:28.150992 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2643f7b-41d8-49eb-aace-c2457bb74d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:28.152741 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2643f7b-41d8-49eb-aace-c2457bb74d79 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:28.169302 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1138/2282] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:16:28.170717 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3bc8bb-8271-4717-913e-3849150ea8a3 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:28.181123 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3bc8bb-8271-4717-913e-3849150ea8a3 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:28.188193 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7056d2f-6fb9-4ab4-b1cc-21eb264112d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:28.189186 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7056d2f-6fb9-4ab4-b1cc-21eb264112d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:28.189577 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7056d2f-6fb9-4ab4-b1cc-21eb264112d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:28.189935 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7056d2f-6fb9-4ab4-b1cc-21eb264112d3 admin admin] PATH_INFO: `/v3/projects/cb8a146354e449de89e5bafe74d92547/users/b8b27173a7474f00abf0923d375576d4/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:28.209169 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7056d2f-6fb9-4ab4-b1cc-21eb264112d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb8a146354e449de89e5bafe74d92547, user_id=b8b27173a7474f00abf0923d375576d4, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:28.212759 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7056d2f-6fb9-4ab4-b1cc-21eb264112d3 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:28.288562 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:28.308697 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1145/2283] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:16:28 2022] PUT /identity/v3/projects/cb8a146354e449de89e5bafe74d92547/users/b8b27173a7474f00abf0923d375576d4/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:28.311379 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a6c5a-71bd-4338-b49c-ddb252dd4b28 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:28.311672 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a6c5a-71bd-4338-b49c-ddb252dd4b28 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:28.311981 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a6c5a-71bd-4338-b49c-ddb252dd4b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:28.353671 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-5d1a6c5a-71bd-4338-b49c-ddb252dd4b28 None None] MFA Rules not processed for user `b8b27173a7474f00abf0923d375576d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:16:28.368244 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5d1a6c5a-71bd-4338-b49c-ddb252dd4b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:28.434850 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:28.468079 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1139/2284] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:16:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:16:28.469247 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7056d2f-6fb9-4ab4-b1cc-21eb264112d3 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:28.585872 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7056d2f-6fb9-4ab4-b1cc-21eb264112d3 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:28.589893 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb164e-bd64-45ac-bdca-729e403e70ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:28.590632 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb164e-bd64-45ac-bdca-729e403e70ec admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:28.591057 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb164e-bd64-45ac-bdca-729e403e70ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:28.591337 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb164e-bd64-45ac-bdca-729e403e70ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:28.592991 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb164e-bd64-45ac-bdca-729e403e70ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:28.594999 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb164e-bd64-45ac-bdca-729e403e70ec admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:28.738795 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1146/2285] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:16:28 2022] POST /identity/v3/projects => generated 373 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:16:28.743537 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a6c5a-71bd-4338-b49c-ddb252dd4b28 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:28.756868 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a6c5a-71bd-4338-b49c-ddb252dd4b28 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:28.835036 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6df367-1d71-43b0-be96-f73959df3be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:28.835652 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6df367-1d71-43b0-be96-f73959df3be8 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:28.835941 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6df367-1d71-43b0-be96-f73959df3be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:28.836244 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6df367-1d71-43b0-be96-f73959df3be8 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:28.836877 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6df367-1d71-43b0-be96-f73959df3be8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:28.838809 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6df367-1d71-43b0-be96-f73959df3be8 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:28.960817 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1140/2286] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:16:28 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:16:28.964877 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb164e-bd64-45ac-bdca-729e403e70ec admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:28.975878 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb164e-bd64-45ac-bdca-729e403e70ec admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:28.980750 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a13ab-60be-4ddf-a3cf-62dc50c2ff73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:28.981439 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a13ab-60be-4ddf-a3cf-62dc50c2ff73 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:28.981771 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a13ab-60be-4ddf-a3cf-62dc50c2ff73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:28.982007 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a13ab-60be-4ddf-a3cf-62dc50c2ff73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:28.982709 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a13ab-60be-4ddf-a3cf-62dc50c2ff73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:28.984702 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a13ab-60be-4ddf-a3cf-62dc50c2ff73 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:28.997238 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1147/2287] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:16:29.002608 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6df367-1d71-43b0-be96-f73959df3be8 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:29.015418 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6df367-1d71-43b0-be96-f73959df3be8 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:29.020153 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf03ef-63d4-4792-b305-e0d3b2fbcf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:29.020817 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf03ef-63d4-4792-b305-e0d3b2fbcf82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:29.021096 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf03ef-63d4-4792-b305-e0d3b2fbcf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:29.021371 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf03ef-63d4-4792-b305-e0d3b2fbcf82 admin admin] PATH_INFO: `/v3/projects/9ea6041a215d4833b73f85819f5033f9/users/e4d5e314a62f4d10a782077d523e0a22/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:29.038353 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf03ef-63d4-4792-b305-e0d3b2fbcf82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ea6041a215d4833b73f85819f5033f9, user_id=e4d5e314a62f4d10a782077d523e0a22, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:29.041102 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf03ef-63d4-4792-b305-e0d3b2fbcf82 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:29.127922 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1141/2288] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:16:29 2022] PUT /identity/v3/projects/9ea6041a215d4833b73f85819f5033f9/users/e4d5e314a62f4d10a782077d523e0a22/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:16:29.133276 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a13ab-60be-4ddf-a3cf-62dc50c2ff73 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:29.144571 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a13ab-60be-4ddf-a3cf-62dc50c2ff73 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:29.207740 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157d08c-92f1-4fbb-a16b-f2ac4fa8d8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:29.208679 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157d08c-92f1-4fbb-a16b-f2ac4fa8d8b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:29.208679 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157d08c-92f1-4fbb-a16b-f2ac4fa8d8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:29.209036 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157d08c-92f1-4fbb-a16b-f2ac4fa8d8b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:29.209592 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b157d08c-92f1-4fbb-a16b-f2ac4fa8d8b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:29.211211 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b157d08c-92f1-4fbb-a16b-f2ac4fa8d8b2 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:29.222545 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1148/2289] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:16:29.226843 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf03ef-63d4-4792-b305-e0d3b2fbcf82 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:29.238839 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf03ef-63d4-4792-b305-e0d3b2fbcf82 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:29.244410 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010b10d-7231-4d05-94be-286b1c48d902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:29.245094 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010b10d-7231-4d05-94be-286b1c48d902 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:29.245367 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010b10d-7231-4d05-94be-286b1c48d902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:29.245697 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010b10d-7231-4d05-94be-286b1c48d902 admin admin] PATH_INFO: `/v3/projects/9ea6041a215d4833b73f85819f5033f9/users/e4d5e314a62f4d10a782077d523e0a22/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:29.247926 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e010b10d-7231-4d05-94be-286b1c48d902 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ea6041a215d4833b73f85819f5033f9, user_id=e4d5e314a62f4d10a782077d523e0a22, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:29.251216 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e010b10d-7231-4d05-94be-286b1c48d902 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:29.262157 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1142/2290] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:16:29 2022] PUT /identity/v3/projects/9ea6041a215d4833b73f85819f5033f9/users/e4d5e314a62f4d10a782077d523e0a22/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:29.333491 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e35764-887a-45f9-bfc1-6d991e393b84 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:29.333778 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e35764-887a-45f9-bfc1-6d991e393b84 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:29.334103 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e35764-887a-45f9-bfc1-6d991e393b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:29.365884 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-92e35764-887a-45f9-bfc1-6d991e393b84 None None] MFA Rules not processed for user `e4d5e314a62f4d10a782077d523e0a22`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:16:29.367188 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-92e35764-887a-45f9-bfc1-6d991e393b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:29.475500 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:29.487979 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1149/2291] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:16:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:16:29.499732 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010b10d-7231-4d05-94be-286b1c48d902 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:29.501567 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e010b10d-7231-4d05-94be-286b1c48d902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:29.580169 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010b10d-7231-4d05-94be-286b1c48d902 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:29.583744 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5178f-6628-452f-81aa-c7ebd396d0d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:29.584394 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5178f-6628-452f-81aa-c7ebd396d0d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:29.584674 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5178f-6628-452f-81aa-c7ebd396d0d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:29.584945 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5178f-6628-452f-81aa-c7ebd396d0d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:29.663018 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:29.674337 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e5178f-6628-452f-81aa-c7ebd396d0d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:29.675933 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e5178f-6628-452f-81aa-c7ebd396d0d5 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:29.691745 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1143/2292] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:16:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:16:32.867893 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e35764-887a-45f9-bfc1-6d991e393b84 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:32.928501 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e35764-887a-45f9-bfc1-6d991e393b84 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:32.932972 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1607a17-f060-4999-ae41-5655d8ef54df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:32.933594 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1607a17-f060-4999-ae41-5655d8ef54df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:32.933870 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1607a17-f060-4999-ae41-5655d8ef54df admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:32.934142 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1607a17-f060-4999-ae41-5655d8ef54df admin admin] PATH_INFO: `/v3/users/b8b27173a7474f00abf0923d375576d4` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:32.935242 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1607a17-f060-4999-ae41-5655d8ef54df admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8b27173a7474f00abf0923d375576d4)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:32.937293 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1607a17-f060-4999-ae41-5655d8ef54df admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:33.163791 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-b1607a17-f060-4999-ae41-5655d8ef54df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8b27173a7474f00abf0923d375576d4'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:33.228441 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-b1607a17-f060-4999-ae41-5655d8ef54df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8b27173a7474f00abf0923d375576d4'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:33.242082 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-b1607a17-f060-4999-ae41-5655d8ef54df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8b27173a7474f00abf0923d375576d4'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:33.242770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-b1607a17-f060-4999-ae41-5655d8ef54df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8b27173a7474f00abf0923d375576d4'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:33.249952 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-b1607a17-f060-4999-ae41-5655d8ef54df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8b27173a7474f00abf0923d375576d4'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:33.256183 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1150/2293] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:16:32 2022] DELETE /identity/v3/users/b8b27173a7474f00abf0923d375576d4 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:33.260538 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9a495-1940-4b85-b05d-a22d413d8aed None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:33.261063 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9a495-1940-4b85-b05d-a22d413d8aed None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:33.261162 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9a495-1940-4b85-b05d-a22d413d8aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:33.280852 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-92a9a495-1940-4b85-b05d-a22d413d8aed None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:16:33.282077 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-92a9a495-1940-4b85-b05d-a22d413d8aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:33.349029 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1144/2294] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:16:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:16:33.359005 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1607a17-f060-4999-ae41-5655d8ef54df admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:33.360455 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-b1607a17-f060-4999-ae41-5655d8ef54df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:33.417804 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1607a17-f060-4999-ae41-5655d8ef54df admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:33.421445 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a028fed-110d-427c-8a3d-2fd677106adf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:33.422051 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a028fed-110d-427c-8a3d-2fd677106adf service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:33.422337 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a028fed-110d-427c-8a3d-2fd677106adf service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:33.422611 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a028fed-110d-427c-8a3d-2fd677106adf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:33.431502 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a028fed-110d-427c-8a3d-2fd677106adf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:33.433041 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a028fed-110d-427c-8a3d-2fd677106adf service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:33.442387 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1151/2295] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:16:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:16:33.910992 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9a495-1940-4b85-b05d-a22d413d8aed None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:33.917924 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-92a9a495-1940-4b85-b05d-a22d413d8aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:33.940793 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9a495-1940-4b85-b05d-a22d413d8aed None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:33.946821 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca90978-0d69-4021-a4bc-22a769921bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:33.947713 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca90978-0d69-4021-a4bc-22a769921bd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:33.947997 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca90978-0d69-4021-a4bc-22a769921bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:33.952433 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca90978-0d69-4021-a4bc-22a769921bd4 admin admin] PATH_INFO: `/v3/projects/cb8a146354e449de89e5bafe74d92547` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:33.952433 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca90978-0d69-4021-a4bc-22a769921bd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb8a146354e449de89e5bafe74d92547)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:33.952753 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca90978-0d69-4021-a4bc-22a769921bd4 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:34.157781 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6ca90978-0d69-4021-a4bc-22a769921bd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb8a146354e449de89e5bafe74d92547', 'request_id': 'req-6ca90978-0d69-4021-a4bc-22a769921bd4'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:34.164970 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6ca90978-0d69-4021-a4bc-22a769921bd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb8a146354e449de89e5bafe74d92547', 'request_id': 'req-6ca90978-0d69-4021-a4bc-22a769921bd4'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:34.269674 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6ca90978-0d69-4021-a4bc-22a769921bd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb8a146354e449de89e5bafe74d92547', 'request_id': 'req-6ca90978-0d69-4021-a4bc-22a769921bd4'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:34.286114 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6ca90978-0d69-4021-a4bc-22a769921bd4 admin admin] The token cache is being invalidate because project cb8a146354e449de89e5bafe74d92547 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:16:34.286422 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6ca90978-0d69-4021-a4bc-22a769921bd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:34.287202 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6ca90978-0d69-4021-a4bc-22a769921bd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:34.288806 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1145/2296] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:16:33 2022] DELETE /identity/v3/projects/cb8a146354e449de89e5bafe74d92547 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:34.293127 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a028fed-110d-427c-8a3d-2fd677106adf service neutron] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:34.307142 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a028fed-110d-427c-8a3d-2fd677106adf service neutron] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:34.321165 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:34.377403 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f919d9e-6144-46d3-846e-31ffd40d4719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:34.378186 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f919d9e-6144-46d3-846e-31ffd40d4719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:34.378317 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f919d9e-6144-46d3-846e-31ffd40d4719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:34.378569 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f919d9e-6144-46d3-846e-31ffd40d4719 admin admin] PATH_INFO: `/v3/users/e4d5e314a62f4d10a782077d523e0a22` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:34.379712 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f919d9e-6144-46d3-846e-31ffd40d4719 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4d5e314a62f4d10a782077d523e0a22)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:34.381672 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f919d9e-6144-46d3-846e-31ffd40d4719 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:34.587633 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-4f919d9e-6144-46d3-846e-31ffd40d4719 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4d5e314a62f4d10a782077d523e0a22'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:34.657381 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-4f919d9e-6144-46d3-846e-31ffd40d4719 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4d5e314a62f4d10a782077d523e0a22'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:34.669993 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-4f919d9e-6144-46d3-846e-31ffd40d4719 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4d5e314a62f4d10a782077d523e0a22'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:34.671568 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-4f919d9e-6144-46d3-846e-31ffd40d4719 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4d5e314a62f4d10a782077d523e0a22'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:34.682072 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-4f919d9e-6144-46d3-846e-31ffd40d4719 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4d5e314a62f4d10a782077d523e0a22'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:34.692326 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1152/2297] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:16:34 2022] DELETE /identity/v3/users/e4d5e314a62f4d10a782077d523e0a22 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:35.118704 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca90978-0d69-4021-a4bc-22a769921bd4 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:35.120133 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6ca90978-0d69-4021-a4bc-22a769921bd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:35.179541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca90978-0d69-4021-a4bc-22a769921bd4 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:35.205687 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:35.227617 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecaf93e-b4b8-4f8d-898b-0923253f4f89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:35.228259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecaf93e-b4b8-4f8d-898b-0923253f4f89 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:35.228542 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecaf93e-b4b8-4f8d-898b-0923253f4f89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:35.228819 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecaf93e-b4b8-4f8d-898b-0923253f4f89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:35.230558 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3ecaf93e-b4b8-4f8d-898b-0923253f4f89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:35.247599 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f919d9e-6144-46d3-846e-31ffd40d4719 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:35.249673 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-4f919d9e-6144-46d3-846e-31ffd40d4719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:35.306045 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecaf93e-b4b8-4f8d-898b-0923253f4f89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:35.307519 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecaf93e-b4b8-4f8d-898b-0923253f4f89 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:35.319149 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1146/2298] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:16:35 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:16:35.337532 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f919d9e-6144-46d3-846e-31ffd40d4719 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:35.343040 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be129574-9336-448b-a84f-5f121b099e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:35.343859 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be129574-9336-448b-a84f-5f121b099e4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:35.344246 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be129574-9336-448b-a84f-5f121b099e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:35.344597 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be129574-9336-448b-a84f-5f121b099e4b admin admin] PATH_INFO: `/v3/projects/9ea6041a215d4833b73f85819f5033f9` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:35.345972 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be129574-9336-448b-a84f-5f121b099e4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ea6041a215d4833b73f85819f5033f9)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:35.347985 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be129574-9336-448b-a84f-5f121b099e4b admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:35.457771 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:35.464723 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-be129574-9336-448b-a84f-5f121b099e4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ea6041a215d4833b73f85819f5033f9', 'request_id': 'req-be129574-9336-448b-a84f-5f121b099e4b'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:35.555561 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-be129574-9336-448b-a84f-5f121b099e4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ea6041a215d4833b73f85819f5033f9', 'request_id': 'req-be129574-9336-448b-a84f-5f121b099e4b'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:35.567332 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-be129574-9336-448b-a84f-5f121b099e4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ea6041a215d4833b73f85819f5033f9', 'request_id': 'req-be129574-9336-448b-a84f-5f121b099e4b'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:35.616387 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-be129574-9336-448b-a84f-5f121b099e4b admin admin] The token cache is being invalidate because project 9ea6041a215d4833b73f85819f5033f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:16:35.617069 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-be129574-9336-448b-a84f-5f121b099e4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:35.619601 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-be129574-9336-448b-a84f-5f121b099e4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:35.632224 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1153/2299] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:16:35 2022] DELETE /identity/v3/projects/9ea6041a215d4833b73f85819f5033f9 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:16:40.199020 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e29ee-8cd0-4a28-a2cd-a0d43d7c3d4d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:40.199512 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e29ee-8cd0-4a28-a2cd-a0d43d7c3d4d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:40.199634 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e29ee-8cd0-4a28-a2cd-a0d43d7c3d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:40.220042 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-382e29ee-8cd0-4a28-a2cd-a0d43d7c3d4d None None] MFA Rules not processed for user `3c90765757a34c6291c9980a7d5d5c79`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:16:40.221312 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-382e29ee-8cd0-4a28-a2cd-a0d43d7c3d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:40.281184 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1147/2300] 10.222.0.45 () {58 vars in 967 bytes} [Wed Oct 26 11:16:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:16:40.305151 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be129574-9336-448b-a84f-5f121b099e4b admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:40.306684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-be129574-9336-448b-a84f-5f121b099e4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:40.389271 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be129574-9336-448b-a84f-5f121b099e4b admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:40.396184 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b153a4d-7afe-4e3b-8580-81961ac57ed6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21b84cc38a848de8d19a41e1eb04a58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:40.396840 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b153a4d-7afe-4e3b-8580-81961ac57ed6 service swift] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:40.397125 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b153a4d-7afe-4e3b-8580-81961ac57ed6 service swift] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:40.397404 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b153a4d-7afe-4e3b-8580-81961ac57ed6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:40.406903 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b153a4d-7afe-4e3b-8580-81961ac57ed6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:40.408570 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b153a4d-7afe-4e3b-8580-81961ac57ed6 service swift] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:40.416899 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1154/2301] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Oct 26 11:16:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 26 11:16:50.274168 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=62 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:50.413459 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=42,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:17:01.647776 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e29ee-8cd0-4a28-a2cd-a0d43d7c3d4d None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:01.649142 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-382e29ee-8cd0-4a28-a2cd-a0d43d7c3d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:17:01.769846 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e29ee-8cd0-4a28-a2cd-a0d43d7c3d4d None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:01.775359 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb4717d-8c50-475b-9a41-83f51f4b21ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:01.776040 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4717d-8c50-475b-9a41-83f51f4b21ac service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:01.776286 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4717d-8c50-475b-9a41-83f51f4b21ac service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:01.776561 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4717d-8c50-475b-9a41-83f51f4b21ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:01.778322 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2eb4717d-8c50-475b-9a41-83f51f4b21ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:17:01.836364 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb4717d-8c50-475b-9a41-83f51f4b21ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:01.837922 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb4717d-8c50-475b-9a41-83f51f4b21ac service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:01.847089 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1148/2302] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:17:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:17:11.842672 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=78 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:17:25.502226 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b153a4d-7afe-4e3b-8580-81961ac57ed6 service swift] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:25.504533 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-3b153a4d-7afe-4e3b-8580-81961ac57ed6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:17:25.600247 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b153a4d-7afe-4e3b-8580-81961ac57ed6 service swift] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:25.604813 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe093c5-b36e-44bf-9d66-5833554f78de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:25.605688 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe093c5-b36e-44bf-9d66-5833554f78de service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:25.605976 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe093c5-b36e-44bf-9d66-5833554f78de service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:25.606243 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe093c5-b36e-44bf-9d66-5833554f78de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:25.608038 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-ffe093c5-b36e-44bf-9d66-5833554f78de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:17:25.696313 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe093c5-b36e-44bf-9d66-5833554f78de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:25.697681 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe093c5-b36e-44bf-9d66-5833554f78de service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:25.716985 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1155/2303] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:17:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:17:29.215743 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb4717d-8c50-475b-9a41-83f51f4b21ac service nova] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:29.217322 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2eb4717d-8c50-475b-9a41-83f51f4b21ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:17:29.232397 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb4717d-8c50-475b-9a41-83f51f4b21ac service nova] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:29.237750 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd748ba-626d-4b20-a8ba-fef95bd5a8e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:29.238633 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd748ba-626d-4b20-a8ba-fef95bd5a8e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:29.239583 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd748ba-626d-4b20-a8ba-fef95bd5a8e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:29.241242 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd748ba-626d-4b20-a8ba-fef95bd5a8e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:29.244184 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3bd748ba-626d-4b20-a8ba-fef95bd5a8e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:17:29.258330 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd748ba-626d-4b20-a8ba-fef95bd5a8e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:29.259902 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd748ba-626d-4b20-a8ba-fef95bd5a8e0 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:29.275315 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1149/2304] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:17:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:17:29.805894 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe093c5-b36e-44bf-9d66-5833554f78de service neutron] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:29.810174 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-ffe093c5-b36e-44bf-9d66-5833554f78de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:17:29.928147 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:17:29.946277 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe093c5-b36e-44bf-9d66-5833554f78de service neutron] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:29.951311 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9da0a-b1bb-4c2d-84af-87b0bbe430e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4f9a2bba0e748b6a98fa7dea2482ddf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:29.951977 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9da0a-b1bb-4c2d-84af-87b0bbe430e6 service placement] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:29.952507 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9da0a-b1bb-4c2d-84af-87b0bbe430e6 service placement] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:29.952952 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9da0a-b1bb-4c2d-84af-87b0bbe430e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:29.955514 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-cae9da0a-b1bb-4c2d-84af-87b0bbe430e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:17:29.970274 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9da0a-b1bb-4c2d-84af-87b0bbe430e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:29.972831 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9da0a-b1bb-4c2d-84af-87b0bbe430e6 service placement] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:29.978082 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd748ba-626d-4b20-a8ba-fef95bd5a8e0 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:29.979746 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3bd748ba-626d-4b20-a8ba-fef95bd5a8e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:17:29.986189 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1156/2305] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:17:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:17:29.996748 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd748ba-626d-4b20-a8ba-fef95bd5a8e0 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:30.002843 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e9030-8f40-4ca4-862f-ce425251b138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:30.004039 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e9030-8f40-4ca4-862f-ce425251b138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:30.004352 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e9030-8f40-4ca4-862f-ce425251b138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:30.004627 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e9030-8f40-4ca4-862f-ce425251b138 admin admin] PATH_INFO: `/v3/users/fb3a54a17338499eb16ad4c831c0454b` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:30.005765 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e9030-8f40-4ca4-862f-ce425251b138 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb3a54a17338499eb16ad4c831c0454b)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:30.009092 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e9030-8f40-4ca4-862f-ce425251b138 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:30.174032 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-122e9030-8f40-4ca4-862f-ce425251b138 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb3a54a17338499eb16ad4c831c0454b'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:30.257850 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-122e9030-8f40-4ca4-862f-ce425251b138 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb3a54a17338499eb16ad4c831c0454b'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:30.277703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-122e9030-8f40-4ca4-862f-ce425251b138 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb3a54a17338499eb16ad4c831c0454b'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:30.285465 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-122e9030-8f40-4ca4-862f-ce425251b138 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb3a54a17338499eb16ad4c831c0454b'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:30.286218 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-122e9030-8f40-4ca4-862f-ce425251b138 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb3a54a17338499eb16ad4c831c0454b'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:30.292503 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1150/2306] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:17:29 2022] DELETE /identity/v3/users/fb3a54a17338499eb16ad4c831c0454b => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:17:30.545646 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9da0a-b1bb-4c2d-84af-87b0bbe430e6 service placement] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:30.556028 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9da0a-b1bb-4c2d-84af-87b0bbe430e6 service placement] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:30.620328 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc2a35-cf83-4c05-89c4-d508f1680e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:30.620977 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc2a35-cf83-4c05-89c4-d508f1680e03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:30.622030 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc2a35-cf83-4c05-89c4-d508f1680e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:30.622325 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc2a35-cf83-4c05-89c4-d508f1680e03 admin admin] PATH_INFO: `/v3/projects/44dc1945c1304de18ba90d15bcf76604` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:30.623620 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffc2a35-cf83-4c05-89c4-d508f1680e03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44dc1945c1304de18ba90d15bcf76604)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:30.626189 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffc2a35-cf83-4c05-89c4-d508f1680e03 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:30.763302 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-4ffc2a35-cf83-4c05-89c4-d508f1680e03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44dc1945c1304de18ba90d15bcf76604', 'request_id': 'req-4ffc2a35-cf83-4c05-89c4-d508f1680e03'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:30.838956 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-4ffc2a35-cf83-4c05-89c4-d508f1680e03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44dc1945c1304de18ba90d15bcf76604', 'request_id': 'req-4ffc2a35-cf83-4c05-89c4-d508f1680e03'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:30.847778 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-4ffc2a35-cf83-4c05-89c4-d508f1680e03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44dc1945c1304de18ba90d15bcf76604', 'request_id': 'req-4ffc2a35-cf83-4c05-89c4-d508f1680e03'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:30.861056 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-4ffc2a35-cf83-4c05-89c4-d508f1680e03 admin admin] The token cache is being invalidate because project 44dc1945c1304de18ba90d15bcf76604 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:17:30.866424 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-4ffc2a35-cf83-4c05-89c4-d508f1680e03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:30.866424 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-4ffc2a35-cf83-4c05-89c4-d508f1680e03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:30.866424 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1157/2307] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:17:30 2022] DELETE /identity/v3/projects/44dc1945c1304de18ba90d15bcf76604 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:17:30.869175 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda1781-1453-4457-9b95-d92fdfdf89f1 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:30.869509 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda1781-1453-4457-9b95-d92fdfdf89f1 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:30.869797 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda1781-1453-4457-9b95-d92fdfdf89f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:30.934360 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-7cda1781-1453-4457-9b95-d92fdfdf89f1 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:17:30.935597 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7cda1781-1453-4457-9b95-d92fdfdf89f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:17:31.014580 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1151/2308] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:17:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:17:31.028552 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da9ea7-24af-4fb0-b1a6-cb644969f86f None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:31.028850 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da9ea7-24af-4fb0-b1a6-cb644969f86f None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:31.029114 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da9ea7-24af-4fb0-b1a6-cb644969f86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:31.055449 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-50da9ea7-24af-4fb0-b1a6-cb644969f86f None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:17:31.056793 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-50da9ea7-24af-4fb0-b1a6-cb644969f86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:17:31.065371 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1158/2309] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:17:31.070579 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda1781-1453-4457-9b95-d92fdfdf89f1 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:31.082118 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda1781-1453-4457-9b95-d92fdfdf89f1 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:31.087274 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7370c-0d4b-4792-bd6d-0b2d6212fad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:31.087985 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7370c-0d4b-4792-bd6d-0b2d6212fad5 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:31.088424 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7370c-0d4b-4792-bd6d-0b2d6212fad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:31.088776 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7370c-0d4b-4792-bd6d-0b2d6212fad5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:31.089585 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e7370c-0d4b-4792-bd6d-0b2d6212fad5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:17:31.089970 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e7370c-0d4b-4792-bd6d-0b2d6212fad5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:31.091548 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e7370c-0d4b-4792-bd6d-0b2d6212fad5 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:31.107952 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1152/2310] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:17:31.112917 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da9ea7-24af-4fb0-b1a6-cb644969f86f None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:31.122958 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da9ea7-24af-4fb0-b1a6-cb644969f86f None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:31.128597 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec674cc-3596-49b1-88c7-4cdfd225ba8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:31.129337 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec674cc-3596-49b1-88c7-4cdfd225ba8a admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:31.129689 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec674cc-3596-49b1-88c7-4cdfd225ba8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:31.130032 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec674cc-3596-49b1-88c7-4cdfd225ba8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:31.130819 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec674cc-3596-49b1-88c7-4cdfd225ba8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:31.132844 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec674cc-3596-49b1-88c7-4cdfd225ba8a admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:31.272461 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1159/2311] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:17:31 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:17:31.276723 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7370c-0d4b-4792-bd6d-0b2d6212fad5 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:31.287328 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7370c-0d4b-4792-bd6d-0b2d6212fad5 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:31.303720 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:17:31.385763 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91899f9b-ddb1-41b2-86e1-e193dd034221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:31.386517 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91899f9b-ddb1-41b2-86e1-e193dd034221 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:31.387335 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91899f9b-ddb1-41b2-86e1-e193dd034221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:31.387335 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91899f9b-ddb1-41b2-86e1-e193dd034221 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:31.388002 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91899f9b-ddb1-41b2-86e1-e193dd034221 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:31.390467 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91899f9b-ddb1-41b2-86e1-e193dd034221 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:31.486732 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1153/2312] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:17:31 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:17:31.492140 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec674cc-3596-49b1-88c7-4cdfd225ba8a admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:31.505485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec674cc-3596-49b1-88c7-4cdfd225ba8a admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:31.515098 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf455041-d266-4b49-ba9f-ff9d7a9bdd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:31.516017 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf455041-d266-4b49-ba9f-ff9d7a9bdd4e admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:31.516542 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf455041-d266-4b49-ba9f-ff9d7a9bdd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:31.516884 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf455041-d266-4b49-ba9f-ff9d7a9bdd4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:31.517721 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf455041-d266-4b49-ba9f-ff9d7a9bdd4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:31.519519 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf455041-d266-4b49-ba9f-ff9d7a9bdd4e admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:31.538203 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1160/2313] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:17:31.539071 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91899f9b-ddb1-41b2-86e1-e193dd034221 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:31.561483 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91899f9b-ddb1-41b2-86e1-e193dd034221 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:31.568612 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df6b04-c1f8-49cb-8552-08828d0f61a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:31.569808 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df6b04-c1f8-49cb-8552-08828d0f61a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:31.570267 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df6b04-c1f8-49cb-8552-08828d0f61a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:31.570548 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df6b04-c1f8-49cb-8552-08828d0f61a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:31.571229 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7df6b04-c1f8-49cb-8552-08828d0f61a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:31.573202 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7df6b04-c1f8-49cb-8552-08828d0f61a7 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:31.595744 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1154/2314] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:17:31.598351 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf455041-d266-4b49-ba9f-ff9d7a9bdd4e admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:31.614014 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf455041-d266-4b49-ba9f-ff9d7a9bdd4e admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:31.619287 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6ed65-f580-42e4-9718-8c64d900e41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:31.620107 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6ed65-f580-42e4-9718-8c64d900e41b admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:31.628007 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6ed65-f580-42e4-9718-8c64d900e41b admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:31.628007 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6ed65-f580-42e4-9718-8c64d900e41b admin admin] PATH_INFO: `/v3/projects/3c58e907109248188aacd4d5ed3ffadd/users/81523f532f3549589780b2881f857fff/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:31.639689 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d6ed65-f580-42e4-9718-8c64d900e41b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c58e907109248188aacd4d5ed3ffadd, user_id=81523f532f3549589780b2881f857fff, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:31.642838 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d6ed65-f580-42e4-9718-8c64d900e41b admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:31.703169 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:17:31.711600 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1161/2315] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:17:31 2022] PUT /identity/v3/projects/3c58e907109248188aacd4d5ed3ffadd/users/81523f532f3549589780b2881f857fff/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:17:31.717315 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0112e88-82eb-4ee3-bed7-3161f9f99fe5 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:31.717315 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0112e88-82eb-4ee3-bed7-3161f9f99fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:31.717315 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0112e88-82eb-4ee3-bed7-3161f9f99fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:31.744563 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-c0112e88-82eb-4ee3-bed7-3161f9f99fe5 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:17:31.746127 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c0112e88-82eb-4ee3-bed7-3161f9f99fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:17:31.833079 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1155/2316] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:17:31.845543 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6ed65-f580-42e4-9718-8c64d900e41b admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:31.848905 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-35d6ed65-f580-42e4-9718-8c64d900e41b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:17:31.909019 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6ed65-f580-42e4-9718-8c64d900e41b admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:31.912711 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324d670-f288-4e5f-ab99-c2e30ac30b09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:31.913328 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324d670-f288-4e5f-ab99-c2e30ac30b09 service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:31.913610 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324d670-f288-4e5f-ab99-c2e30ac30b09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:31.913885 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324d670-f288-4e5f-ab99-c2e30ac30b09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:31.924530 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324d670-f288-4e5f-ab99-c2e30ac30b09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:31.926239 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324d670-f288-4e5f-ab99-c2e30ac30b09 service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:31.936460 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1162/2317] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:17:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:17:34.098129 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0112e88-82eb-4ee3-bed7-3161f9f99fe5 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:34.099626 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c0112e88-82eb-4ee3-bed7-3161f9f99fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:17:34.114581 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0112e88-82eb-4ee3-bed7-3161f9f99fe5 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:34.119692 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc77756-8e14-490a-b1b0-b031292a0c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:34.123911 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc77756-8e14-490a-b1b0-b031292a0c6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:34.123911 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc77756-8e14-490a-b1b0-b031292a0c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:34.123911 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc77756-8e14-490a-b1b0-b031292a0c6b admin admin] PATH_INFO: `/v3/users/1519c41b8f9e4724b520bab8f741b783` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:34.123911 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc77756-8e14-490a-b1b0-b031292a0c6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1519c41b8f9e4724b520bab8f741b783)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:34.124509 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc77756-8e14-490a-b1b0-b031292a0c6b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:34.352178 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-bfc77756-8e14-490a-b1b0-b031292a0c6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1519c41b8f9e4724b520bab8f741b783'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:34.427958 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-bfc77756-8e14-490a-b1b0-b031292a0c6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1519c41b8f9e4724b520bab8f741b783'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:34.445470 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-bfc77756-8e14-490a-b1b0-b031292a0c6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1519c41b8f9e4724b520bab8f741b783'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:34.455481 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-bfc77756-8e14-490a-b1b0-b031292a0c6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1519c41b8f9e4724b520bab8f741b783'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:34.457252 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-bfc77756-8e14-490a-b1b0-b031292a0c6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1519c41b8f9e4724b520bab8f741b783'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:34.465857 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1156/2318] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:17:34 2022] DELETE /identity/v3/users/1519c41b8f9e4724b520bab8f741b783 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:17:34.768234 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324d670-f288-4e5f-ab99-c2e30ac30b09 service neutron] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:34.782916 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324d670-f288-4e5f-ab99-c2e30ac30b09 service neutron] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:34.870428 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927dc57e-156b-4dd9-a48b-120af3863505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:34.871164 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927dc57e-156b-4dd9-a48b-120af3863505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:34.871775 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927dc57e-156b-4dd9-a48b-120af3863505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:34.872305 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927dc57e-156b-4dd9-a48b-120af3863505 admin admin] PATH_INFO: `/v3/projects/3e30b770d9ce4d46a5b0f46a07dc650f` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:34.877892 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927dc57e-156b-4dd9-a48b-120af3863505 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e30b770d9ce4d46a5b0f46a07dc650f)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:34.877892 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927dc57e-156b-4dd9-a48b-120af3863505 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:34.966967 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-927dc57e-156b-4dd9-a48b-120af3863505 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e30b770d9ce4d46a5b0f46a07dc650f', 'request_id': 'req-927dc57e-156b-4dd9-a48b-120af3863505'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:35.033436 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-927dc57e-156b-4dd9-a48b-120af3863505 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e30b770d9ce4d46a5b0f46a07dc650f', 'request_id': 'req-927dc57e-156b-4dd9-a48b-120af3863505'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:35.041694 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-927dc57e-156b-4dd9-a48b-120af3863505 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e30b770d9ce4d46a5b0f46a07dc650f', 'request_id': 'req-927dc57e-156b-4dd9-a48b-120af3863505'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:35.054938 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-927dc57e-156b-4dd9-a48b-120af3863505 admin admin] The token cache is being invalidate because project 3e30b770d9ce4d46a5b0f46a07dc650f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:17:35.055232 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-927dc57e-156b-4dd9-a48b-120af3863505 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:35.055886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-927dc57e-156b-4dd9-a48b-120af3863505 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:35.057701 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1163/2319] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:17:34 2022] DELETE /identity/v3/projects/3e30b770d9ce4d46a5b0f46a07dc650f => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:17:35.062528 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14480d55-c7a5-4405-9987-9f586e1298a8 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:35.062761 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14480d55-c7a5-4405-9987-9f586e1298a8 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:35.063044 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14480d55-c7a5-4405-9987-9f586e1298a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:35.083671 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:17:35.089816 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-14480d55-c7a5-4405-9987-9f586e1298a8 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:17:35.091123 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-14480d55-c7a5-4405-9987-9f586e1298a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:17:35.151302 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1157/2320] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:17:35.159018 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b28dc9-a502-494f-93ae-49e15d1629d1 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:35.159937 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b28dc9-a502-494f-93ae-49e15d1629d1 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:35.160267 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b28dc9-a502-494f-93ae-49e15d1629d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:35.181215 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-e4b28dc9-a502-494f-93ae-49e15d1629d1 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:17:35.182451 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-e4b28dc9-a502-494f-93ae-49e15d1629d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:17:35.190686 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1164/2321] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:17:35.195017 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14480d55-c7a5-4405-9987-9f586e1298a8 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:35.205071 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14480d55-c7a5-4405-9987-9f586e1298a8 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:35.217193 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e0f49-f360-4b04-a655-06384f5b61ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:35.217920 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e0f49-f360-4b04-a655-06384f5b61ca admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:35.218272 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e0f49-f360-4b04-a655-06384f5b61ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:35.218624 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e0f49-f360-4b04-a655-06384f5b61ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:35.219439 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e0f49-f360-4b04-a655-06384f5b61ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:17:35.219820 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e0f49-f360-4b04-a655-06384f5b61ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:35.222174 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e0f49-f360-4b04-a655-06384f5b61ca admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:35.235539 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1158/2322] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:17:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:17:35.239616 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b28dc9-a502-494f-93ae-49e15d1629d1 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:35.255615 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b28dc9-a502-494f-93ae-49e15d1629d1 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:35.261020 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f6b69-26e4-4387-866b-b34b62fb2787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:35.261760 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f6b69-26e4-4387-866b-b34b62fb2787 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:35.262160 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f6b69-26e4-4387-866b-b34b62fb2787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:35.262540 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f6b69-26e4-4387-866b-b34b62fb2787 admin admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:35.263311 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f6b69-26e4-4387-866b-b34b62fb2787 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:35.265381 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f6b69-26e4-4387-866b-b34b62fb2787 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:35.390708 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1165/2323] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:17:35 2022] POST /identity/v3/projects => generated 383 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:17:35.395122 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e0f49-f360-4b04-a655-06384f5b61ca admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:35.407481 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e0f49-f360-4b04-a655-06384f5b61ca admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:35.485662 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e6114-6bbd-4e71-b805-82bcbe630e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:35.487182 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e6114-6bbd-4e71-b805-82bcbe630e7a admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:35.487182 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e6114-6bbd-4e71-b805-82bcbe630e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:35.487882 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e6114-6bbd-4e71-b805-82bcbe630e7a admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:35.488401 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e6114-6bbd-4e71-b805-82bcbe630e7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:35.490359 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e6114-6bbd-4e71-b805-82bcbe630e7a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:35.580219 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1159/2324] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:17:35 2022] POST /identity/v3/users => generated 292 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:17:35.581535 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f6b69-26e4-4387-866b-b34b62fb2787 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:35.587057 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:17:35.592399 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f6b69-26e4-4387-866b-b34b62fb2787 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:35.598210 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f6bb6-28f1-4697-bb65-1d9a55d7057b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:35.598830 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f6bb6-28f1-4697-bb65-1d9a55d7057b admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:35.599144 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f6bb6-28f1-4697-bb65-1d9a55d7057b admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:35.599471 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f6bb6-28f1-4697-bb65-1d9a55d7057b admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:35.600248 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f6bb6-28f1-4697-bb65-1d9a55d7057b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:35.601874 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f6bb6-28f1-4697-bb65-1d9a55d7057b admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:35.614158 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1166/2325] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:17:35.619352 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e6114-6bbd-4e71-b805-82bcbe630e7a admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:35.630134 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e6114-6bbd-4e71-b805-82bcbe630e7a admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:35.638595 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db8a577-e350-439f-a9cb-0f4ed92ddbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:35.639237 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db8a577-e350-439f-a9cb-0f4ed92ddbde admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:35.639522 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db8a577-e350-439f-a9cb-0f4ed92ddbde admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:35.639803 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db8a577-e350-439f-a9cb-0f4ed92ddbde admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:35.640519 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db8a577-e350-439f-a9cb-0f4ed92ddbde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:35.642550 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db8a577-e350-439f-a9cb-0f4ed92ddbde admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:35.656110 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1160/2326] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:17:35.664039 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f6bb6-28f1-4697-bb65-1d9a55d7057b admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:35.674467 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f6bb6-28f1-4697-bb65-1d9a55d7057b admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:35.680681 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bbfde6-a695-40ae-8100-7c0f49cf3345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:35.681353 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbfde6-a695-40ae-8100-7c0f49cf3345 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:35.681637 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbfde6-a695-40ae-8100-7c0f49cf3345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:35.681935 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbfde6-a695-40ae-8100-7c0f49cf3345 admin admin] PATH_INFO: `/v3/projects/74fd7f933ccb4f52af4c064b0ee0c52f/users/20bb9ef1e9c14633a4f08e3149c98ea4/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:35.697249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bbfde6-a695-40ae-8100-7c0f49cf3345 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74fd7f933ccb4f52af4c064b0ee0c52f, user_id=20bb9ef1e9c14633a4f08e3149c98ea4, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:35.699925 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bbfde6-a695-40ae-8100-7c0f49cf3345 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:35.766155 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1167/2327] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:17:35 2022] PUT /identity/v3/projects/74fd7f933ccb4f52af4c064b0ee0c52f/users/20bb9ef1e9c14633a4f08e3149c98ea4/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:17:35.777164 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083350d-2898-4def-a378-403aff6201a7 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:35.777646 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083350d-2898-4def-a378-403aff6201a7 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:35.777992 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083350d-2898-4def-a378-403aff6201a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:35.810589 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-f083350d-2898-4def-a378-403aff6201a7 None None] MFA Rules not processed for user `20bb9ef1e9c14633a4f08e3149c98ea4`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:17:35.812004 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f083350d-2898-4def-a378-403aff6201a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:17:35.889108 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1161/2328] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:17:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:17:35.901400 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bbfde6-a695-40ae-8100-7c0f49cf3345 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:35.907288 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-40bbfde6-a695-40ae-8100-7c0f49cf3345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:17:36.008966 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bbfde6-a695-40ae-8100-7c0f49cf3345 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:36.021016 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17063ce4-3df9-4faf-8fc4-0350d87e30ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:36.021016 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17063ce4-3df9-4faf-8fc4-0350d87e30ed service nova] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:36.021016 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17063ce4-3df9-4faf-8fc4-0350d87e30ed service nova] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:36.021016 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17063ce4-3df9-4faf-8fc4-0350d87e30ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:36.028285 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17063ce4-3df9-4faf-8fc4-0350d87e30ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:36.030110 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17063ce4-3df9-4faf-8fc4-0350d87e30ed service nova] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:36.043788 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1168/2329] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:17:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:17:38.058298 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999b620-3b89-481a-b232-1633a659765d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:38.058774 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999b620-3b89-481a-b232-1633a659765d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:38.058881 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999b620-3b89-481a-b232-1633a659765d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:38.075334 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:17:38.105546 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-6999b620-3b89-481a-b232-1633a659765d None None] MFA Rules not processed for user `81523f532f3549589780b2881f857fff`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:17:38.107165 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6999b620-3b89-481a-b232-1633a659765d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:17:38.189483 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1162/2330] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:17:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:17:38.203282 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17063ce4-3df9-4faf-8fc4-0350d87e30ed service nova] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:38.215859 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17063ce4-3df9-4faf-8fc4-0350d87e30ed service nova] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:38.222208 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384aa1b-e426-4d29-8cc9-aff661230db6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:38.222828 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384aa1b-e426-4d29-8cc9-aff661230db6 service nova] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:38.223105 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384aa1b-e426-4d29-8cc9-aff661230db6 service nova] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:38.223379 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384aa1b-e426-4d29-8cc9-aff661230db6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:38.232038 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384aa1b-e426-4d29-8cc9-aff661230db6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:38.233638 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384aa1b-e426-4d29-8cc9-aff661230db6 service nova] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:38.243746 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1169/2331] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:17:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:17:40.516090 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f0a73-5790-438f-8554-819216a6cb31 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:40.516611 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f0a73-5790-438f-8554-819216a6cb31 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:40.516808 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f0a73-5790-438f-8554-819216a6cb31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:40.536758 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-e49f0a73-5790-438f-8554-819216a6cb31 None None] MFA Rules not processed for user `81523f532f3549589780b2881f857fff`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:17:40.538031 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e49f0a73-5790-438f-8554-819216a6cb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:17:40.545307 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1163/2332] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:17:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:17:42.465594 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384aa1b-e426-4d29-8cc9-aff661230db6 service nova] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:42.532802 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384aa1b-e426-4d29-8cc9-aff661230db6 service nova] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:42.537567 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a2743-6710-4fd7-ba50-2f17d5e16808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:42.538198 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a2743-6710-4fd7-ba50-2f17d5e16808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:42.538481 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a2743-6710-4fd7-ba50-2f17d5e16808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:42.538787 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a2743-6710-4fd7-ba50-2f17d5e16808 admin admin] PATH_INFO: `/v3/users/20bb9ef1e9c14633a4f08e3149c98ea4` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:42.539951 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a2743-6710-4fd7-ba50-2f17d5e16808 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20bb9ef1e9c14633a4f08e3149c98ea4)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:42.541935 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a2743-6710-4fd7-ba50-2f17d5e16808 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:42.745844 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:17:42.750882 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-952a2743-6710-4fd7-ba50-2f17d5e16808 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20bb9ef1e9c14633a4f08e3149c98ea4'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:42.804030 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-952a2743-6710-4fd7-ba50-2f17d5e16808 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20bb9ef1e9c14633a4f08e3149c98ea4'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:42.817252 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-952a2743-6710-4fd7-ba50-2f17d5e16808 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20bb9ef1e9c14633a4f08e3149c98ea4'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:42.817891 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-952a2743-6710-4fd7-ba50-2f17d5e16808 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20bb9ef1e9c14633a4f08e3149c98ea4'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:42.824882 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-952a2743-6710-4fd7-ba50-2f17d5e16808 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20bb9ef1e9c14633a4f08e3149c98ea4'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:42.830839 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1170/2333] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:17:42 2022] DELETE /identity/v3/users/20bb9ef1e9c14633a4f08e3149c98ea4 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:17:42.835392 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e9f4c-379b-44d1-abe2-52e73c2e61a6 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:42.835879 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e9f4c-379b-44d1-abe2-52e73c2e61a6 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:42.836022 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e9f4c-379b-44d1-abe2-52e73c2e61a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:42.855692 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-0d3e9f4c-379b-44d1-abe2-52e73c2e61a6 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:17:42.856932 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0d3e9f4c-379b-44d1-abe2-52e73c2e61a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:17:42.921875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1164/2334] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:17:42.932145 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a2743-6710-4fd7-ba50-2f17d5e16808 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:42.933550 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-952a2743-6710-4fd7-ba50-2f17d5e16808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:17:42.993101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a2743-6710-4fd7-ba50-2f17d5e16808 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:42.996950 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca72ad6-4ab3-4a0d-bbc3-6a517e00cc4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:42.997562 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca72ad6-4ab3-4a0d-bbc3-6a517e00cc4e service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:42.997843 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca72ad6-4ab3-4a0d-bbc3-6a517e00cc4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:42.998122 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca72ad6-4ab3-4a0d-bbc3-6a517e00cc4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:43.007412 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca72ad6-4ab3-4a0d-bbc3-6a517e00cc4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:43.008862 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca72ad6-4ab3-4a0d-bbc3-6a517e00cc4e service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:43.018352 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1171/2335] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:17:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:17:43.406508 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e9f4c-379b-44d1-abe2-52e73c2e61a6 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:43.408401 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0d3e9f4c-379b-44d1-abe2-52e73c2e61a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:17:43.430056 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e9f4c-379b-44d1-abe2-52e73c2e61a6 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:43.434821 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85181f9a-7009-4767-9b2d-f45206e3fcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:43.435571 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85181f9a-7009-4767-9b2d-f45206e3fcc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:43.435917 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85181f9a-7009-4767-9b2d-f45206e3fcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:43.436295 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85181f9a-7009-4767-9b2d-f45206e3fcc2 admin admin] PATH_INFO: `/v3/projects/74fd7f933ccb4f52af4c064b0ee0c52f` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:43.437624 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85181f9a-7009-4767-9b2d-f45206e3fcc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74fd7f933ccb4f52af4c064b0ee0c52f)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:43.439782 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85181f9a-7009-4767-9b2d-f45206e3fcc2 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:43.570954 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-85181f9a-7009-4767-9b2d-f45206e3fcc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74fd7f933ccb4f52af4c064b0ee0c52f', 'request_id': 'req-85181f9a-7009-4767-9b2d-f45206e3fcc2'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:43.584301 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-85181f9a-7009-4767-9b2d-f45206e3fcc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74fd7f933ccb4f52af4c064b0ee0c52f', 'request_id': 'req-85181f9a-7009-4767-9b2d-f45206e3fcc2'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:43.661785 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-85181f9a-7009-4767-9b2d-f45206e3fcc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74fd7f933ccb4f52af4c064b0ee0c52f', 'request_id': 'req-85181f9a-7009-4767-9b2d-f45206e3fcc2'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:43.678622 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-85181f9a-7009-4767-9b2d-f45206e3fcc2 admin admin] The token cache is being invalidate because project 74fd7f933ccb4f52af4c064b0ee0c52f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:17:43.678979 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-85181f9a-7009-4767-9b2d-f45206e3fcc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:43.679585 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-85181f9a-7009-4767-9b2d-f45206e3fcc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:43.684696 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1165/2336] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:17:43 2022] DELETE /identity/v3/projects/74fd7f933ccb4f52af4c064b0ee0c52f => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:17:43.686550 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfad81-545f-484e-9bb1-5a341948026b None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:43.687052 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfad81-545f-484e-9bb1-5a341948026b None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:43.687151 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfad81-545f-484e-9bb1-5a341948026b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:43.710948 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-97dfad81-545f-484e-9bb1-5a341948026b None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:17:43.712349 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-97dfad81-545f-484e-9bb1-5a341948026b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:17:43.781067 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1172/2337] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:17:43.788757 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1b45e-2691-4bff-bf9d-2b723819d37a None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:43.789299 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1b45e-2691-4bff-bf9d-2b723819d37a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:43.789766 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1b45e-2691-4bff-bf9d-2b723819d37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:43.810728 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-7cc1b45e-2691-4bff-bf9d-2b723819d37a None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:17:43.811982 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7cc1b45e-2691-4bff-bf9d-2b723819d37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:17:43.822229 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1166/2338] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:17:43.826692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfad81-545f-484e-9bb1-5a341948026b None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:43.838198 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfad81-545f-484e-9bb1-5a341948026b None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:43.848956 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99c8e1-2d5d-4fda-a61c-18781ee3fec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:43.849748 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99c8e1-2d5d-4fda-a61c-18781ee3fec9 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:43.850001 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99c8e1-2d5d-4fda-a61c-18781ee3fec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:43.850300 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99c8e1-2d5d-4fda-a61c-18781ee3fec9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:43.850959 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99c8e1-2d5d-4fda-a61c-18781ee3fec9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:17:43.851262 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99c8e1-2d5d-4fda-a61c-18781ee3fec9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:43.852932 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99c8e1-2d5d-4fda-a61c-18781ee3fec9 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:43.866756 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1173/2339] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:17:43.871232 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc1b45e-2691-4bff-bf9d-2b723819d37a None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:43.876503 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:17:43.883348 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc1b45e-2691-4bff-bf9d-2b723819d37a None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:43.891665 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1e71c-b4b8-4832-8827-bf2b9f3c30c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:43.892338 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1e71c-b4b8-4832-8827-bf2b9f3c30c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:43.892624 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1e71c-b4b8-4832-8827-bf2b9f3c30c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:43.892900 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1e71c-b4b8-4832-8827-bf2b9f3c30c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:43.893549 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa1e71c-b4b8-4832-8827-bf2b9f3c30c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:43.896620 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa1e71c-b4b8-4832-8827-bf2b9f3c30c3 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:44.031890 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1167/2340] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:17:43 2022] POST /identity/v3/projects => generated 367 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:17:44.033122 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99c8e1-2d5d-4fda-a61c-18781ee3fec9 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:44.043858 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99c8e1-2d5d-4fda-a61c-18781ee3fec9 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:44.087623 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:17:44.100310 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce911bc0-a835-4215-8810-59fa8d3cb17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:44.101355 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce911bc0-a835-4215-8810-59fa8d3cb17a admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:44.101355 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce911bc0-a835-4215-8810-59fa8d3cb17a admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:44.101561 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce911bc0-a835-4215-8810-59fa8d3cb17a admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:44.102076 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce911bc0-a835-4215-8810-59fa8d3cb17a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:44.103983 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce911bc0-a835-4215-8810-59fa8d3cb17a admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:44.187104 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1174/2341] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:17:44 2022] POST /identity/v3/users => generated 284 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:17:44.191238 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1e71c-b4b8-4832-8827-bf2b9f3c30c3 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:44.201443 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1e71c-b4b8-4832-8827-bf2b9f3c30c3 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:44.206054 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53725453-9e93-43e4-84fa-9a7df5a93ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:44.206658 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53725453-9e93-43e4-84fa-9a7df5a93ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:44.207955 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53725453-9e93-43e4-84fa-9a7df5a93ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:44.207955 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53725453-9e93-43e4-84fa-9a7df5a93ec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:44.208503 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53725453-9e93-43e4-84fa-9a7df5a93ec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:44.210115 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53725453-9e93-43e4-84fa-9a7df5a93ec2 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:44.220237 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1168/2342] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:17:44.224809 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce911bc0-a835-4215-8810-59fa8d3cb17a admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:44.235325 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce911bc0-a835-4215-8810-59fa8d3cb17a admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:44.240305 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cbf1c4-b0eb-4db2-9ca8-42d19209cd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:44.240918 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbf1c4-b0eb-4db2-9ca8-42d19209cd9b admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:44.241201 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbf1c4-b0eb-4db2-9ca8-42d19209cd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:44.241615 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbf1c4-b0eb-4db2-9ca8-42d19209cd9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:44.242494 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cbf1c4-b0eb-4db2-9ca8-42d19209cd9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:44.244996 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cbf1c4-b0eb-4db2-9ca8-42d19209cd9b admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:44.256826 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1175/2343] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:17:44.260694 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53725453-9e93-43e4-84fa-9a7df5a93ec2 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:44.272499 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53725453-9e93-43e4-84fa-9a7df5a93ec2 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:44.277494 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528e758-a27c-4fb0-9641-68168ce1c71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:44.278986 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528e758-a27c-4fb0-9641-68168ce1c71f admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:44.278986 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528e758-a27c-4fb0-9641-68168ce1c71f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:44.278986 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528e758-a27c-4fb0-9641-68168ce1c71f admin admin] PATH_INFO: `/v3/projects/6b3567e45259463a8e1f60195e740e5c/users/c7eb3ce24c784e55b530f14b69ffb1ee/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:44.295567 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4528e758-a27c-4fb0-9641-68168ce1c71f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b3567e45259463a8e1f60195e740e5c, user_id=c7eb3ce24c784e55b530f14b69ffb1ee, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:44.298248 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4528e758-a27c-4fb0-9641-68168ce1c71f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:44.412217 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1169/2344] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:17:44 2022] PUT /identity/v3/projects/6b3567e45259463a8e1f60195e740e5c/users/c7eb3ce24c784e55b530f14b69ffb1ee/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:17:44.422735 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602c8c2-7b6c-4c97-9e92-334c4da266cd None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:44.423022 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602c8c2-7b6c-4c97-9e92-334c4da266cd None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:44.423288 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602c8c2-7b6c-4c97-9e92-334c4da266cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:44.452784 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-6602c8c2-7b6c-4c97-9e92-334c4da266cd None None] MFA Rules not processed for user `c7eb3ce24c784e55b530f14b69ffb1ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:17:44.454092 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-6602c8c2-7b6c-4c97-9e92-334c4da266cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:17:44.527264 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1176/2345] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:17:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:17:44.538688 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528e758-a27c-4fb0-9641-68168ce1c71f admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:44.541387 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4528e758-a27c-4fb0-9641-68168ce1c71f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:17:44.663022 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528e758-a27c-4fb0-9641-68168ce1c71f admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:44.667557 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e508a82-9a77-452c-958b-1ec78cc137a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:44.668276 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e508a82-9a77-452c-958b-1ec78cc137a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:44.672107 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e508a82-9a77-452c-958b-1ec78cc137a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:44.672107 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e508a82-9a77-452c-958b-1ec78cc137a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:44.685792 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e508a82-9a77-452c-958b-1ec78cc137a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:44.687364 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e508a82-9a77-452c-958b-1ec78cc137a6 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:44.701005 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1170/2346] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:17:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:17:54.524094 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=44,keystone:INSERT=3 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:17:54.611281 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602c8c2-7b6c-4c97-9e92-334c4da266cd None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:54.694672 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602c8c2-7b6c-4c97-9e92-334c4da266cd None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:54.696976 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=58,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:17:54.699636 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3c6e0-a61f-4659-b76a-4010e6f3b388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:54.700412 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3c6e0-a61f-4659-b76a-4010e6f3b388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:54.700798 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3c6e0-a61f-4659-b76a-4010e6f3b388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:54.701150 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3c6e0-a61f-4659-b76a-4010e6f3b388 admin admin] PATH_INFO: `/v3/users/c7eb3ce24c784e55b530f14b69ffb1ee` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:54.702410 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be3c6e0-a61f-4659-b76a-4010e6f3b388 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7eb3ce24c784e55b530f14b69ffb1ee)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:54.704466 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be3c6e0-a61f-4659-b76a-4010e6f3b388 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:54.896574 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-6be3c6e0-a61f-4659-b76a-4010e6f3b388 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7eb3ce24c784e55b530f14b69ffb1ee'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:54.981153 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-6be3c6e0-a61f-4659-b76a-4010e6f3b388 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7eb3ce24c784e55b530f14b69ffb1ee'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:54.996833 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-6be3c6e0-a61f-4659-b76a-4010e6f3b388 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7eb3ce24c784e55b530f14b69ffb1ee'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:54.996833 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-6be3c6e0-a61f-4659-b76a-4010e6f3b388 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7eb3ce24c784e55b530f14b69ffb1ee'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:55.004474 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-6be3c6e0-a61f-4659-b76a-4010e6f3b388 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7eb3ce24c784e55b530f14b69ffb1ee'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:55.011927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1177/2347] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:17:54 2022] DELETE /identity/v3/users/c7eb3ce24c784e55b530f14b69ffb1ee => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:17:55.016342 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae88647-1884-48c2-ae10-210d9533ab6f None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:55.016674 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae88647-1884-48c2-ae10-210d9533ab6f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:55.016900 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae88647-1884-48c2-ae10-210d9533ab6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:55.038197 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-3ae88647-1884-48c2-ae10-210d9533ab6f None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:17:55.039446 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3ae88647-1884-48c2-ae10-210d9533ab6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:17:55.105032 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1171/2348] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:17:55.115061 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3c6e0-a61f-4659-b76a-4010e6f3b388 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:55.116926 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-6be3c6e0-a61f-4659-b76a-4010e6f3b388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:17:55.179641 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3c6e0-a61f-4659-b76a-4010e6f3b388 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:55.183480 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7c747-0c78-4880-b120-e2eab2cd050d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:55.184132 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7c747-0c78-4880-b120-e2eab2cd050d service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:55.184417 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7c747-0c78-4880-b120-e2eab2cd050d service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:55.184691 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7c747-0c78-4880-b120-e2eab2cd050d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:55.195963 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7c747-0c78-4880-b120-e2eab2cd050d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:55.197469 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7c747-0c78-4880-b120-e2eab2cd050d service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:55.208261 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1178/2349] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:17:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:17:55.715199 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae88647-1884-48c2-ae10-210d9533ab6f None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:55.716126 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3ae88647-1884-48c2-ae10-210d9533ab6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:17:55.731671 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae88647-1884-48c2-ae10-210d9533ab6f None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:55.747715 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc85e0-3b21-45a7-aa59-9e21735aac91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:55.748436 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc85e0-3b21-45a7-aa59-9e21735aac91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:55.748718 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc85e0-3b21-45a7-aa59-9e21735aac91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:55.748994 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc85e0-3b21-45a7-aa59-9e21735aac91 admin admin] PATH_INFO: `/v3/projects/6b3567e45259463a8e1f60195e740e5c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:55.750138 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc85e0-3b21-45a7-aa59-9e21735aac91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b3567e45259463a8e1f60195e740e5c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:55.752143 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc85e0-3b21-45a7-aa59-9e21735aac91 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:55.931074 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4dbc85e0-3b21-45a7-aa59-9e21735aac91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b3567e45259463a8e1f60195e740e5c', 'request_id': 'req-4dbc85e0-3b21-45a7-aa59-9e21735aac91'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:55.937771 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4dbc85e0-3b21-45a7-aa59-9e21735aac91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b3567e45259463a8e1f60195e740e5c', 'request_id': 'req-4dbc85e0-3b21-45a7-aa59-9e21735aac91'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:56.009111 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4dbc85e0-3b21-45a7-aa59-9e21735aac91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b3567e45259463a8e1f60195e740e5c', 'request_id': 'req-4dbc85e0-3b21-45a7-aa59-9e21735aac91'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:56.021113 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4dbc85e0-3b21-45a7-aa59-9e21735aac91 admin admin] The token cache is being invalidate because project 6b3567e45259463a8e1f60195e740e5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:17:56.021400 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4dbc85e0-3b21-45a7-aa59-9e21735aac91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:56.022015 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4dbc85e0-3b21-45a7-aa59-9e21735aac91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:56.023489 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1172/2350] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:17:55 2022] DELETE /identity/v3/projects/6b3567e45259463a8e1f60195e740e5c => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:17:56.028377 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8973b-fe1e-412b-ae92-7ea354f36595 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:56.028832 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8973b-fe1e-412b-ae92-7ea354f36595 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:56.031816 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8973b-fe1e-412b-ae92-7ea354f36595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:56.049671 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-2ee8973b-fe1e-412b-ae92-7ea354f36595 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:17:56.050864 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-2ee8973b-fe1e-412b-ae92-7ea354f36595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:17:56.067465 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:17:56.109648 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1179/2351] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:17:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:17:56.118898 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870d551-baed-4d88-aba2-815a13501d07 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:56.119255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870d551-baed-4d88-aba2-815a13501d07 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:56.119540 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870d551-baed-4d88-aba2-815a13501d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:56.139893 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-4870d551-baed-4d88-aba2-815a13501d07 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:17:56.141300 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4870d551-baed-4d88-aba2-815a13501d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:17:56.150110 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1173/2352] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:17:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:17:56.154250 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8973b-fe1e-412b-ae92-7ea354f36595 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:56.164796 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8973b-fe1e-412b-ae92-7ea354f36595 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:56.169362 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ac4cd-4b77-4a95-92ee-8f8d5526f841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:56.169960 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ac4cd-4b77-4a95-92ee-8f8d5526f841 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:56.170240 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ac4cd-4b77-4a95-92ee-8f8d5526f841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:56.170515 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ac4cd-4b77-4a95-92ee-8f8d5526f841 admin admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:56.171158 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ac4cd-4b77-4a95-92ee-8f8d5526f841 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:17:56.171463 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ac4cd-4b77-4a95-92ee-8f8d5526f841 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:56.173084 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ac4cd-4b77-4a95-92ee-8f8d5526f841 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:56.184503 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1180/2353] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:17:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:17:56.188798 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870d551-baed-4d88-aba2-815a13501d07 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:56.198088 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870d551-baed-4d88-aba2-815a13501d07 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:56.202664 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be36a2-1592-41a2-b961-f35f820effba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:56.203277 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be36a2-1592-41a2-b961-f35f820effba admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:56.203558 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be36a2-1592-41a2-b961-f35f820effba admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:56.203837 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be36a2-1592-41a2-b961-f35f820effba admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:56.204510 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be36a2-1592-41a2-b961-f35f820effba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:56.206395 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be36a2-1592-41a2-b961-f35f820effba admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:56.284340 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1174/2354] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:17:56 2022] POST /identity/v3/projects => generated 365 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:17:56.288501 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ac4cd-4b77-4a95-92ee-8f8d5526f841 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:56.298333 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ac4cd-4b77-4a95-92ee-8f8d5526f841 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:56.355236 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b566d3-5b28-4887-bb4c-18ec839c638d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:56.355846 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b566d3-5b28-4887-bb4c-18ec839c638d admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:56.356162 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b566d3-5b28-4887-bb4c-18ec839c638d admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:56.356439 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b566d3-5b28-4887-bb4c-18ec839c638d admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:56.357076 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b566d3-5b28-4887-bb4c-18ec839c638d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:56.359257 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b566d3-5b28-4887-bb4c-18ec839c638d admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:56.432382 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1181/2355] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:17:56 2022] POST /identity/v3/users => generated 283 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:17:56.436460 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be36a2-1592-41a2-b961-f35f820effba admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:56.447147 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be36a2-1592-41a2-b961-f35f820effba admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:56.451781 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a41367-908c-447d-ac9c-81af00654efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:56.452417 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a41367-908c-447d-ac9c-81af00654efb admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:56.452701 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a41367-908c-447d-ac9c-81af00654efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:56.452973 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a41367-908c-447d-ac9c-81af00654efb admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:56.453610 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a41367-908c-447d-ac9c-81af00654efb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:56.455230 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a41367-908c-447d-ac9c-81af00654efb admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:56.465746 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1175/2356] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:17:56.469478 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b566d3-5b28-4887-bb4c-18ec839c638d admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:56.479214 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b566d3-5b28-4887-bb4c-18ec839c638d admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:56.483774 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9279c7d-a183-486d-8d11-777e6201267f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:56.484650 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9279c7d-a183-486d-8d11-777e6201267f admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:56.484924 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9279c7d-a183-486d-8d11-777e6201267f admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:56.485194 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9279c7d-a183-486d-8d11-777e6201267f admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:56.485824 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9279c7d-a183-486d-8d11-777e6201267f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:56.487418 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9279c7d-a183-486d-8d11-777e6201267f admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:56.497824 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1182/2357] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:17:56.501725 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a41367-908c-447d-ac9c-81af00654efb admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:56.511942 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a41367-908c-447d-ac9c-81af00654efb admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:56.516495 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313b66c-9dd9-4255-b6ed-f960b4d9276a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:56.517131 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313b66c-9dd9-4255-b6ed-f960b4d9276a admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:56.517411 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313b66c-9dd9-4255-b6ed-f960b4d9276a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:56.517685 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313b66c-9dd9-4255-b6ed-f960b4d9276a admin admin] PATH_INFO: `/v3/projects/5df729e35fec4837958245669616ab34/users/0fce6a92eb2e4eafa075b2d276452d47/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:56.533808 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f313b66c-9dd9-4255-b6ed-f960b4d9276a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5df729e35fec4837958245669616ab34, user_id=0fce6a92eb2e4eafa075b2d276452d47, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:56.536519 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f313b66c-9dd9-4255-b6ed-f960b4d9276a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:56.615837 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1176/2358] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:17:56 2022] PUT /identity/v3/projects/5df729e35fec4837958245669616ab34/users/0fce6a92eb2e4eafa075b2d276452d47/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:17:56.626226 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4acfae-eb41-47a1-acdd-a278a7ced629 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:56.626530 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4acfae-eb41-47a1-acdd-a278a7ced629 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:56.626802 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4acfae-eb41-47a1-acdd-a278a7ced629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:56.655179 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-ed4acfae-eb41-47a1-acdd-a278a7ced629 None None] MFA Rules not processed for user `0fce6a92eb2e4eafa075b2d276452d47`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:17:56.656423 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-ed4acfae-eb41-47a1-acdd-a278a7ced629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:17:56.718823 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1183/2359] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:17:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:17:56.723219 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313b66c-9dd9-4255-b6ed-f960b4d9276a admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:56.744355 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:17:56.783976 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313b66c-9dd9-4255-b6ed-f960b4d9276a admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:56.788772 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce591f4-bb55-45da-a0c3-14d140c9181d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:56.789385 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce591f4-bb55-45da-a0c3-14d140c9181d admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:56.789667 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce591f4-bb55-45da-a0c3-14d140c9181d admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:56.789940 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce591f4-bb55-45da-a0c3-14d140c9181d admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:56.790587 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce591f4-bb55-45da-a0c3-14d140c9181d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:56.792867 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce591f4-bb55-45da-a0c3-14d140c9181d admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:56.952661 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1177/2360] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:17:56 2022] POST /identity/v3/projects => generated 363 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:17:56.953904 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4acfae-eb41-47a1-acdd-a278a7ced629 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:56.964888 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4acfae-eb41-47a1-acdd-a278a7ced629 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:56.980984 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:17:57.027841 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd6331-3930-457e-a4e4-0f3737c73f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:57.028495 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd6331-3930-457e-a4e4-0f3737c73f5a admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:57.029039 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd6331-3930-457e-a4e4-0f3737c73f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:57.029039 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd6331-3930-457e-a4e4-0f3737c73f5a admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:57.029704 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd6331-3930-457e-a4e4-0f3737c73f5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:57.031661 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd6331-3930-457e-a4e4-0f3737c73f5a admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:57.100910 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1184/2361] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:17:56 2022] POST /identity/v3/users => generated 288 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:17:57.104819 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce591f4-bb55-45da-a0c3-14d140c9181d admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:57.116259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce591f4-bb55-45da-a0c3-14d140c9181d admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:57.121019 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a70d5-96bc-4996-92b2-28010f36ccce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:57.121621 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a70d5-96bc-4996-92b2-28010f36ccce admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:57.121907 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a70d5-96bc-4996-92b2-28010f36ccce admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:57.122183 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a70d5-96bc-4996-92b2-28010f36ccce admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:57.122828 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1a70d5-96bc-4996-92b2-28010f36ccce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:57.124468 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1a70d5-96bc-4996-92b2-28010f36ccce admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:57.134911 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1178/2362] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:17:57.138895 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd6331-3930-457e-a4e4-0f3737c73f5a admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:57.148787 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd6331-3930-457e-a4e4-0f3737c73f5a admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:57.153335 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3184e57-f767-47c5-948b-80709bc0bb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:57.153977 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3184e57-f767-47c5-948b-80709bc0bb6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:57.154258 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3184e57-f767-47c5-948b-80709bc0bb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:57.154531 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3184e57-f767-47c5-948b-80709bc0bb6b admin admin] PATH_INFO: `/v3/projects/cd4a5e7794a34c5b909a51e153331feb/users/bcf26d2ffd26411d856e5630f022d4d1/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:57.170639 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3184e57-f767-47c5-948b-80709bc0bb6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd4a5e7794a34c5b909a51e153331feb, user_id=bcf26d2ffd26411d856e5630f022d4d1, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:57.173309 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3184e57-f767-47c5-948b-80709bc0bb6b admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:57.231820 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1185/2363] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:17:57 2022] PUT /identity/v3/projects/cd4a5e7794a34c5b909a51e153331feb/users/bcf26d2ffd26411d856e5630f022d4d1/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:17:57.236173 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a70d5-96bc-4996-92b2-28010f36ccce admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:57.246689 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a70d5-96bc-4996-92b2-28010f36ccce admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:57.309757 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74937f0-d024-48fd-be8e-28308c1c2b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:57.310373 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74937f0-d024-48fd-be8e-28308c1c2b20 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:57.310686 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74937f0-d024-48fd-be8e-28308c1c2b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:57.310959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74937f0-d024-48fd-be8e-28308c1c2b20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:57.311594 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74937f0-d024-48fd-be8e-28308c1c2b20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:57.313222 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74937f0-d024-48fd-be8e-28308c1c2b20 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:57.322729 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1179/2364] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:17:57.326837 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3184e57-f767-47c5-948b-80709bc0bb6b admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:57.337012 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3184e57-f767-47c5-948b-80709bc0bb6b admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:57.342066 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bea8be-6aec-4cf5-922b-31a5df7ab3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:57.342214 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bea8be-6aec-4cf5-922b-31a5df7ab3aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:57.342490 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bea8be-6aec-4cf5-922b-31a5df7ab3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:57.342763 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bea8be-6aec-4cf5-922b-31a5df7ab3aa admin admin] PATH_INFO: `/v3/projects/cd4a5e7794a34c5b909a51e153331feb/users/bcf26d2ffd26411d856e5630f022d4d1/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:57.344688 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bea8be-6aec-4cf5-922b-31a5df7ab3aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd4a5e7794a34c5b909a51e153331feb, user_id=bcf26d2ffd26411d856e5630f022d4d1, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:57.347310 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bea8be-6aec-4cf5-922b-31a5df7ab3aa admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:57.358147 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1186/2365] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:17:57 2022] PUT /identity/v3/projects/cd4a5e7794a34c5b909a51e153331feb/users/bcf26d2ffd26411d856e5630f022d4d1/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:17:57.369109 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7221e0-cb64-41b1-a0b6-052d70207c36 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:57.369397 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7221e0-cb64-41b1-a0b6-052d70207c36 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:57.369674 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7221e0-cb64-41b1-a0b6-052d70207c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:57.396871 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-db7221e0-cb64-41b1-a0b6-052d70207c36 None None] MFA Rules not processed for user `bcf26d2ffd26411d856e5630f022d4d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:17:57.398065 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-db7221e0-cb64-41b1-a0b6-052d70207c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:17:57.466618 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1180/2366] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:17:57 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:17:57.479260 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bea8be-6aec-4cf5-922b-31a5df7ab3aa admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:57.480954 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-04bea8be-6aec-4cf5-922b-31a5df7ab3aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:17:57.538541 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bea8be-6aec-4cf5-922b-31a5df7ab3aa admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:57.542259 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db3975-8ac3-420d-92a5-59bbddd1b94d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:57.542857 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db3975-8ac3-420d-92a5-59bbddd1b94d service cinder] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:57.543163 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db3975-8ac3-420d-92a5-59bbddd1b94d service cinder] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:57.543432 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db3975-8ac3-420d-92a5-59bbddd1b94d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:57.552493 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db3975-8ac3-420d-92a5-59bbddd1b94d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:57.553912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db3975-8ac3-420d-92a5-59bbddd1b94d service cinder] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:57.563230 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1187/2367] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:17:57 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:17:58.569105 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7221e0-cb64-41b1-a0b6-052d70207c36 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:58.587440 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:17:58.640023 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7221e0-cb64-41b1-a0b6-052d70207c36 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:58.645501 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6315785-1cc2-47c3-8129-e845d6b8f48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:58.646139 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6315785-1cc2-47c3-8129-e845d6b8f48b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:58.646422 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6315785-1cc2-47c3-8129-e845d6b8f48b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:58.646697 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6315785-1cc2-47c3-8129-e845d6b8f48b admin admin] PATH_INFO: `/v3/users/0fce6a92eb2e4eafa075b2d276452d47` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:58.647822 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6315785-1cc2-47c3-8129-e845d6b8f48b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fce6a92eb2e4eafa075b2d276452d47)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:58.649781 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6315785-1cc2-47c3-8129-e845d6b8f48b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:58.847083 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-e6315785-1cc2-47c3-8129-e845d6b8f48b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fce6a92eb2e4eafa075b2d276452d47'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:58.969744 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-e6315785-1cc2-47c3-8129-e845d6b8f48b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fce6a92eb2e4eafa075b2d276452d47'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:58.984069 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-e6315785-1cc2-47c3-8129-e845d6b8f48b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fce6a92eb2e4eafa075b2d276452d47'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:58.991671 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-e6315785-1cc2-47c3-8129-e845d6b8f48b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fce6a92eb2e4eafa075b2d276452d47'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:58.992387 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-e6315785-1cc2-47c3-8129-e845d6b8f48b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fce6a92eb2e4eafa075b2d276452d47'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:58.998275 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1181/2368] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:17:58 2022] DELETE /identity/v3/users/0fce6a92eb2e4eafa075b2d276452d47 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:17:59.003033 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039df5c-5929-4b0e-978c-41222e038510 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:59.003508 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039df5c-5929-4b0e-978c-41222e038510 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:59.003607 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039df5c-5929-4b0e-978c-41222e038510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:59.022686 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-b039df5c-5929-4b0e-978c-41222e038510 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:17:59.023890 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-b039df5c-5929-4b0e-978c-41222e038510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:17:59.081932 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1188/2369] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:17:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:17:59.092521 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6315785-1cc2-47c3-8129-e845d6b8f48b admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:59.093921 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e6315785-1cc2-47c3-8129-e845d6b8f48b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:17:59.151518 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6315785-1cc2-47c3-8129-e845d6b8f48b admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:59.155591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c6df9-36a5-4d5e-a570-d65ee13dcc82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:59.156232 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c6df9-36a5-4d5e-a570-d65ee13dcc82 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:59.156523 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c6df9-36a5-4d5e-a570-d65ee13dcc82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:59.157865 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c6df9-36a5-4d5e-a570-d65ee13dcc82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:59.169084 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c6df9-36a5-4d5e-a570-d65ee13dcc82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:59.170560 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c6df9-36a5-4d5e-a570-d65ee13dcc82 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:59.181823 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1182/2370] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:17:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:17:59.599631 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039df5c-5929-4b0e-978c-41222e038510 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:59.601201 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-b039df5c-5929-4b0e-978c-41222e038510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:17:59.615840 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039df5c-5929-4b0e-978c-41222e038510 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:59.620605 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b7d0a5-981c-413d-b531-34950a4a1b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:59.623952 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7d0a5-981c-413d-b531-34950a4a1b80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:59.623952 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7d0a5-981c-413d-b531-34950a4a1b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:59.623952 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7d0a5-981c-413d-b531-34950a4a1b80 admin admin] PATH_INFO: `/v3/projects/5df729e35fec4837958245669616ab34` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:59.623952 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b7d0a5-981c-413d-b531-34950a4a1b80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5df729e35fec4837958245669616ab34)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:59.628848 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b7d0a5-981c-413d-b531-34950a4a1b80 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:17:59.640092 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:17:59.752077 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-f2b7d0a5-981c-413d-b531-34950a4a1b80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5df729e35fec4837958245669616ab34', 'request_id': 'req-f2b7d0a5-981c-413d-b531-34950a4a1b80'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:59.831796 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-f2b7d0a5-981c-413d-b531-34950a4a1b80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5df729e35fec4837958245669616ab34', 'request_id': 'req-f2b7d0a5-981c-413d-b531-34950a4a1b80'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:59.838745 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-f2b7d0a5-981c-413d-b531-34950a4a1b80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5df729e35fec4837958245669616ab34', 'request_id': 'req-f2b7d0a5-981c-413d-b531-34950a4a1b80'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:59.849302 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-f2b7d0a5-981c-413d-b531-34950a4a1b80 admin admin] The token cache is being invalidate because project 5df729e35fec4837958245669616ab34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:17:59.849540 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-f2b7d0a5-981c-413d-b531-34950a4a1b80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:59.850193 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-f2b7d0a5-981c-413d-b531-34950a4a1b80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:17:59.851681 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1189/2371] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:17:59 2022] DELETE /identity/v3/projects/5df729e35fec4837958245669616ab34 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:17:59.855684 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c6df9-36a5-4d5e-a570-d65ee13dcc82 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:17:59.866075 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c6df9-36a5-4d5e-a570-d65ee13dcc82 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:17:59.899596 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:17:59.921661 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c4002-8a2c-4725-bc69-2c71dc6fd838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:17:59.922355 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c4002-8a2c-4725-bc69-2c71dc6fd838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:17:59.922631 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c4002-8a2c-4725-bc69-2c71dc6fd838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:17:59.922901 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c4002-8a2c-4725-bc69-2c71dc6fd838 admin admin] PATH_INFO: `/v3/users/bcf26d2ffd26411d856e5630f022d4d1` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:17:59.924005 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c4002-8a2c-4725-bc69-2c71dc6fd838 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcf26d2ffd26411d856e5630f022d4d1)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:17:59.925946 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c4002-8a2c-4725-bc69-2c71dc6fd838 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:00.131971 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c02c4002-8a2c-4725-bc69-2c71dc6fd838 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcf26d2ffd26411d856e5630f022d4d1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:00.208639 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c02c4002-8a2c-4725-bc69-2c71dc6fd838 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcf26d2ffd26411d856e5630f022d4d1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:00.221144 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c02c4002-8a2c-4725-bc69-2c71dc6fd838 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcf26d2ffd26411d856e5630f022d4d1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:00.235648 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c02c4002-8a2c-4725-bc69-2c71dc6fd838 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcf26d2ffd26411d856e5630f022d4d1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:00.236424 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c02c4002-8a2c-4725-bc69-2c71dc6fd838 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcf26d2ffd26411d856e5630f022d4d1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:00.243136 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1183/2372] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:17:59 2022] DELETE /identity/v3/users/bcf26d2ffd26411d856e5630f022d4d1 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:18:00.535390 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24c480-3b17-47ea-ab74-243a123915bd None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:00.535860 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24c480-3b17-47ea-ab74-243a123915bd None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:00.535989 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24c480-3b17-47ea-ab74-243a123915bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:00.566944 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-5b24c480-3b17-47ea-ab74-243a123915bd None None] MFA Rules not processed for user `3c90765757a34c6291c9980a7d5d5c79`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:18:00.568226 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-5b24c480-3b17-47ea-ab74-243a123915bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:00.626099 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1190/2373] 10.222.0.45 () {58 vars in 967 bytes} [Wed Oct 26 11:18:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:18:00.715072 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c4002-8a2c-4725-bc69-2c71dc6fd838 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:00.716676 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c02c4002-8a2c-4725-bc69-2c71dc6fd838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:00.759578 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24c480-3b17-47ea-ab74-243a123915bd None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:00.759578 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-5b24c480-3b17-47ea-ab74-243a123915bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:00.788549 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c4002-8a2c-4725-bc69-2c71dc6fd838 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:00.793272 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5f0c7-3e33-4265-959d-ae8cab3bdfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:00.793914 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5f0c7-3e33-4265-959d-ae8cab3bdfff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:00.794206 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5f0c7-3e33-4265-959d-ae8cab3bdfff admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:00.794477 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5f0c7-3e33-4265-959d-ae8cab3bdfff admin admin] PATH_INFO: `/v3/projects/cd4a5e7794a34c5b909a51e153331feb` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:00.795603 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf5f0c7-3e33-4265-959d-ae8cab3bdfff admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd4a5e7794a34c5b909a51e153331feb)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:00.797623 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf5f0c7-3e33-4265-959d-ae8cab3bdfff admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:00.830789 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24c480-3b17-47ea-ab74-243a123915bd None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:00.836685 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6050fa1-ac7f-4770-9795-cc9acf597db3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21b84cc38a848de8d19a41e1eb04a58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:00.837302 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6050fa1-ac7f-4770-9795-cc9acf597db3 service swift] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:00.837590 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6050fa1-ac7f-4770-9795-cc9acf597db3 service swift] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:00.837872 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6050fa1-ac7f-4770-9795-cc9acf597db3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:00.845991 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6050fa1-ac7f-4770-9795-cc9acf597db3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:00.847703 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6050fa1-ac7f-4770-9795-cc9acf597db3 service swift] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:00.855986 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1191/2374] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Oct 26 11:18:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 26 11:18:00.913939 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-fbf5f0c7-3e33-4265-959d-ae8cab3bdfff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd4a5e7794a34c5b909a51e153331feb', 'request_id': 'req-fbf5f0c7-3e33-4265-959d-ae8cab3bdfff'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:00.920469 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-fbf5f0c7-3e33-4265-959d-ae8cab3bdfff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd4a5e7794a34c5b909a51e153331feb', 'request_id': 'req-fbf5f0c7-3e33-4265-959d-ae8cab3bdfff'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:00.924245 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:01.015120 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-fbf5f0c7-3e33-4265-959d-ae8cab3bdfff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd4a5e7794a34c5b909a51e153331feb', 'request_id': 'req-fbf5f0c7-3e33-4265-959d-ae8cab3bdfff'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:01.027182 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-fbf5f0c7-3e33-4265-959d-ae8cab3bdfff admin admin] The token cache is being invalidate because project cd4a5e7794a34c5b909a51e153331feb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:18:01.027475 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-fbf5f0c7-3e33-4265-959d-ae8cab3bdfff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:01.028146 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-fbf5f0c7-3e33-4265-959d-ae8cab3bdfff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:01.029651 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1184/2375] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:18:00 2022] DELETE /identity/v3/projects/cd4a5e7794a34c5b909a51e153331feb => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:18:01.034399 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9077c-796d-4c49-ab48-dabe90a49bb3 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:01.034684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9077c-796d-4c49-ab48-dabe90a49bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:01.034959 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9077c-796d-4c49-ab48-dabe90a49bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:01.054924 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-9dd9077c-796d-4c49-ab48-dabe90a49bb3 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:18:01.056156 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-9dd9077c-796d-4c49-ab48-dabe90a49bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:01.073545 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:01.116211 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1192/2376] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:18:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:18:01.125239 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb140f6-12d6-4a43-ac10-1fb2da55d8eb None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:01.125535 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb140f6-12d6-4a43-ac10-1fb2da55d8eb None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:01.125818 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb140f6-12d6-4a43-ac10-1fb2da55d8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:01.146112 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-ccb140f6-12d6-4a43-ac10-1fb2da55d8eb None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:18:01.147388 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ccb140f6-12d6-4a43-ac10-1fb2da55d8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:01.155406 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1185/2377] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:18:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:18:01.159481 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd9077c-796d-4c49-ab48-dabe90a49bb3 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:01.169199 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd9077c-796d-4c49-ab48-dabe90a49bb3 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:01.174041 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60a8d3-6d09-4666-8ebd-6574c8c19095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:01.174664 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60a8d3-6d09-4666-8ebd-6574c8c19095 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:01.174949 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60a8d3-6d09-4666-8ebd-6574c8c19095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:01.175218 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60a8d3-6d09-4666-8ebd-6574c8c19095 admin admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:01.175859 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d60a8d3-6d09-4666-8ebd-6574c8c19095 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:18:01.176190 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d60a8d3-6d09-4666-8ebd-6574c8c19095 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:01.177773 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d60a8d3-6d09-4666-8ebd-6574c8c19095 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:01.190804 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1193/2378] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:18:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:18:01.196046 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb140f6-12d6-4a43-ac10-1fb2da55d8eb None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:01.205428 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb140f6-12d6-4a43-ac10-1fb2da55d8eb None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:01.210283 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a740d6a-d273-4b5e-b17f-bcbc88ea53cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:01.210896 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a740d6a-d273-4b5e-b17f-bcbc88ea53cb admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:01.211179 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a740d6a-d273-4b5e-b17f-bcbc88ea53cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:01.212204 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a740d6a-d273-4b5e-b17f-bcbc88ea53cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:01.212204 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a740d6a-d273-4b5e-b17f-bcbc88ea53cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:01.214030 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a740d6a-d273-4b5e-b17f-bcbc88ea53cb admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:01.299704 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1186/2379] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:18:01 2022] POST /identity/v3/projects => generated 389 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:18:01.304179 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60a8d3-6d09-4666-8ebd-6574c8c19095 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:01.314308 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60a8d3-6d09-4666-8ebd-6574c8c19095 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:01.376931 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4bf06-7549-4f08-a898-279a2e732d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:01.377544 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4bf06-7549-4f08-a898-279a2e732d52 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:01.377826 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4bf06-7549-4f08-a898-279a2e732d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:01.378104 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4bf06-7549-4f08-a898-279a2e732d52 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:01.378734 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd4bf06-7549-4f08-a898-279a2e732d52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:01.380685 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd4bf06-7549-4f08-a898-279a2e732d52 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:01.449328 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1194/2380] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:18:01 2022] POST /identity/v3/users => generated 295 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:18:01.453532 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a740d6a-d273-4b5e-b17f-bcbc88ea53cb admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:01.464429 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a740d6a-d273-4b5e-b17f-bcbc88ea53cb admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:01.469335 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b159851-0694-4c2d-97cd-701ce9f052bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:01.469936 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b159851-0694-4c2d-97cd-701ce9f052bd admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:01.470320 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b159851-0694-4c2d-97cd-701ce9f052bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:01.470694 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b159851-0694-4c2d-97cd-701ce9f052bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:01.471315 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b159851-0694-4c2d-97cd-701ce9f052bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:01.473015 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b159851-0694-4c2d-97cd-701ce9f052bd admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:01.484145 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1187/2381] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:18:01.487972 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4bf06-7549-4f08-a898-279a2e732d52 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:01.498010 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4bf06-7549-4f08-a898-279a2e732d52 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:01.502812 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bebdd3c-22ea-4986-b033-d373a1870aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:01.503411 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bebdd3c-22ea-4986-b033-d373a1870aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:01.503690 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bebdd3c-22ea-4986-b033-d373a1870aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:01.503969 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bebdd3c-22ea-4986-b033-d373a1870aa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:01.504650 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bebdd3c-22ea-4986-b033-d373a1870aa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:01.506754 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bebdd3c-22ea-4986-b033-d373a1870aa0 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:01.518465 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1195/2382] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:18:01.523302 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b159851-0694-4c2d-97cd-701ce9f052bd admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:01.533555 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b159851-0694-4c2d-97cd-701ce9f052bd admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:01.538108 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92062c70-bf0b-4dd4-9b0d-092898b1d2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:01.538794 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92062c70-bf0b-4dd4-9b0d-092898b1d2be admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:01.539074 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92062c70-bf0b-4dd4-9b0d-092898b1d2be admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:01.539346 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92062c70-bf0b-4dd4-9b0d-092898b1d2be admin admin] PATH_INFO: `/v3/projects/119605c4c0f346acb663afa694c76ae8/users/91e4ebdc36e24f69a7dc533db9bd3c19/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:01.553935 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92062c70-bf0b-4dd4-9b0d-092898b1d2be admin admin] RBAC: Authorizing `identity:create_grant(project_id=119605c4c0f346acb663afa694c76ae8, user_id=91e4ebdc36e24f69a7dc533db9bd3c19, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:01.556683 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92062c70-bf0b-4dd4-9b0d-092898b1d2be admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:01.672241 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1188/2383] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:18:01 2022] PUT /identity/v3/projects/119605c4c0f346acb663afa694c76ae8/users/91e4ebdc36e24f69a7dc533db9bd3c19/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:18:01.682653 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d15b9a-82dc-4062-acd0-028b4d5f34c6 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:01.683184 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d15b9a-82dc-4062-acd0-028b4d5f34c6 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:01.683184 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d15b9a-82dc-4062-acd0-028b4d5f34c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:01.713183 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-89d15b9a-82dc-4062-acd0-028b4d5f34c6 None None] MFA Rules not processed for user `91e4ebdc36e24f69a7dc533db9bd3c19`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:18:01.714455 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-89d15b9a-82dc-4062-acd0-028b4d5f34c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:01.780431 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1196/2384] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:18:01 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:18:01.785179 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92062c70-bf0b-4dd4-9b0d-092898b1d2be admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:01.846006 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92062c70-bf0b-4dd4-9b0d-092898b1d2be admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:01.850731 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac4535-5d85-4c8b-91c9-d637818a59c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:01.851328 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac4535-5d85-4c8b-91c9-d637818a59c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:01.851610 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac4535-5d85-4c8b-91c9-d637818a59c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:01.851880 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac4535-5d85-4c8b-91c9-d637818a59c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:01.852545 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac4535-5d85-4c8b-91c9-d637818a59c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:01.854746 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac4535-5d85-4c8b-91c9-d637818a59c1 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:01.970661 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1189/2385] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:18:01 2022] POST /identity/v3/projects => generated 389 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:18:01.974785 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d15b9a-82dc-4062-acd0-028b4d5f34c6 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:01.986321 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d15b9a-82dc-4062-acd0-028b4d5f34c6 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:01.999579 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:02.045204 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26dcb1-e357-41c2-99ea-403d0266a8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:02.045819 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26dcb1-e357-41c2-99ea-403d0266a8a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:02.046098 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26dcb1-e357-41c2-99ea-403d0266a8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:02.046391 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26dcb1-e357-41c2-99ea-403d0266a8a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:02.047003 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c26dcb1-e357-41c2-99ea-403d0266a8a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:02.048954 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c26dcb1-e357-41c2-99ea-403d0266a8a0 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:02.147018 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1197/2386] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:18:01 2022] POST /identity/v3/users => generated 301 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:18:02.151211 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac4535-5d85-4c8b-91c9-d637818a59c1 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:02.162161 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac4535-5d85-4c8b-91c9-d637818a59c1 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:02.167291 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c003a9-4c0b-4a47-89fc-a4baa3442fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:02.167905 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c003a9-4c0b-4a47-89fc-a4baa3442fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:02.168232 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c003a9-4c0b-4a47-89fc-a4baa3442fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:02.169662 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c003a9-4c0b-4a47-89fc-a4baa3442fb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:02.169662 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c003a9-4c0b-4a47-89fc-a4baa3442fb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:02.170811 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c003a9-4c0b-4a47-89fc-a4baa3442fb8 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:02.182268 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1190/2387] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:18:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:18:02.186457 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26dcb1-e357-41c2-99ea-403d0266a8a0 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:02.197203 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26dcb1-e357-41c2-99ea-403d0266a8a0 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:02.201969 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d242a80-5783-4796-9518-79e563fc0036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:02.202657 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d242a80-5783-4796-9518-79e563fc0036 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:02.202942 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d242a80-5783-4796-9518-79e563fc0036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:02.203249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d242a80-5783-4796-9518-79e563fc0036 admin admin] PATH_INFO: `/v3/projects/6c493152afe0498dbbfaa779b11828d7/users/a80a3924c8be44fb95705bc716d308c2/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:02.218594 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d242a80-5783-4796-9518-79e563fc0036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c493152afe0498dbbfaa779b11828d7, user_id=a80a3924c8be44fb95705bc716d308c2, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:02.221864 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d242a80-5783-4796-9518-79e563fc0036 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:02.290333 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1198/2388] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:18:02 2022] PUT /identity/v3/projects/6c493152afe0498dbbfaa779b11828d7/users/a80a3924c8be44fb95705bc716d308c2/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:18:02.294452 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c003a9-4c0b-4a47-89fc-a4baa3442fb8 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:02.305334 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c003a9-4c0b-4a47-89fc-a4baa3442fb8 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:02.361719 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:02.368683 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9525562-3792-4b7d-b617-9efa6355a206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:02.369302 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9525562-3792-4b7d-b617-9efa6355a206 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:02.369638 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9525562-3792-4b7d-b617-9efa6355a206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:02.369918 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9525562-3792-4b7d-b617-9efa6355a206 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:02.370569 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9525562-3792-4b7d-b617-9efa6355a206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:02.372224 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9525562-3792-4b7d-b617-9efa6355a206 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:02.385504 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1191/2389] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:18:02 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:18:02.386668 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d242a80-5783-4796-9518-79e563fc0036 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:02.397146 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d242a80-5783-4796-9518-79e563fc0036 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:02.401753 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146bce4-60b2-4469-8e02-7d090d4eaa7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:02.402442 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146bce4-60b2-4469-8e02-7d090d4eaa7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:02.407290 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146bce4-60b2-4469-8e02-7d090d4eaa7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:02.407290 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146bce4-60b2-4469-8e02-7d090d4eaa7d admin admin] PATH_INFO: `/v3/projects/6c493152afe0498dbbfaa779b11828d7/users/a80a3924c8be44fb95705bc716d308c2/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:02.407290 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4146bce4-60b2-4469-8e02-7d090d4eaa7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c493152afe0498dbbfaa779b11828d7, user_id=a80a3924c8be44fb95705bc716d308c2, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:02.407598 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4146bce4-60b2-4469-8e02-7d090d4eaa7d admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:02.418529 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1199/2390] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:18:02 2022] PUT /identity/v3/projects/6c493152afe0498dbbfaa779b11828d7/users/a80a3924c8be44fb95705bc716d308c2/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:18:02.429331 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e3d26-8e34-4b0c-b5e2-1e98addeefde None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:02.429606 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e3d26-8e34-4b0c-b5e2-1e98addeefde None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:02.429886 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e3d26-8e34-4b0c-b5e2-1e98addeefde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:02.457758 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-512e3d26-8e34-4b0c-b5e2-1e98addeefde None None] MFA Rules not processed for user `a80a3924c8be44fb95705bc716d308c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:18:02.458992 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-512e3d26-8e34-4b0c-b5e2-1e98addeefde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:02.528749 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1192/2391] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:18:02 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:18:02.540214 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146bce4-60b2-4469-8e02-7d090d4eaa7d admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:02.541938 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-4146bce4-60b2-4469-8e02-7d090d4eaa7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:02.601114 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146bce4-60b2-4469-8e02-7d090d4eaa7d admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:02.605623 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edffa6-3a45-4e92-9622-d44b98452c70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:02.606228 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edffa6-3a45-4e92-9622-d44b98452c70 service cinder] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:02.606507 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edffa6-3a45-4e92-9622-d44b98452c70 service cinder] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:02.606775 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edffa6-3a45-4e92-9622-d44b98452c70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:02.616493 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1edffa6-3a45-4e92-9622-d44b98452c70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:02.617930 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1edffa6-3a45-4e92-9622-d44b98452c70 service cinder] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:02.627589 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1200/2392] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:18:02 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:18:02.766687 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e3d26-8e34-4b0c-b5e2-1e98addeefde None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:02.840370 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e3d26-8e34-4b0c-b5e2-1e98addeefde None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:02.845581 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765e986-3a2a-4acc-aa93-3823ff33a9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:02.846267 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765e986-3a2a-4acc-aa93-3823ff33a9bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:02.846555 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765e986-3a2a-4acc-aa93-3823ff33a9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:02.846833 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765e986-3a2a-4acc-aa93-3823ff33a9bb admin admin] PATH_INFO: `/v3/users/91e4ebdc36e24f69a7dc533db9bd3c19` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:02.848070 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765e986-3a2a-4acc-aa93-3823ff33a9bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=91e4ebdc36e24f69a7dc533db9bd3c19)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:02.850029 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765e986-3a2a-4acc-aa93-3823ff33a9bb admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:03.049972 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0765e986-3a2a-4acc-aa93-3823ff33a9bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91e4ebdc36e24f69a7dc533db9bd3c19'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:03.112307 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0765e986-3a2a-4acc-aa93-3823ff33a9bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91e4ebdc36e24f69a7dc533db9bd3c19'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:03.129134 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0765e986-3a2a-4acc-aa93-3823ff33a9bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91e4ebdc36e24f69a7dc533db9bd3c19'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:03.138843 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0765e986-3a2a-4acc-aa93-3823ff33a9bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91e4ebdc36e24f69a7dc533db9bd3c19'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:03.139652 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0765e986-3a2a-4acc-aa93-3823ff33a9bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91e4ebdc36e24f69a7dc533db9bd3c19'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:03.141536 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:03.148625 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1193/2393] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:18:02 2022] DELETE /identity/v3/users/91e4ebdc36e24f69a7dc533db9bd3c19 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:18:03.153383 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef0fa2-c079-49af-bea6-9261def3e9bb None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:03.153960 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef0fa2-c079-49af-bea6-9261def3e9bb None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:03.153960 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef0fa2-c079-49af-bea6-9261def3e9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:03.175734 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-79ef0fa2-c079-49af-bea6-9261def3e9bb None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:18:03.177043 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-79ef0fa2-c079-49af-bea6-9261def3e9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:03.248154 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1201/2394] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:18:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:18:03.258989 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765e986-3a2a-4acc-aa93-3823ff33a9bb admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:03.261439 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0765e986-3a2a-4acc-aa93-3823ff33a9bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:03.333699 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765e986-3a2a-4acc-aa93-3823ff33a9bb admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:03.346313 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d105b2-6342-445a-a260-7d3cadf0631a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:03.348580 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d105b2-6342-445a-a260-7d3cadf0631a service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:03.348580 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d105b2-6342-445a-a260-7d3cadf0631a service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:03.348580 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d105b2-6342-445a-a260-7d3cadf0631a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:03.358109 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d105b2-6342-445a-a260-7d3cadf0631a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:03.359984 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d105b2-6342-445a-a260-7d3cadf0631a service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:03.374704 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1194/2395] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:18:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:18:03.999277 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef0fa2-c079-49af-bea6-9261def3e9bb None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:04.000856 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-79ef0fa2-c079-49af-bea6-9261def3e9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:04.014860 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef0fa2-c079-49af-bea6-9261def3e9bb None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:04.020636 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff945d5-746c-4976-8a76-a97ac7f61fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:04.021389 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff945d5-746c-4976-8a76-a97ac7f61fbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:04.021793 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff945d5-746c-4976-8a76-a97ac7f61fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:04.022970 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff945d5-746c-4976-8a76-a97ac7f61fbc admin admin] PATH_INFO: `/v3/projects/119605c4c0f346acb663afa694c76ae8` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:04.024136 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff945d5-746c-4976-8a76-a97ac7f61fbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=119605c4c0f346acb663afa694c76ae8)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:04.026667 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff945d5-746c-4976-8a76-a97ac7f61fbc admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:04.037491 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:04.324980 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-1ff945d5-746c-4976-8a76-a97ac7f61fbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '119605c4c0f346acb663afa694c76ae8', 'request_id': 'req-1ff945d5-746c-4976-8a76-a97ac7f61fbc'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:04.409353 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-1ff945d5-746c-4976-8a76-a97ac7f61fbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '119605c4c0f346acb663afa694c76ae8', 'request_id': 'req-1ff945d5-746c-4976-8a76-a97ac7f61fbc'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:04.416889 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-1ff945d5-746c-4976-8a76-a97ac7f61fbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '119605c4c0f346acb663afa694c76ae8', 'request_id': 'req-1ff945d5-746c-4976-8a76-a97ac7f61fbc'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:04.427582 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-1ff945d5-746c-4976-8a76-a97ac7f61fbc admin admin] The token cache is being invalidate because project 119605c4c0f346acb663afa694c76ae8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:18:04.427873 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-1ff945d5-746c-4976-8a76-a97ac7f61fbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:04.429083 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-1ff945d5-746c-4976-8a76-a97ac7f61fbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:04.430574 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1202/2396] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:18:03 2022] DELETE /identity/v3/projects/119605c4c0f346acb663afa694c76ae8 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:18:04.434616 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d105b2-6342-445a-a260-7d3cadf0631a service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:04.445959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d105b2-6342-445a-a260-7d3cadf0631a service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:04.507828 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeffcba6-c5d0-4376-a4f1-71724638ab95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:04.508485 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffcba6-c5d0-4376-a4f1-71724638ab95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:04.508768 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffcba6-c5d0-4376-a4f1-71724638ab95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:04.509043 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffcba6-c5d0-4376-a4f1-71724638ab95 admin admin] PATH_INFO: `/v3/users/a80a3924c8be44fb95705bc716d308c2` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:04.510208 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeffcba6-c5d0-4376-a4f1-71724638ab95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a80a3924c8be44fb95705bc716d308c2)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:04.512274 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeffcba6-c5d0-4376-a4f1-71724638ab95 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:04.696458 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-eeffcba6-c5d0-4376-a4f1-71724638ab95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a80a3924c8be44fb95705bc716d308c2'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:04.759148 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-eeffcba6-c5d0-4376-a4f1-71724638ab95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a80a3924c8be44fb95705bc716d308c2'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:04.774839 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-eeffcba6-c5d0-4376-a4f1-71724638ab95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a80a3924c8be44fb95705bc716d308c2'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:04.783418 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-eeffcba6-c5d0-4376-a4f1-71724638ab95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a80a3924c8be44fb95705bc716d308c2'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:04.784222 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-eeffcba6-c5d0-4376-a4f1-71724638ab95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a80a3924c8be44fb95705bc716d308c2'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:04.790739 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1195/2397] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:18:04 2022] DELETE /identity/v3/users/a80a3924c8be44fb95705bc716d308c2 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:18:05.234239 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff945d5-746c-4976-8a76-a97ac7f61fbc admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:05.235841 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-1ff945d5-746c-4976-8a76-a97ac7f61fbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:05.254014 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff945d5-746c-4976-8a76-a97ac7f61fbc admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:05.315559 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677cb490-77ab-45f3-8863-93a39772be0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:05.316331 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cb490-77ab-45f3-8863-93a39772be0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:05.316687 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cb490-77ab-45f3-8863-93a39772be0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:05.317026 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cb490-77ab-45f3-8863-93a39772be0b admin admin] PATH_INFO: `/v3/projects/6c493152afe0498dbbfaa779b11828d7` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:05.318212 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677cb490-77ab-45f3-8863-93a39772be0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c493152afe0498dbbfaa779b11828d7)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:05.322062 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677cb490-77ab-45f3-8863-93a39772be0b admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:05.496398 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-677cb490-77ab-45f3-8863-93a39772be0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c493152afe0498dbbfaa779b11828d7', 'request_id': 'req-677cb490-77ab-45f3-8863-93a39772be0b'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:05.587606 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-677cb490-77ab-45f3-8863-93a39772be0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c493152afe0498dbbfaa779b11828d7', 'request_id': 'req-677cb490-77ab-45f3-8863-93a39772be0b'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:05.601405 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-677cb490-77ab-45f3-8863-93a39772be0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c493152afe0498dbbfaa779b11828d7', 'request_id': 'req-677cb490-77ab-45f3-8863-93a39772be0b'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:05.619319 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-677cb490-77ab-45f3-8863-93a39772be0b admin admin] The token cache is being invalidate because project 6c493152afe0498dbbfaa779b11828d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:18:05.619860 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-677cb490-77ab-45f3-8863-93a39772be0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:05.620947 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-677cb490-77ab-45f3-8863-93a39772be0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:05.626886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1203/2398] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:18:05 2022] DELETE /identity/v3/projects/6c493152afe0498dbbfaa779b11828d7 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:18:05.628472 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f39ee3-8803-4c1d-95df-a031b367d5e2 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:05.628930 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f39ee3-8803-4c1d-95df-a031b367d5e2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:05.629964 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f39ee3-8803-4c1d-95df-a031b367d5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:05.671711 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677cb490-77ab-45f3-8863-93a39772be0b admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:05.673287 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-677cb490-77ab-45f3-8863-93a39772be0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:05.682175 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-c5f39ee3-8803-4c1d-95df-a031b367d5e2 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:18:05.683556 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c5f39ee3-8803-4c1d-95df-a031b367d5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:05.707241 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:05.723060 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:05.770843 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1196/2399] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:18:05.775204 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2498d45-139f-40f6-90f9-ef69870a2fea None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:05.775440 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2498d45-139f-40f6-90f9-ef69870a2fea None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:05.775725 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2498d45-139f-40f6-90f9-ef69870a2fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:05.775850 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677cb490-77ab-45f3-8863-93a39772be0b admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:05.780837 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d95cbf4-dafb-4e69-af5c-0b730f2bc595 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4f9a2bba0e748b6a98fa7dea2482ddf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:05.781453 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95cbf4-dafb-4e69-af5c-0b730f2bc595 service placement] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:05.781732 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95cbf4-dafb-4e69-af5c-0b730f2bc595 service placement] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:05.782010 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95cbf4-dafb-4e69-af5c-0b730f2bc595 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:05.783736 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-2d95cbf4-dafb-4e69-af5c-0b730f2bc595 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:05.799582 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d95cbf4-dafb-4e69-af5c-0b730f2bc595 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:05.799582 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d95cbf4-dafb-4e69-af5c-0b730f2bc595 service placement] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:05.820487 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-e2498d45-139f-40f6-90f9-ef69870a2fea None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:18:05.821714 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e2498d45-139f-40f6-90f9-ef69870a2fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:05.823836 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1204/2400] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:18:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:18:05.840634 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1197/2401] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:18:05.844743 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d95cbf4-dafb-4e69-af5c-0b730f2bc595 service placement] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:05.856047 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d95cbf4-dafb-4e69-af5c-0b730f2bc595 service placement] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:05.861598 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba13f5a-9a0a-4e43-acea-93bbc9b94c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:05.861945 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba13f5a-9a0a-4e43-acea-93bbc9b94c5c admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:05.862416 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba13f5a-9a0a-4e43-acea-93bbc9b94c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:05.862699 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba13f5a-9a0a-4e43-acea-93bbc9b94c5c admin admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:05.863373 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba13f5a-9a0a-4e43-acea-93bbc9b94c5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:18:05.863680 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba13f5a-9a0a-4e43-acea-93bbc9b94c5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:05.865615 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba13f5a-9a0a-4e43-acea-93bbc9b94c5c admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:05.880108 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1205/2402] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:18:05.883121 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2498d45-139f-40f6-90f9-ef69870a2fea None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:05.893707 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2498d45-139f-40f6-90f9-ef69870a2fea None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:05.899460 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8b97b-fcfb-4ce3-9ac7-b5752fb1cea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:05.899903 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8b97b-fcfb-4ce3-9ac7-b5752fb1cea6 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:05.900221 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8b97b-fcfb-4ce3-9ac7-b5752fb1cea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:05.900497 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8b97b-fcfb-4ce3-9ac7-b5752fb1cea6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:05.901154 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8b97b-fcfb-4ce3-9ac7-b5752fb1cea6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:05.903102 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8b97b-fcfb-4ce3-9ac7-b5752fb1cea6 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:06.043065 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1198/2403] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:18:05 2022] POST /identity/v3/projects => generated 383 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:18:06.044743 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba13f5a-9a0a-4e43-acea-93bbc9b94c5c admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:06.058052 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba13f5a-9a0a-4e43-acea-93bbc9b94c5c admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:06.119670 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0720b-b536-4434-8986-f6f0b3e56b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:06.120554 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0720b-b536-4434-8986-f6f0b3e56b27 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:06.120903 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0720b-b536-4434-8986-f6f0b3e56b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:06.121319 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0720b-b536-4434-8986-f6f0b3e56b27 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:06.121971 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f0720b-b536-4434-8986-f6f0b3e56b27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:06.123880 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f0720b-b536-4434-8986-f6f0b3e56b27 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:06.207555 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1206/2404] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:18:06 2022] POST /identity/v3/users => generated 292 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:18:06.210602 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8b97b-fcfb-4ce3-9ac7-b5752fb1cea6 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:06.221262 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8b97b-fcfb-4ce3-9ac7-b5752fb1cea6 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:06.226254 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142c519-171e-4a7a-8a32-8e4e1fcabdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:06.226873 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142c519-171e-4a7a-8a32-8e4e1fcabdf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:06.227155 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142c519-171e-4a7a-8a32-8e4e1fcabdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:06.227431 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142c519-171e-4a7a-8a32-8e4e1fcabdf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:06.228138 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4142c519-171e-4a7a-8a32-8e4e1fcabdf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:06.229818 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4142c519-171e-4a7a-8a32-8e4e1fcabdf4 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:06.241194 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1199/2405] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:18:06.245556 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0720b-b536-4434-8986-f6f0b3e56b27 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:06.257221 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0720b-b536-4434-8986-f6f0b3e56b27 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:06.263451 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763cbc0-d7da-4881-b54d-7095cbadf629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:06.264113 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763cbc0-d7da-4881-b54d-7095cbadf629 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:06.264550 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763cbc0-d7da-4881-b54d-7095cbadf629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:06.265242 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763cbc0-d7da-4881-b54d-7095cbadf629 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:06.265899 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763cbc0-d7da-4881-b54d-7095cbadf629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:06.267534 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763cbc0-d7da-4881-b54d-7095cbadf629 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:06.282019 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1207/2406] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:18:06.283237 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142c519-171e-4a7a-8a32-8e4e1fcabdf4 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:06.295804 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142c519-171e-4a7a-8a32-8e4e1fcabdf4 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:06.300880 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa07762-484d-4dfb-a0a7-9f9f54bd50a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:06.301558 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa07762-484d-4dfb-a0a7-9f9f54bd50a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:06.301848 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa07762-484d-4dfb-a0a7-9f9f54bd50a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:06.302127 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa07762-484d-4dfb-a0a7-9f9f54bd50a7 admin admin] PATH_INFO: `/v3/projects/1f4ccf146a6a477ca125181a849586c7/users/2a4c12cdf9334ac7b1b859dfbb5ddd0f/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:06.319630 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa07762-484d-4dfb-a0a7-9f9f54bd50a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f4ccf146a6a477ca125181a849586c7, user_id=2a4c12cdf9334ac7b1b859dfbb5ddd0f, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:06.322765 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa07762-484d-4dfb-a0a7-9f9f54bd50a7 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:06.413978 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1200/2407] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:18:06 2022] PUT /identity/v3/projects/1f4ccf146a6a477ca125181a849586c7/users/2a4c12cdf9334ac7b1b859dfbb5ddd0f/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:18:06.432803 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6c1f5-802c-4c24-80a6-cdb5e8918cd3 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:06.433330 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6c1f5-802c-4c24-80a6-cdb5e8918cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:06.433687 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6c1f5-802c-4c24-80a6-cdb5e8918cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:06.499508 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-26e6c1f5-802c-4c24-80a6-cdb5e8918cd3 None None] MFA Rules not processed for user `2a4c12cdf9334ac7b1b859dfbb5ddd0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:18:06.502324 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-26e6c1f5-802c-4c24-80a6-cdb5e8918cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:06.601280 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1208/2408] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:18:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:18:06.605562 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa07762-484d-4dfb-a0a7-9f9f54bd50a7 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:06.685602 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa07762-484d-4dfb-a0a7-9f9f54bd50a7 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:06.691540 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e7eab-246d-450d-93fb-2203cafd23f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:06.692460 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e7eab-246d-450d-93fb-2203cafd23f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:06.693067 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e7eab-246d-450d-93fb-2203cafd23f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:06.693868 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e7eab-246d-450d-93fb-2203cafd23f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:06.695231 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e7eab-246d-450d-93fb-2203cafd23f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:06.697643 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e7eab-246d-450d-93fb-2203cafd23f3 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:06.834184 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1201/2409] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:18:06 2022] POST /identity/v3/projects => generated 383 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:18:06.837984 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6c1f5-802c-4c24-80a6-cdb5e8918cd3 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:06.854097 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6c1f5-802c-4c24-80a6-cdb5e8918cd3 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:06.937730 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb9934-8972-4a9e-96fb-4c68553ab40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:06.938571 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb9934-8972-4a9e-96fb-4c68553ab40e admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:06.939222 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb9934-8972-4a9e-96fb-4c68553ab40e admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:06.939699 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb9934-8972-4a9e-96fb-4c68553ab40e admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:06.940572 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb9934-8972-4a9e-96fb-4c68553ab40e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:06.944530 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb9934-8972-4a9e-96fb-4c68553ab40e admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:07.040750 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1209/2410] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:18:06 2022] POST /identity/v3/users => generated 298 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:18:07.044528 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e7eab-246d-450d-93fb-2203cafd23f3 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:07.068930 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e7eab-246d-450d-93fb-2203cafd23f3 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:07.075309 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41041b24-ad1a-412e-b226-e29da29f07b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:07.076252 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41041b24-ad1a-412e-b226-e29da29f07b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:07.076538 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41041b24-ad1a-412e-b226-e29da29f07b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:07.076865 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41041b24-ad1a-412e-b226-e29da29f07b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:07.077588 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41041b24-ad1a-412e-b226-e29da29f07b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:07.079220 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41041b24-ad1a-412e-b226-e29da29f07b0 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:07.093455 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1202/2411] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:18:07.097314 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb9934-8972-4a9e-96fb-4c68553ab40e admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:07.110361 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb9934-8972-4a9e-96fb-4c68553ab40e admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:07.117934 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b5c1f-7257-4edc-a882-7a63947f3999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:07.118809 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b5c1f-7257-4edc-a882-7a63947f3999 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:07.119090 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b5c1f-7257-4edc-a882-7a63947f3999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:07.119941 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b5c1f-7257-4edc-a882-7a63947f3999 admin admin] PATH_INFO: `/v3/projects/bd5b7fc6f6164fc18d1f8db7afa6a146/users/7dedcdf4e4b44ba7948638fe389c27f0/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:07.136473 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647b5c1f-7257-4edc-a882-7a63947f3999 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd5b7fc6f6164fc18d1f8db7afa6a146, user_id=7dedcdf4e4b44ba7948638fe389c27f0, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:07.140543 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647b5c1f-7257-4edc-a882-7a63947f3999 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:07.205721 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1210/2412] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:18:07 2022] PUT /identity/v3/projects/bd5b7fc6f6164fc18d1f8db7afa6a146/users/7dedcdf4e4b44ba7948638fe389c27f0/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:18:07.210366 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41041b24-ad1a-412e-b226-e29da29f07b0 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:07.210861 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:07.221799 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41041b24-ad1a-412e-b226-e29da29f07b0 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:07.259779 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:07.298843 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79416555-5ca8-42e6-a6d7-0a057f770c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:07.299529 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79416555-5ca8-42e6-a6d7-0a057f770c6f admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:07.299839 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79416555-5ca8-42e6-a6d7-0a057f770c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:07.300181 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79416555-5ca8-42e6-a6d7-0a057f770c6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:07.300837 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79416555-5ca8-42e6-a6d7-0a057f770c6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:07.302470 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79416555-5ca8-42e6-a6d7-0a057f770c6f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:07.314805 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1203/2413] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:18:07.318355 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b5c1f-7257-4edc-a882-7a63947f3999 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:07.331498 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b5c1f-7257-4edc-a882-7a63947f3999 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:07.342001 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27a5ea-fb9c-44c4-a120-4df9e3ee974d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:07.343335 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27a5ea-fb9c-44c4-a120-4df9e3ee974d admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:07.343335 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27a5ea-fb9c-44c4-a120-4df9e3ee974d admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:07.343525 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27a5ea-fb9c-44c4-a120-4df9e3ee974d admin admin] PATH_INFO: `/v3/projects/bd5b7fc6f6164fc18d1f8db7afa6a146/users/7dedcdf4e4b44ba7948638fe389c27f0/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:07.346238 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c27a5ea-fb9c-44c4-a120-4df9e3ee974d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd5b7fc6f6164fc18d1f8db7afa6a146, user_id=7dedcdf4e4b44ba7948638fe389c27f0, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:07.349074 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c27a5ea-fb9c-44c4-a120-4df9e3ee974d admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:07.379447 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1211/2414] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:18:07 2022] PUT /identity/v3/projects/bd5b7fc6f6164fc18d1f8db7afa6a146/users/7dedcdf4e4b44ba7948638fe389c27f0/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:18:07.390931 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c960a78-22b9-4665-bf39-78c8e7cde5e3 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:07.391224 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c960a78-22b9-4665-bf39-78c8e7cde5e3 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:07.391652 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c960a78-22b9-4665-bf39-78c8e7cde5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:07.458229 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-3c960a78-22b9-4665-bf39-78c8e7cde5e3 None None] MFA Rules not processed for user `7dedcdf4e4b44ba7948638fe389c27f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:18:07.458229 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3c960a78-22b9-4665-bf39-78c8e7cde5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:07.583445 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1204/2415] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:18:07 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:18:07.594368 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27a5ea-fb9c-44c4-a120-4df9e3ee974d admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:07.596926 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-1c27a5ea-fb9c-44c4-a120-4df9e3ee974d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:07.682389 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27a5ea-fb9c-44c4-a120-4df9e3ee974d admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:07.686669 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee04417-4908-417a-ad88-4407b2518fe1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:07.687397 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee04417-4908-417a-ad88-4407b2518fe1 service cinder] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:07.687754 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee04417-4908-417a-ad88-4407b2518fe1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:07.688260 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee04417-4908-417a-ad88-4407b2518fe1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:07.760404 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee04417-4908-417a-ad88-4407b2518fe1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:07.761864 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee04417-4908-417a-ad88-4407b2518fe1 service cinder] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:07.776263 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1212/2416] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:18:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:18:10.412712 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c960a78-22b9-4665-bf39-78c8e7cde5e3 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:10.412712 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3c960a78-22b9-4665-bf39-78c8e7cde5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:10.491326 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c960a78-22b9-4665-bf39-78c8e7cde5e3 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:10.496020 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796508eb-9658-466b-a531-9f096c3f4265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:10.496812 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796508eb-9658-466b-a531-9f096c3f4265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:10.497269 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796508eb-9658-466b-a531-9f096c3f4265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:10.497710 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796508eb-9658-466b-a531-9f096c3f4265 admin admin] PATH_INFO: `/v3/users/f6448e0a06444705abd41215526e939c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:10.499188 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796508eb-9658-466b-a531-9f096c3f4265 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6448e0a06444705abd41215526e939c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:10.501375 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796508eb-9658-466b-a531-9f096c3f4265 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:10.694661 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-796508eb-9658-466b-a531-9f096c3f4265 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6448e0a06444705abd41215526e939c'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:10.762884 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-796508eb-9658-466b-a531-9f096c3f4265 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6448e0a06444705abd41215526e939c'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:10.764320 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:10.776802 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-796508eb-9658-466b-a531-9f096c3f4265 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6448e0a06444705abd41215526e939c'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:10.783543 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-796508eb-9658-466b-a531-9f096c3f4265 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6448e0a06444705abd41215526e939c'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:10.784292 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-796508eb-9658-466b-a531-9f096c3f4265 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6448e0a06444705abd41215526e939c'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:10.790472 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1205/2417] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:18:10 2022] DELETE /identity/v3/users/f6448e0a06444705abd41215526e939c => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:18:11.039259 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee04417-4908-417a-ad88-4407b2518fe1 service cinder] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:11.052220 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee04417-4908-417a-ad88-4407b2518fe1 service cinder] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:11.066437 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:11.111772 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40500c01-eec7-41ad-8d7e-da74bdf0950d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:11.112431 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40500c01-eec7-41ad-8d7e-da74bdf0950d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:11.112713 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40500c01-eec7-41ad-8d7e-da74bdf0950d admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:11.112985 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40500c01-eec7-41ad-8d7e-da74bdf0950d admin admin] PATH_INFO: `/v3/projects/6cac0dfe7a724b3d9b72a317e8edce68` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:11.114128 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40500c01-eec7-41ad-8d7e-da74bdf0950d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cac0dfe7a724b3d9b72a317e8edce68)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:11.116574 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40500c01-eec7-41ad-8d7e-da74bdf0950d admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:11.214324 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-40500c01-eec7-41ad-8d7e-da74bdf0950d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cac0dfe7a724b3d9b72a317e8edce68', 'request_id': 'req-40500c01-eec7-41ad-8d7e-da74bdf0950d'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:11.310222 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-40500c01-eec7-41ad-8d7e-da74bdf0950d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cac0dfe7a724b3d9b72a317e8edce68', 'request_id': 'req-40500c01-eec7-41ad-8d7e-da74bdf0950d'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:11.316865 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-40500c01-eec7-41ad-8d7e-da74bdf0950d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cac0dfe7a724b3d9b72a317e8edce68', 'request_id': 'req-40500c01-eec7-41ad-8d7e-da74bdf0950d'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:11.327147 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-40500c01-eec7-41ad-8d7e-da74bdf0950d admin admin] The token cache is being invalidate because project 6cac0dfe7a724b3d9b72a317e8edce68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:18:11.327432 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-40500c01-eec7-41ad-8d7e-da74bdf0950d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:11.328135 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-40500c01-eec7-41ad-8d7e-da74bdf0950d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:11.329609 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1213/2418] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:18:11 2022] DELETE /identity/v3/projects/6cac0dfe7a724b3d9b72a317e8edce68 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:18:11.333688 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796508eb-9658-466b-a531-9f096c3f4265 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:11.335398 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-796508eb-9658-466b-a531-9f096c3f4265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:11.348292 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796508eb-9658-466b-a531-9f096c3f4265 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:11.411598 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c02fe53-b2e2-441b-8fe4-b77257ff7d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:11.412958 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02fe53-b2e2-441b-8fe4-b77257ff7d2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:11.413537 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02fe53-b2e2-441b-8fe4-b77257ff7d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:11.413537 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02fe53-b2e2-441b-8fe4-b77257ff7d2a admin admin] PATH_INFO: `/v3/users/36d611dad36c44d3940ac6db7e0acac4` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:11.414737 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c02fe53-b2e2-441b-8fe4-b77257ff7d2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=36d611dad36c44d3940ac6db7e0acac4)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:11.416762 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c02fe53-b2e2-441b-8fe4-b77257ff7d2a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:11.594044 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4c02fe53-b2e2-441b-8fe4-b77257ff7d2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36d611dad36c44d3940ac6db7e0acac4'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:11.660684 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4c02fe53-b2e2-441b-8fe4-b77257ff7d2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36d611dad36c44d3940ac6db7e0acac4'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:11.675445 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4c02fe53-b2e2-441b-8fe4-b77257ff7d2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36d611dad36c44d3940ac6db7e0acac4'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:11.683307 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4c02fe53-b2e2-441b-8fe4-b77257ff7d2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36d611dad36c44d3940ac6db7e0acac4'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:11.684035 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4c02fe53-b2e2-441b-8fe4-b77257ff7d2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36d611dad36c44d3940ac6db7e0acac4'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:11.690669 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1206/2419] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:18:11 2022] DELETE /identity/v3/users/36d611dad36c44d3940ac6db7e0acac4 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:18:11.959766 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40500c01-eec7-41ad-8d7e-da74bdf0950d admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:11.964252 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-40500c01-eec7-41ad-8d7e-da74bdf0950d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:11.974518 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40500c01-eec7-41ad-8d7e-da74bdf0950d admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:12.012497 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c02fe53-b2e2-441b-8fe4-b77257ff7d2a admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:12.014160 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4c02fe53-b2e2-441b-8fe4-b77257ff7d2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:12.054563 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb4980-c925-43ac-9ded-274fc7df04e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:12.055260 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb4980-c925-43ac-9ded-274fc7df04e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:12.055544 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb4980-c925-43ac-9ded-274fc7df04e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:12.055819 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb4980-c925-43ac-9ded-274fc7df04e2 admin admin] PATH_INFO: `/v3/projects/b27d16291cb345849b5e2aeab2c2b04b` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:12.057105 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb4980-c925-43ac-9ded-274fc7df04e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b27d16291cb345849b5e2aeab2c2b04b)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:12.059095 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb4980-c925-43ac-9ded-274fc7df04e2 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:12.075987 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c02fe53-b2e2-441b-8fe4-b77257ff7d2a admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:12.079810 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3f766-c0e4-42d7-ba69-a56de242ca53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:12.080531 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3f766-c0e4-42d7-ba69-a56de242ca53 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:12.080815 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3f766-c0e4-42d7-ba69-a56de242ca53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:12.083369 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3f766-c0e4-42d7-ba69-a56de242ca53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:12.084121 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-50e3f766-c0e4-42d7-ba69-a56de242ca53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:12.092966 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:12.096672 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e3f766-c0e4-42d7-ba69-a56de242ca53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:12.098174 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e3f766-c0e4-42d7-ba69-a56de242ca53 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:12.108743 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1207/2420] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:18:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:18:12.172169 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-56eb4980-c925-43ac-9ded-274fc7df04e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b27d16291cb345849b5e2aeab2c2b04b', 'request_id': 'req-56eb4980-c925-43ac-9ded-274fc7df04e2'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:12.174249 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:12.277485 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-56eb4980-c925-43ac-9ded-274fc7df04e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b27d16291cb345849b5e2aeab2c2b04b', 'request_id': 'req-56eb4980-c925-43ac-9ded-274fc7df04e2'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:12.284684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-56eb4980-c925-43ac-9ded-274fc7df04e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b27d16291cb345849b5e2aeab2c2b04b', 'request_id': 'req-56eb4980-c925-43ac-9ded-274fc7df04e2'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:12.299711 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-56eb4980-c925-43ac-9ded-274fc7df04e2 admin admin] The token cache is being invalidate because project b27d16291cb345849b5e2aeab2c2b04b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:18:12.300001 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-56eb4980-c925-43ac-9ded-274fc7df04e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:12.300961 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-56eb4980-c925-43ac-9ded-274fc7df04e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:12.302351 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1214/2421] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:18:11 2022] DELETE /identity/v3/projects/b27d16291cb345849b5e2aeab2c2b04b => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:18:13.527059 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3f766-c0e4-42d7-ba69-a56de242ca53 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:13.528564 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-50e3f766-c0e4-42d7-ba69-a56de242ca53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:13.589913 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3f766-c0e4-42d7-ba69-a56de242ca53 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:13.650736 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e44bc1-ba25-4efd-934e-c353e123c514 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:13.651381 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e44bc1-ba25-4efd-934e-c353e123c514 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:13.651798 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e44bc1-ba25-4efd-934e-c353e123c514 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:13.652103 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e44bc1-ba25-4efd-934e-c353e123c514 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:13.653831 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-90e44bc1-ba25-4efd-934e-c353e123c514 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:13.730681 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e44bc1-ba25-4efd-934e-c353e123c514 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:13.732037 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e44bc1-ba25-4efd-934e-c353e123c514 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:13.744139 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1208/2422] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:18:13 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:18:19.214657 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb4980-c925-43ac-9ded-274fc7df04e2 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:19.216197 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-56eb4980-c925-43ac-9ded-274fc7df04e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:19.284158 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb4980-c925-43ac-9ded-274fc7df04e2 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:19.288627 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3070177-53b2-4df7-b824-3182ccdd3c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:19.289269 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3070177-53b2-4df7-b824-3182ccdd3c1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:19.289547 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3070177-53b2-4df7-b824-3182ccdd3c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:19.289816 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3070177-53b2-4df7-b824-3182ccdd3c1d admin admin] PATH_INFO: `/v3/users/efbaebe9814441faa4efed0b4e4c7181` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:19.290910 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3070177-53b2-4df7-b824-3182ccdd3c1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=efbaebe9814441faa4efed0b4e4c7181)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:19.292843 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3070177-53b2-4df7-b824-3182ccdd3c1d admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:19.492749 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-a3070177-53b2-4df7-b824-3182ccdd3c1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efbaebe9814441faa4efed0b4e4c7181'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:19.591539 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-a3070177-53b2-4df7-b824-3182ccdd3c1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efbaebe9814441faa4efed0b4e4c7181'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:19.608336 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-a3070177-53b2-4df7-b824-3182ccdd3c1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efbaebe9814441faa4efed0b4e4c7181'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:19.609331 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-a3070177-53b2-4df7-b824-3182ccdd3c1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efbaebe9814441faa4efed0b4e4c7181'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:19.617590 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-a3070177-53b2-4df7-b824-3182ccdd3c1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efbaebe9814441faa4efed0b4e4c7181'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:19.623541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e44bc1-ba25-4efd-934e-c353e123c514 service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:19.625135 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-90e44bc1-ba25-4efd-934e-c353e123c514 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:19.625520 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1215/2423] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:18:19 2022] DELETE /identity/v3/users/efbaebe9814441faa4efed0b4e4c7181 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:18:19.638644 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e44bc1-ba25-4efd-934e-c353e123c514 service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:19.697814 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de854a50-9cf5-4257-88c4-683fd9fa0fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:19.698463 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de854a50-9cf5-4257-88c4-683fd9fa0fdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:19.698750 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de854a50-9cf5-4257-88c4-683fd9fa0fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:19.699029 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de854a50-9cf5-4257-88c4-683fd9fa0fdc admin admin] PATH_INFO: `/v3/users/2a4c12cdf9334ac7b1b859dfbb5ddd0f` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:19.700480 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de854a50-9cf5-4257-88c4-683fd9fa0fdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a4c12cdf9334ac7b1b859dfbb5ddd0f)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:19.703241 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de854a50-9cf5-4257-88c4-683fd9fa0fdc admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:19.705056 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:19.891136 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-de854a50-9cf5-4257-88c4-683fd9fa0fdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a4c12cdf9334ac7b1b859dfbb5ddd0f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:19.925709 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3070177-53b2-4df7-b824-3182ccdd3c1d admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:19.927649 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-a3070177-53b2-4df7-b824-3182ccdd3c1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:19.946830 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3070177-53b2-4df7-b824-3182ccdd3c1d admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:19.951979 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39263d7-7eb6-4a71-a660-57981dc114e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:19.952669 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39263d7-7eb6-4a71-a660-57981dc114e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:19.952946 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39263d7-7eb6-4a71-a660-57981dc114e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:19.953218 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39263d7-7eb6-4a71-a660-57981dc114e6 admin admin] PATH_INFO: `/v3/projects/0ad996fc626841a8ae82fd8891084a3a` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:19.954500 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39263d7-7eb6-4a71-a660-57981dc114e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ad996fc626841a8ae82fd8891084a3a)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:19.960265 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39263d7-7eb6-4a71-a660-57981dc114e6 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:19.968643 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-de854a50-9cf5-4257-88c4-683fd9fa0fdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a4c12cdf9334ac7b1b859dfbb5ddd0f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:19.984215 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-de854a50-9cf5-4257-88c4-683fd9fa0fdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a4c12cdf9334ac7b1b859dfbb5ddd0f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:19.991837 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-de854a50-9cf5-4257-88c4-683fd9fa0fdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a4c12cdf9334ac7b1b859dfbb5ddd0f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:19.992596 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-de854a50-9cf5-4257-88c4-683fd9fa0fdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a4c12cdf9334ac7b1b859dfbb5ddd0f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:19.999031 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1209/2424] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:18:19 2022] DELETE /identity/v3/users/2a4c12cdf9334ac7b1b859dfbb5ddd0f => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:18:20.003832 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe2116-4415-4c39-ba16-64d5ebaa18c8 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:20.004162 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe2116-4415-4c39-ba16-64d5ebaa18c8 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:20.005554 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe2116-4415-4c39-ba16-64d5ebaa18c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:20.027004 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-64fe2116-4415-4c39-ba16-64d5ebaa18c8 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:18:20.028375 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-64fe2116-4415-4c39-ba16-64d5ebaa18c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:20.065745 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-f39263d7-7eb6-4a71-a660-57981dc114e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ad996fc626841a8ae82fd8891084a3a', 'request_id': 'req-f39263d7-7eb6-4a71-a660-57981dc114e6'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:20.068389 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:INSERT=3,keystone:DELETE=17,keystone:SELECT=80 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:20.097012 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1210/2425] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:18:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:18:20.107360 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe2116-4415-4c39-ba16-64d5ebaa18c8 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:20.108983 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-64fe2116-4415-4c39-ba16-64d5ebaa18c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:20.151375 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-f39263d7-7eb6-4a71-a660-57981dc114e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ad996fc626841a8ae82fd8891084a3a', 'request_id': 'req-f39263d7-7eb6-4a71-a660-57981dc114e6'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:20.158228 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-f39263d7-7eb6-4a71-a660-57981dc114e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ad996fc626841a8ae82fd8891084a3a', 'request_id': 'req-f39263d7-7eb6-4a71-a660-57981dc114e6'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:20.168830 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe2116-4415-4c39-ba16-64d5ebaa18c8 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:20.169041 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-f39263d7-7eb6-4a71-a660-57981dc114e6 admin admin] The token cache is being invalidate because project 0ad996fc626841a8ae82fd8891084a3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:18:20.169182 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-f39263d7-7eb6-4a71-a660-57981dc114e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:20.169831 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-f39263d7-7eb6-4a71-a660-57981dc114e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:20.171333 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1216/2426] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:18:19 2022] DELETE /identity/v3/projects/0ad996fc626841a8ae82fd8891084a3a => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:18:20.181436 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39263d7-7eb6-4a71-a660-57981dc114e6 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:20.182917 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-f39263d7-7eb6-4a71-a660-57981dc114e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:20.209237 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:20.227618 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60ce52-0b22-41ae-b458-f585924b159d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:20.228285 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60ce52-0b22-41ae-b458-f585924b159d service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:20.228569 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60ce52-0b22-41ae-b458-f585924b159d service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:20.228841 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60ce52-0b22-41ae-b458-f585924b159d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:20.230689 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9a60ce52-0b22-41ae-b458-f585924b159d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:20.264260 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39263d7-7eb6-4a71-a660-57981dc114e6 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:20.273983 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a08ff-c81f-44f8-9397-18d1ee4ab523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:20.274646 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a08ff-c81f-44f8-9397-18d1ee4ab523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:20.274929 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a08ff-c81f-44f8-9397-18d1ee4ab523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:20.275208 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a08ff-c81f-44f8-9397-18d1ee4ab523 admin admin] PATH_INFO: `/v3/users/e73b94ef47a44d249ffc3539bd480142` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:20.276392 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259a08ff-c81f-44f8-9397-18d1ee4ab523 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e73b94ef47a44d249ffc3539bd480142)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:20.278315 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259a08ff-c81f-44f8-9397-18d1ee4ab523 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:20.307941 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60ce52-0b22-41ae-b458-f585924b159d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:20.309467 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60ce52-0b22-41ae-b458-f585924b159d service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:20.324216 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1211/2427] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:18:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:18:20.466373 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-259a08ff-c81f-44f8-9397-18d1ee4ab523 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e73b94ef47a44d249ffc3539bd480142'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:20.523640 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-259a08ff-c81f-44f8-9397-18d1ee4ab523 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e73b94ef47a44d249ffc3539bd480142'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:20.545495 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-259a08ff-c81f-44f8-9397-18d1ee4ab523 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e73b94ef47a44d249ffc3539bd480142'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:20.546612 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-259a08ff-c81f-44f8-9397-18d1ee4ab523 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e73b94ef47a44d249ffc3539bd480142'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:20.560760 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-259a08ff-c81f-44f8-9397-18d1ee4ab523 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e73b94ef47a44d249ffc3539bd480142'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:20.572173 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1217/2428] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:18:20 2022] DELETE /identity/v3/users/e73b94ef47a44d249ffc3539bd480142 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:18:20.780797 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60ce52-0b22-41ae-b458-f585924b159d service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:20.787989 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9a60ce52-0b22-41ae-b458-f585924b159d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:20.795057 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60ce52-0b22-41ae-b458-f585924b159d service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:20.845745 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a08ff-c81f-44f8-9397-18d1ee4ab523 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:20.847313 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-259a08ff-c81f-44f8-9397-18d1ee4ab523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:20.857447 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a29a83-2868-4148-9909-27483aaa30b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:20.858231 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a29a83-2868-4148-9909-27483aaa30b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:20.858665 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a29a83-2868-4148-9909-27483aaa30b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:20.858911 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a29a83-2868-4148-9909-27483aaa30b5 admin admin] PATH_INFO: `/v3/projects/1f4ccf146a6a477ca125181a849586c7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:20.860047 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a29a83-2868-4148-9909-27483aaa30b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f4ccf146a6a477ca125181a849586c7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:20.862074 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a29a83-2868-4148-9909-27483aaa30b5 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:20.920009 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a08ff-c81f-44f8-9397-18d1ee4ab523 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:20.924827 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da578bb-effc-41d1-acc5-54e0e761c6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:20.925457 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da578bb-effc-41d1-acc5-54e0e761c6eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:20.925741 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da578bb-effc-41d1-acc5-54e0e761c6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:20.926015 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da578bb-effc-41d1-acc5-54e0e761c6eb admin admin] PATH_INFO: `/v3/projects/d6c4059f3f0e4b85ac633f17b2a2658b` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:20.927130 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da578bb-effc-41d1-acc5-54e0e761c6eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6c4059f3f0e4b85ac633f17b2a2658b)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:20.929219 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da578bb-effc-41d1-acc5-54e0e761c6eb admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:20.930688 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:20.992338 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-68a29a83-2868-4148-9909-27483aaa30b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f4ccf146a6a477ca125181a849586c7', 'request_id': 'req-68a29a83-2868-4148-9909-27483aaa30b5'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:20.998687 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-68a29a83-2868-4148-9909-27483aaa30b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f4ccf146a6a477ca125181a849586c7', 'request_id': 'req-68a29a83-2868-4148-9909-27483aaa30b5'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:21.053810 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-6da578bb-effc-41d1-acc5-54e0e761c6eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6c4059f3f0e4b85ac633f17b2a2658b', 'request_id': 'req-6da578bb-effc-41d1-acc5-54e0e761c6eb'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:21.105408 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-68a29a83-2868-4148-9909-27483aaa30b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f4ccf146a6a477ca125181a849586c7', 'request_id': 'req-68a29a83-2868-4148-9909-27483aaa30b5'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:21.116654 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-68a29a83-2868-4148-9909-27483aaa30b5 admin admin] The token cache is being invalidate because project 1f4ccf146a6a477ca125181a849586c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:18:21.116950 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-68a29a83-2868-4148-9909-27483aaa30b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:21.117575 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-68a29a83-2868-4148-9909-27483aaa30b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:21.119260 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1212/2429] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:18:20 2022] DELETE /identity/v3/projects/1f4ccf146a6a477ca125181a849586c7 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:18:21.122837 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a29a83-2868-4148-9909-27483aaa30b5 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:21.124146 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-68a29a83-2868-4148-9909-27483aaa30b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:21.141804 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:21.157168 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-6da578bb-effc-41d1-acc5-54e0e761c6eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6c4059f3f0e4b85ac633f17b2a2658b', 'request_id': 'req-6da578bb-effc-41d1-acc5-54e0e761c6eb'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:21.164333 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-6da578bb-effc-41d1-acc5-54e0e761c6eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6c4059f3f0e4b85ac633f17b2a2658b', 'request_id': 'req-6da578bb-effc-41d1-acc5-54e0e761c6eb'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:21.176353 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-6da578bb-effc-41d1-acc5-54e0e761c6eb admin admin] The token cache is being invalidate because project d6c4059f3f0e4b85ac633f17b2a2658b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:18:21.176643 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-6da578bb-effc-41d1-acc5-54e0e761c6eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:21.177299 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-6da578bb-effc-41d1-acc5-54e0e761c6eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:21.178785 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1218/2430] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:18:20 2022] DELETE /identity/v3/projects/d6c4059f3f0e4b85ac633f17b2a2658b => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:18:21.189579 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a29a83-2868-4148-9909-27483aaa30b5 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:21.256172 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c2e77-3471-4512-b0e4-e7fef99cfd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:21.256980 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c2e77-3471-4512-b0e4-e7fef99cfd4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:21.257217 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c2e77-3471-4512-b0e4-e7fef99cfd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:21.257682 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c2e77-3471-4512-b0e4-e7fef99cfd4c admin admin] PATH_INFO: `/v3/users/7dedcdf4e4b44ba7948638fe389c27f0` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:21.258956 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c2e77-3471-4512-b0e4-e7fef99cfd4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dedcdf4e4b44ba7948638fe389c27f0)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:21.260981 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c2e77-3471-4512-b0e4-e7fef99cfd4c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:21.446004 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0c1c2e77-3471-4512-b0e4-e7fef99cfd4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dedcdf4e4b44ba7948638fe389c27f0'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:21.533677 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0c1c2e77-3471-4512-b0e4-e7fef99cfd4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dedcdf4e4b44ba7948638fe389c27f0'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:21.547187 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0c1c2e77-3471-4512-b0e4-e7fef99cfd4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dedcdf4e4b44ba7948638fe389c27f0'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:21.555656 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0c1c2e77-3471-4512-b0e4-e7fef99cfd4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dedcdf4e4b44ba7948638fe389c27f0'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:21.556513 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0c1c2e77-3471-4512-b0e4-e7fef99cfd4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dedcdf4e4b44ba7948638fe389c27f0'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:21.562530 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1213/2431] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:18:21 2022] DELETE /identity/v3/users/7dedcdf4e4b44ba7948638fe389c27f0 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:18:21.969655 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da578bb-effc-41d1-acc5-54e0e761c6eb admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:21.970991 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-6da578bb-effc-41d1-acc5-54e0e761c6eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:21.985103 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da578bb-effc-41d1-acc5-54e0e761c6eb admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:22.055125 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981c530-5c9e-4d73-a9f8-ce2cda027621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:22.055760 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981c530-5c9e-4d73-a9f8-ce2cda027621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:22.056044 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981c530-5c9e-4d73-a9f8-ce2cda027621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:22.056351 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981c530-5c9e-4d73-a9f8-ce2cda027621 admin admin] PATH_INFO: `/v3/projects/bd5b7fc6f6164fc18d1f8db7afa6a146` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:22.057500 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981c530-5c9e-4d73-a9f8-ce2cda027621 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd5b7fc6f6164fc18d1f8db7afa6a146)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:22.059428 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981c530-5c9e-4d73-a9f8-ce2cda027621 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:22.191039 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-f981c530-5c9e-4d73-a9f8-ce2cda027621 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd5b7fc6f6164fc18d1f8db7afa6a146', 'request_id': 'req-f981c530-5c9e-4d73-a9f8-ce2cda027621'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:22.339995 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-f981c530-5c9e-4d73-a9f8-ce2cda027621 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd5b7fc6f6164fc18d1f8db7afa6a146', 'request_id': 'req-f981c530-5c9e-4d73-a9f8-ce2cda027621'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:22.347126 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-f981c530-5c9e-4d73-a9f8-ce2cda027621 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd5b7fc6f6164fc18d1f8db7afa6a146', 'request_id': 'req-f981c530-5c9e-4d73-a9f8-ce2cda027621'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:22.358593 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-f981c530-5c9e-4d73-a9f8-ce2cda027621 admin admin] The token cache is being invalidate because project bd5b7fc6f6164fc18d1f8db7afa6a146 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:18:22.358880 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-f981c530-5c9e-4d73-a9f8-ce2cda027621 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:22.359508 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-f981c530-5c9e-4d73-a9f8-ce2cda027621 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:22.361014 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1219/2432] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:18:21 2022] DELETE /identity/v3/projects/bd5b7fc6f6164fc18d1f8db7afa6a146 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:18:22.367003 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba5e21-d217-43d9-ab5b-78a82d7e1994 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:22.367447 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba5e21-d217-43d9-ab5b-78a82d7e1994 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:22.367583 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba5e21-d217-43d9-ab5b-78a82d7e1994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:22.387302 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-94ba5e21-d217-43d9-ab5b-78a82d7e1994 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:18:22.388547 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-94ba5e21-d217-43d9-ab5b-78a82d7e1994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:22.426888 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:22.446769 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1214/2433] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:18:22.455237 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb47a24-a654-4703-b4b3-25da65cb2b68 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:22.456182 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb47a24-a654-4703-b4b3-25da65cb2b68 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:22.456471 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb47a24-a654-4703-b4b3-25da65cb2b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:22.476985 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-beb47a24-a654-4703-b4b3-25da65cb2b68 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:18:22.478188 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-beb47a24-a654-4703-b4b3-25da65cb2b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:22.486401 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1220/2434] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:18:22.490335 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba5e21-d217-43d9-ab5b-78a82d7e1994 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:22.500087 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba5e21-d217-43d9-ab5b-78a82d7e1994 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:22.504657 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dbeab4-d405-41de-af2e-2857edd04cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:22.505259 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbeab4-d405-41de-af2e-2857edd04cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:22.506046 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbeab4-d405-41de-af2e-2857edd04cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:22.506324 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbeab4-d405-41de-af2e-2857edd04cb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:22.506964 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dbeab4-d405-41de-af2e-2857edd04cb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:18:22.507270 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dbeab4-d405-41de-af2e-2857edd04cb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:22.508919 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dbeab4-d405-41de-af2e-2857edd04cb8 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:22.520641 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1215/2435] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:18:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:18:22.525372 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb47a24-a654-4703-b4b3-25da65cb2b68 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:22.534594 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb47a24-a654-4703-b4b3-25da65cb2b68 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:22.539243 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e351a-91bf-4ff1-af03-3b06863e8f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:22.539838 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e351a-91bf-4ff1-af03-3b06863e8f01 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:22.540156 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e351a-91bf-4ff1-af03-3b06863e8f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:22.540432 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e351a-91bf-4ff1-af03-3b06863e8f01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:22.541061 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e351a-91bf-4ff1-af03-3b06863e8f01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:22.542980 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e351a-91bf-4ff1-af03-3b06863e8f01 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:22.554150 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:22.614316 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1221/2436] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:18:22 2022] POST /identity/v3/projects => generated 385 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:18:22.618582 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dbeab4-d405-41de-af2e-2857edd04cb8 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:22.628484 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dbeab4-d405-41de-af2e-2857edd04cb8 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:22.685314 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab13af7-f018-403a-9a70-f5032917da45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:22.685991 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab13af7-f018-403a-9a70-f5032917da45 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:22.686274 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab13af7-f018-403a-9a70-f5032917da45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:22.686553 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab13af7-f018-403a-9a70-f5032917da45 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:22.687176 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab13af7-f018-403a-9a70-f5032917da45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:22.689139 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab13af7-f018-403a-9a70-f5032917da45 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:22.814379 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1216/2437] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:18:22 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:18:22.818566 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e351a-91bf-4ff1-af03-3b06863e8f01 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:22.830311 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e351a-91bf-4ff1-af03-3b06863e8f01 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:22.834997 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba25b0b-95b7-4851-947d-bfcce30c5cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:22.835592 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba25b0b-95b7-4851-947d-bfcce30c5cec admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:22.835871 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba25b0b-95b7-4851-947d-bfcce30c5cec admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:22.836189 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba25b0b-95b7-4851-947d-bfcce30c5cec admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:22.836856 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba25b0b-95b7-4851-947d-bfcce30c5cec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:22.838517 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba25b0b-95b7-4851-947d-bfcce30c5cec admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:22.848254 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1222/2438] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:18:22.851974 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab13af7-f018-403a-9a70-f5032917da45 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:22.862248 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab13af7-f018-403a-9a70-f5032917da45 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:22.867470 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18592d-1c6f-4d9a-8099-8d6a0aadf6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:22.868009 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18592d-1c6f-4d9a-8099-8d6a0aadf6e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:22.868317 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18592d-1c6f-4d9a-8099-8d6a0aadf6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:22.868592 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18592d-1c6f-4d9a-8099-8d6a0aadf6e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:22.869227 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c18592d-1c6f-4d9a-8099-8d6a0aadf6e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:22.870817 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c18592d-1c6f-4d9a-8099-8d6a0aadf6e0 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:22.881279 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1217/2439] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:18:22.885884 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba25b0b-95b7-4851-947d-bfcce30c5cec admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:22.895597 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba25b0b-95b7-4851-947d-bfcce30c5cec admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:22.900385 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb9acb-11c2-44bb-bcdb-d33fde7f897b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:22.901032 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb9acb-11c2-44bb-bcdb-d33fde7f897b admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:22.901313 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb9acb-11c2-44bb-bcdb-d33fde7f897b admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:22.901590 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb9acb-11c2-44bb-bcdb-d33fde7f897b admin admin] PATH_INFO: `/v3/projects/e93d9978c389472980503457cab8d146/users/712375f0913f4b74aa71195b0f20625f/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:22.915692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb9acb-11c2-44bb-bcdb-d33fde7f897b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e93d9978c389472980503457cab8d146, user_id=712375f0913f4b74aa71195b0f20625f, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:22.918352 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb9acb-11c2-44bb-bcdb-d33fde7f897b admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:23.002539 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1223/2440] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:18:22 2022] PUT /identity/v3/projects/e93d9978c389472980503457cab8d146/users/712375f0913f4b74aa71195b0f20625f/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:18:23.014961 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbe88e-fae2-4bde-a0cf-25745a47df6b None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:23.015254 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbe88e-fae2-4bde-a0cf-25745a47df6b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:23.015527 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbe88e-fae2-4bde-a0cf-25745a47df6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:23.043211 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-81bbe88e-fae2-4bde-a0cf-25745a47df6b None None] MFA Rules not processed for user `712375f0913f4b74aa71195b0f20625f`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:18:23.044466 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-81bbe88e-fae2-4bde-a0cf-25745a47df6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:23.107961 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1218/2441] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:18:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:18:23.120134 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb9acb-11c2-44bb-bcdb-d33fde7f897b admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:23.121867 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-7fdb9acb-11c2-44bb-bcdb-d33fde7f897b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:23.178254 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb9acb-11c2-44bb-bcdb-d33fde7f897b admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:23.182580 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34e759-cb1f-4363-b1dc-d67c7d951b0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:23.183188 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34e759-cb1f-4363-b1dc-d67c7d951b0f service cinder] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:23.183472 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34e759-cb1f-4363-b1dc-d67c7d951b0f service cinder] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:23.183747 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34e759-cb1f-4363-b1dc-d67c7d951b0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:23.192187 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34e759-cb1f-4363-b1dc-d67c7d951b0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:23.193613 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34e759-cb1f-4363-b1dc-d67c7d951b0f service cinder] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:23.202545 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1224/2442] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:18:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:18:29.847910 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bbe88e-fae2-4bde-a0cf-25745a47df6b None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:29.889729 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:29.910946 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bbe88e-fae2-4bde-a0cf-25745a47df6b None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:29.915479 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f2912-44e2-4e46-b13d-a1d1440f4c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:29.916142 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f2912-44e2-4e46-b13d-a1d1440f4c1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:29.916427 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f2912-44e2-4e46-b13d-a1d1440f4c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:29.916703 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f2912-44e2-4e46-b13d-a1d1440f4c1e admin admin] PATH_INFO: `/v3/users/712375f0913f4b74aa71195b0f20625f` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:29.917807 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f2912-44e2-4e46-b13d-a1d1440f4c1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=712375f0913f4b74aa71195b0f20625f)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:29.919728 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f2912-44e2-4e46-b13d-a1d1440f4c1e admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:30.038861 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f71f2912-44e2-4e46-b13d-a1d1440f4c1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '712375f0913f4b74aa71195b0f20625f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:30.082160 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f71f2912-44e2-4e46-b13d-a1d1440f4c1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '712375f0913f4b74aa71195b0f20625f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:30.094520 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f71f2912-44e2-4e46-b13d-a1d1440f4c1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '712375f0913f4b74aa71195b0f20625f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:30.101418 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f71f2912-44e2-4e46-b13d-a1d1440f4c1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '712375f0913f4b74aa71195b0f20625f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:30.102058 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f71f2912-44e2-4e46-b13d-a1d1440f4c1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '712375f0913f4b74aa71195b0f20625f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:30.107876 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1219/2443] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:18:29 2022] DELETE /identity/v3/users/712375f0913f4b74aa71195b0f20625f => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:18:30.112586 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9a749-eb0c-4a88-9dbe-4ae8e95b8186 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:30.113104 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9a749-eb0c-4a88-9dbe-4ae8e95b8186 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:30.113205 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9a749-eb0c-4a88-9dbe-4ae8e95b8186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:30.131708 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-3bb9a749-eb0c-4a88-9dbe-4ae8e95b8186 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:18:30.133031 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-3bb9a749-eb0c-4a88-9dbe-4ae8e95b8186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:30.190782 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1225/2444] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:18:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:18:30.200959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f2912-44e2-4e46-b13d-a1d1440f4c1e admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:30.202355 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f71f2912-44e2-4e46-b13d-a1d1440f4c1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:30.259904 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f2912-44e2-4e46-b13d-a1d1440f4c1e admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:30.263694 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773f17a-4063-49ba-8326-353f8e7585f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:30.264347 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773f17a-4063-49ba-8326-353f8e7585f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:30.264632 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773f17a-4063-49ba-8326-353f8e7585f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:30.264912 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773f17a-4063-49ba-8326-353f8e7585f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:30.275298 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f773f17a-4063-49ba-8326-353f8e7585f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:30.276780 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f773f17a-4063-49ba-8326-353f8e7585f2 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:30.286452 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1220/2445] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:18:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:18:30.756985 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9a749-eb0c-4a88-9dbe-4ae8e95b8186 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:30.758426 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-3bb9a749-eb0c-4a88-9dbe-4ae8e95b8186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:30.770781 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9a749-eb0c-4a88-9dbe-4ae8e95b8186 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:30.775606 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9ba6f-84f1-442d-bccf-bd864ea569cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:30.776312 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9ba6f-84f1-442d-bccf-bd864ea569cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:30.776596 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9ba6f-84f1-442d-bccf-bd864ea569cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:30.776876 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9ba6f-84f1-442d-bccf-bd864ea569cb admin admin] PATH_INFO: `/v3/projects/e93d9978c389472980503457cab8d146` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:30.778049 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9ba6f-84f1-442d-bccf-bd864ea569cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e93d9978c389472980503457cab8d146)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:30.779919 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9ba6f-84f1-442d-bccf-bd864ea569cb admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:30.904448 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-32b9ba6f-84f1-442d-bccf-bd864ea569cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e93d9978c389472980503457cab8d146', 'request_id': 'req-32b9ba6f-84f1-442d-bccf-bd864ea569cb'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:30.908241 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:31.065344 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-32b9ba6f-84f1-442d-bccf-bd864ea569cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e93d9978c389472980503457cab8d146', 'request_id': 'req-32b9ba6f-84f1-442d-bccf-bd864ea569cb'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:31.073077 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-32b9ba6f-84f1-442d-bccf-bd864ea569cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e93d9978c389472980503457cab8d146', 'request_id': 'req-32b9ba6f-84f1-442d-bccf-bd864ea569cb'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:31.083409 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-32b9ba6f-84f1-442d-bccf-bd864ea569cb admin admin] The token cache is being invalidate because project e93d9978c389472980503457cab8d146 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:18:31.083701 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-32b9ba6f-84f1-442d-bccf-bd864ea569cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:31.084375 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-32b9ba6f-84f1-442d-bccf-bd864ea569cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:18:31.085864 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1226/2446] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:18:30 2022] DELETE /identity/v3/projects/e93d9978c389472980503457cab8d146 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:18:31.090774 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bc0f4-fcb5-4611-b3e3-c7c5f70b0e07 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:31.091566 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bc0f4-fcb5-4611-b3e3-c7c5f70b0e07 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:31.091566 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bc0f4-fcb5-4611-b3e3-c7c5f70b0e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:31.110996 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-ee8bc0f4-fcb5-4611-b3e3-c7c5f70b0e07 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:18:31.112238 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ee8bc0f4-fcb5-4611-b3e3-c7c5f70b0e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:31.163539 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:31.171775 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1221/2447] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:18:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:18:31.234869 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfd464-eec9-4c10-b9dc-c24ab3177f15 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:31.235431 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfd464-eec9-4c10-b9dc-c24ab3177f15 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:31.235431 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfd464-eec9-4c10-b9dc-c24ab3177f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:31.255294 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-a4cfd464-eec9-4c10-b9dc-c24ab3177f15 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:18:31.256555 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-a4cfd464-eec9-4c10-b9dc-c24ab3177f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:31.265097 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1227/2448] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:18:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:18:31.269507 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8bc0f4-fcb5-4611-b3e3-c7c5f70b0e07 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:31.279528 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8bc0f4-fcb5-4611-b3e3-c7c5f70b0e07 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:31.284809 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730e8d6-9a81-45a7-b2df-051641ad5f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:31.285403 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730e8d6-9a81-45a7-b2df-051641ad5f86 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:31.285690 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730e8d6-9a81-45a7-b2df-051641ad5f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:31.285965 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730e8d6-9a81-45a7-b2df-051641ad5f86 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:31.286604 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a730e8d6-9a81-45a7-b2df-051641ad5f86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:18:31.286909 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a730e8d6-9a81-45a7-b2df-051641ad5f86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:31.288544 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a730e8d6-9a81-45a7-b2df-051641ad5f86 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:31.300025 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1222/2449] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:18:31.304267 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfd464-eec9-4c10-b9dc-c24ab3177f15 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:31.313772 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfd464-eec9-4c10-b9dc-c24ab3177f15 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:31.318436 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8efba-6b52-49f2-826e-70f8486e98bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:31.319039 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8efba-6b52-49f2-826e-70f8486e98bb admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:31.319323 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8efba-6b52-49f2-826e-70f8486e98bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:31.319598 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8efba-6b52-49f2-826e-70f8486e98bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:31.320289 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8efba-6b52-49f2-826e-70f8486e98bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:31.322912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8efba-6b52-49f2-826e-70f8486e98bb admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:31.403727 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1228/2450] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:18:31 2022] POST /identity/v3/projects => generated 361 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:18:31.407949 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730e8d6-9a81-45a7-b2df-051641ad5f86 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:31.418829 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730e8d6-9a81-45a7-b2df-051641ad5f86 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:31.473664 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a8bd6-d511-49db-9420-b0e58f2b09ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:31.474290 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a8bd6-d511-49db-9420-b0e58f2b09ac admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:31.474573 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a8bd6-d511-49db-9420-b0e58f2b09ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:31.474880 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a8bd6-d511-49db-9420-b0e58f2b09ac admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:31.475507 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a8bd6-d511-49db-9420-b0e58f2b09ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:31.477959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a8bd6-d511-49db-9420-b0e58f2b09ac admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:31.563042 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1223/2451] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:18:31 2022] POST /identity/v3/users => generated 281 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:18:31.567111 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8efba-6b52-49f2-826e-70f8486e98bb admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:31.578830 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8efba-6b52-49f2-826e-70f8486e98bb admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:31.583526 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0acbf8-dbcf-4d33-92c9-e4d1fea96db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:31.584159 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0acbf8-dbcf-4d33-92c9-e4d1fea96db8 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:31.584440 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0acbf8-dbcf-4d33-92c9-e4d1fea96db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:31.584718 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0acbf8-dbcf-4d33-92c9-e4d1fea96db8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:31.585420 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0acbf8-dbcf-4d33-92c9-e4d1fea96db8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:31.587040 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0acbf8-dbcf-4d33-92c9-e4d1fea96db8 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:31.597133 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1229/2452] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:18:31.601424 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a8bd6-d511-49db-9420-b0e58f2b09ac admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:31.613247 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a8bd6-d511-49db-9420-b0e58f2b09ac admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:31.618533 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255042df-f95f-4c6b-916f-7e14a0e285bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:31.619133 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255042df-f95f-4c6b-916f-7e14a0e285bd admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:31.619409 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255042df-f95f-4c6b-916f-7e14a0e285bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:31.619682 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255042df-f95f-4c6b-916f-7e14a0e285bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:31.620486 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255042df-f95f-4c6b-916f-7e14a0e285bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:31.622074 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255042df-f95f-4c6b-916f-7e14a0e285bd admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:31.633484 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1224/2453] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:18:31.637781 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0acbf8-dbcf-4d33-92c9-e4d1fea96db8 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:31.647979 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0acbf8-dbcf-4d33-92c9-e4d1fea96db8 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:31.653227 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b0c4f-9da0-4472-b7f4-a2fea8c6bf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:31.654009 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b0c4f-9da0-4472-b7f4-a2fea8c6bf52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:31.654182 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b0c4f-9da0-4472-b7f4-a2fea8c6bf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:31.654458 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b0c4f-9da0-4472-b7f4-a2fea8c6bf52 admin admin] PATH_INFO: `/v3/projects/10f87b1d23164f85913b21f7aa759d64/users/6981fb9117504a96b5bcb31f9c0c4aaf/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:31.671055 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b0c4f-9da0-4472-b7f4-a2fea8c6bf52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10f87b1d23164f85913b21f7aa759d64, user_id=6981fb9117504a96b5bcb31f9c0c4aaf, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:31.673732 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b0c4f-9da0-4472-b7f4-a2fea8c6bf52 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:31.763225 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1230/2454] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:18:31 2022] PUT /identity/v3/projects/10f87b1d23164f85913b21f7aa759d64/users/6981fb9117504a96b5bcb31f9c0c4aaf/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:18:31.773363 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f43f21-793a-40e8-9ee7-d76f83cd5ada None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:31.773654 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f43f21-793a-40e8-9ee7-d76f83cd5ada None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:31.774558 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f43f21-793a-40e8-9ee7-d76f83cd5ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:31.802678 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-71f43f21-793a-40e8-9ee7-d76f83cd5ada None None] MFA Rules not processed for user `6981fb9117504a96b5bcb31f9c0c4aaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:18:31.803883 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-71f43f21-793a-40e8-9ee7-d76f83cd5ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:31.870191 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1225/2455] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:18:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:18:31.881857 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b0c4f-9da0-4472-b7f4-a2fea8c6bf52 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:31.884344 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-1e3b0c4f-9da0-4472-b7f4-a2fea8c6bf52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:31.943792 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b0c4f-9da0-4472-b7f4-a2fea8c6bf52 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:31.948237 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3fe353-445e-47a2-adae-471c2864d13c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:31.948863 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fe353-445e-47a2-adae-471c2864d13c service cinder] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:31.949143 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fe353-445e-47a2-adae-471c2864d13c service cinder] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:31.949438 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fe353-445e-47a2-adae-471c2864d13c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:31.958824 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3fe353-445e-47a2-adae-471c2864d13c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:31.960257 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3fe353-445e-47a2-adae-471c2864d13c service cinder] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:31.969138 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1231/2456] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:18:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:18:38.032190 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90085d21-4731-4ebf-b8a6-7ffe20bceefd None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:38.040048 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90085d21-4731-4ebf-b8a6-7ffe20bceefd None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:38.040048 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90085d21-4731-4ebf-b8a6-7ffe20bceefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:38.051584 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-90085d21-4731-4ebf-b8a6-7ffe20bceefd None None] MFA Rules not processed for user `81523f532f3549589780b2881f857fff`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:18:38.052822 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-90085d21-4731-4ebf-b8a6-7ffe20bceefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:38.100318 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:38.108437 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1226/2457] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:18:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:18:41.965184 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=59,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:46.671813 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3fe353-445e-47a2-adae-471c2864d13c service cinder] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:46.673464 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-fc3fe353-445e-47a2-adae-471c2864d13c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:46.762459 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3fe353-445e-47a2-adae-471c2864d13c service cinder] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:46.768223 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff80378-b847-431f-8a8f-bcf0c690917a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4f9a2bba0e748b6a98fa7dea2482ddf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:46.769019 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff80378-b847-431f-8a8f-bcf0c690917a service placement] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:46.769315 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff80378-b847-431f-8a8f-bcf0c690917a service placement] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:46.769673 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff80378-b847-431f-8a8f-bcf0c690917a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:46.771371 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-6ff80378-b847-431f-8a8f-bcf0c690917a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:46.783709 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff80378-b847-431f-8a8f-bcf0c690917a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:46.785306 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff80378-b847-431f-8a8f-bcf0c690917a service placement] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:46.795117 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1232/2458] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:18:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:18:56.790820 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=41 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:19:06.170359 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90085d21-4731-4ebf-b8a6-7ffe20bceefd None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:19:06.231295 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90085d21-4731-4ebf-b8a6-7ffe20bceefd None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:19:06.235991 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9abb4e-c3e1-437b-9903-ba13f48cbae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:19:06.236646 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9abb4e-c3e1-437b-9903-ba13f48cbae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:19:06.236930 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9abb4e-c3e1-437b-9903-ba13f48cbae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:19:06.237207 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9abb4e-c3e1-437b-9903-ba13f48cbae5 admin admin] PATH_INFO: `/v3/users/6981fb9117504a96b5bcb31f9c0c4aaf` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:19:06.238318 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9abb4e-c3e1-437b-9903-ba13f48cbae5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6981fb9117504a96b5bcb31f9c0c4aaf)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:19:06.240264 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9abb4e-c3e1-437b-9903-ba13f48cbae5 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:19:06.432066 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ae9abb4e-c3e1-437b-9903-ba13f48cbae5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6981fb9117504a96b5bcb31f9c0c4aaf'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:19:06.480858 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ae9abb4e-c3e1-437b-9903-ba13f48cbae5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6981fb9117504a96b5bcb31f9c0c4aaf'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:19:06.494051 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ae9abb4e-c3e1-437b-9903-ba13f48cbae5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6981fb9117504a96b5bcb31f9c0c4aaf'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:19:06.500933 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ae9abb4e-c3e1-437b-9903-ba13f48cbae5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6981fb9117504a96b5bcb31f9c0c4aaf'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:19:06.504523 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ae9abb4e-c3e1-437b-9903-ba13f48cbae5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6981fb9117504a96b5bcb31f9c0c4aaf'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:19:06.508148 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1227/2459] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:19:06 2022] DELETE /identity/v3/users/6981fb9117504a96b5bcb31f9c0c4aaf => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:19:06.512636 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709e46e-ffe7-4b3a-8e14-4677a1797d86 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:19:06.513115 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709e46e-ffe7-4b3a-8e14-4677a1797d86 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:19:06.513222 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709e46e-ffe7-4b3a-8e14-4677a1797d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:19:06.531826 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-4709e46e-ffe7-4b3a-8e14-4677a1797d86 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:19:06.533082 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-4709e46e-ffe7-4b3a-8e14-4677a1797d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:19:06.590940 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1233/2460] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:19:06.600560 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9abb4e-c3e1-437b-9903-ba13f48cbae5 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:19:06.601944 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ae9abb4e-c3e1-437b-9903-ba13f48cbae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:19:06.658290 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9abb4e-c3e1-437b-9903-ba13f48cbae5 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:19:06.661929 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946bb4f3-f381-4ccb-b892-08ab7ad107a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:19:06.662531 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bb4f3-f381-4ccb-b892-08ab7ad107a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:19:06.662810 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bb4f3-f381-4ccb-b892-08ab7ad107a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:19:06.663081 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bb4f3-f381-4ccb-b892-08ab7ad107a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:19:06.671784 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946bb4f3-f381-4ccb-b892-08ab7ad107a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:19:06.673236 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946bb4f3-f381-4ccb-b892-08ab7ad107a8 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:19:06.682832 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1228/2461] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:19:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:19:07.071324 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709e46e-ffe7-4b3a-8e14-4677a1797d86 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:19:07.073773 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-4709e46e-ffe7-4b3a-8e14-4677a1797d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:19:07.086569 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709e46e-ffe7-4b3a-8e14-4677a1797d86 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:19:07.091298 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1f25b-e777-40d9-a943-f645281b852e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:19:07.091932 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1f25b-e777-40d9-a943-f645281b852e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:19:07.092274 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1f25b-e777-40d9-a943-f645281b852e admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:19:07.092562 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1f25b-e777-40d9-a943-f645281b852e admin admin] PATH_INFO: `/v3/projects/10f87b1d23164f85913b21f7aa759d64` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:19:07.093698 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e1f25b-e777-40d9-a943-f645281b852e admin admin] RBAC: Authorizing `identity:delete_project(project_id=10f87b1d23164f85913b21f7aa759d64)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:19:07.096196 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e1f25b-e777-40d9-a943-f645281b852e admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:19:07.194707 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-d2e1f25b-e777-40d9-a943-f645281b852e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10f87b1d23164f85913b21f7aa759d64', 'request_id': 'req-d2e1f25b-e777-40d9-a943-f645281b852e'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:19:07.257812 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-d2e1f25b-e777-40d9-a943-f645281b852e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10f87b1d23164f85913b21f7aa759d64', 'request_id': 'req-d2e1f25b-e777-40d9-a943-f645281b852e'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:19:07.264813 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-d2e1f25b-e777-40d9-a943-f645281b852e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10f87b1d23164f85913b21f7aa759d64', 'request_id': 'req-d2e1f25b-e777-40d9-a943-f645281b852e'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:19:07.275758 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-d2e1f25b-e777-40d9-a943-f645281b852e admin admin] The token cache is being invalidate because project 10f87b1d23164f85913b21f7aa759d64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:19:07.276070 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-d2e1f25b-e777-40d9-a943-f645281b852e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:19:07.276695 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-d2e1f25b-e777-40d9-a943-f645281b852e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:19:07.278156 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1234/2462] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:19:07 2022] DELETE /identity/v3/projects/10f87b1d23164f85913b21f7aa759d64 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:19:07.283684 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edecbde-dca1-46bc-8ae2-314e7599f02f None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:19:07.284192 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edecbde-dca1-46bc-8ae2-314e7599f02f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:19:07.284299 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edecbde-dca1-46bc-8ae2-314e7599f02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:19:07.303748 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-3edecbde-dca1-46bc-8ae2-314e7599f02f None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:19:07.304979 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3edecbde-dca1-46bc-8ae2-314e7599f02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:19:07.321544 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:19:07.364504 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1229/2463] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:19:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:19:07.372070 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bd0cb-0d04-4700-b528-c189b489724c None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:19:07.376538 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bd0cb-0d04-4700-b528-c189b489724c None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:19:07.376538 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bd0cb-0d04-4700-b528-c189b489724c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:19:07.392816 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-e71bd0cb-0d04-4700-b528-c189b489724c None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:19:07.394113 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-e71bd0cb-0d04-4700-b528-c189b489724c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:19:07.402899 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1235/2464] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:19:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:19:07.406104 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edecbde-dca1-46bc-8ae2-314e7599f02f None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:19:07.416406 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edecbde-dca1-46bc-8ae2-314e7599f02f None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:19:07.421302 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092c092-79a2-4cc4-84f7-c4dc375e4a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:19:07.422181 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092c092-79a2-4cc4-84f7-c4dc375e4a53 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:19:07.422697 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092c092-79a2-4cc4-84f7-c4dc375e4a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:19:07.423400 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092c092-79a2-4cc4-84f7-c4dc375e4a53 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:19:07.424201 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0092c092-79a2-4cc4-84f7-c4dc375e4a53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:19:07.424510 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0092c092-79a2-4cc4-84f7-c4dc375e4a53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:19:07.426116 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0092c092-79a2-4cc4-84f7-c4dc375e4a53 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:19:07.437542 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1230/2465] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:19:07.441769 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71bd0cb-0d04-4700-b528-c189b489724c None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:19:07.451099 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71bd0cb-0d04-4700-b528-c189b489724c None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:19:07.456285 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d964d-f14f-42d9-ab59-34b38475aabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:19:07.456879 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d964d-f14f-42d9-ab59-34b38475aabd admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:19:07.457161 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d964d-f14f-42d9-ab59-34b38475aabd admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:19:07.457435 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d964d-f14f-42d9-ab59-34b38475aabd admin admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:19:07.458076 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d964d-f14f-42d9-ab59-34b38475aabd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:19:07.459960 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d964d-f14f-42d9-ab59-34b38475aabd admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:19:07.572523 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1236/2466] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:19:07 2022] POST /identity/v3/projects => generated 371 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:19:07.576677 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092c092-79a2-4cc4-84f7-c4dc375e4a53 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:19:07.587649 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092c092-79a2-4cc4-84f7-c4dc375e4a53 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:19:07.643150 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008c3db-c6fb-4f71-96b1-3b35020da504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:19:07.643744 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008c3db-c6fb-4f71-96b1-3b35020da504 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:19:07.644024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008c3db-c6fb-4f71-96b1-3b35020da504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:19:07.644333 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008c3db-c6fb-4f71-96b1-3b35020da504 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:19:07.644960 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5008c3db-c6fb-4f71-96b1-3b35020da504 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:19:07.646872 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5008c3db-c6fb-4f71-96b1-3b35020da504 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:19:07.713332 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1231/2467] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:19:07 2022] POST /identity/v3/users => generated 286 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:19:07.717465 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d964d-f14f-42d9-ab59-34b38475aabd admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:19:07.727732 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d964d-f14f-42d9-ab59-34b38475aabd admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:19:07.732384 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad9534-bc57-4d1d-87ff-d29bda77c6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:19:07.733243 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad9534-bc57-4d1d-87ff-d29bda77c6c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:19:07.733518 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad9534-bc57-4d1d-87ff-d29bda77c6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:19:07.733791 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad9534-bc57-4d1d-87ff-d29bda77c6c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:19:07.734429 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad9534-bc57-4d1d-87ff-d29bda77c6c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:19:07.736038 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad9534-bc57-4d1d-87ff-d29bda77c6c1 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:19:07.745717 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1237/2468] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:19:07.749564 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008c3db-c6fb-4f71-96b1-3b35020da504 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:19:07.763864 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008c3db-c6fb-4f71-96b1-3b35020da504 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:19:07.769994 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d97d8-2782-4031-8f02-a91baa52345b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:19:07.770614 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d97d8-2782-4031-8f02-a91baa52345b admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:19:07.770899 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d97d8-2782-4031-8f02-a91baa52345b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:19:07.771179 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d97d8-2782-4031-8f02-a91baa52345b admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:19:07.771829 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d97d8-2782-4031-8f02-a91baa52345b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:19:07.773483 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d97d8-2782-4031-8f02-a91baa52345b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:19:07.785063 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1232/2469] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:19:07.789176 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad9534-bc57-4d1d-87ff-d29bda77c6c1 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:19:07.799170 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad9534-bc57-4d1d-87ff-d29bda77c6c1 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:19:07.803770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082f5ad-7160-4ab1-b606-a4641faa5a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:19:07.804464 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082f5ad-7160-4ab1-b606-a4641faa5a5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:19:07.804735 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082f5ad-7160-4ab1-b606-a4641faa5a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:19:07.805011 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082f5ad-7160-4ab1-b606-a4641faa5a5c admin admin] PATH_INFO: `/v3/projects/ba907d3de4a0453299c23d248256fb23/users/531ba33d30b94fd48d2458b41e4fc705/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:19:07.819889 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2082f5ad-7160-4ab1-b606-a4641faa5a5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba907d3de4a0453299c23d248256fb23, user_id=531ba33d30b94fd48d2458b41e4fc705, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:19:07.822669 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2082f5ad-7160-4ab1-b606-a4641faa5a5c admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:19:07.990656 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1238/2470] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:19:07 2022] PUT /identity/v3/projects/ba907d3de4a0453299c23d248256fb23/users/531ba33d30b94fd48d2458b41e4fc705/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:19:08.000985 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4207d00-eff0-472e-a3ec-ac5696131e04 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:19:08.001275 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4207d00-eff0-472e-a3ec-ac5696131e04 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:19:08.002380 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4207d00-eff0-472e-a3ec-ac5696131e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:19:08.030337 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-a4207d00-eff0-472e-a3ec-ac5696131e04 None None] MFA Rules not processed for user `531ba33d30b94fd48d2458b41e4fc705`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:19:08.031560 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a4207d00-eff0-472e-a3ec-ac5696131e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:19:08.095880 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1233/2471] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:19:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:19:08.107061 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082f5ad-7160-4ab1-b606-a4641faa5a5c admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:19:08.109099 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-2082f5ad-7160-4ab1-b606-a4641faa5a5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:19:08.132742 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:19:08.166853 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082f5ad-7160-4ab1-b606-a4641faa5a5c admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:19:08.170526 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327557d1-f451-45b5-a4a8-fae307a05e84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:19:08.171127 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327557d1-f451-45b5-a4a8-fae307a05e84 service cinder] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:19:08.171409 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327557d1-f451-45b5-a4a8-fae307a05e84 service cinder] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:19:08.171684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327557d1-f451-45b5-a4a8-fae307a05e84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:19:08.180555 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327557d1-f451-45b5-a4a8-fae307a05e84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:19:08.181978 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327557d1-f451-45b5-a4a8-fae307a05e84 service cinder] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:19:08.191329 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1239/2472] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:19:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:19:08.217689 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4207d00-eff0-472e-a3ec-ac5696131e04 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:19:08.237902 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:19:08.281282 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4207d00-eff0-472e-a3ec-ac5696131e04 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:19:08.285850 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18add6f7-ed76-4dfb-9a3f-f118c0709f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:19:08.286532 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18add6f7-ed76-4dfb-9a3f-f118c0709f22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:19:08.286752 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18add6f7-ed76-4dfb-9a3f-f118c0709f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:19:08.287025 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18add6f7-ed76-4dfb-9a3f-f118c0709f22 admin admin] PATH_INFO: `/v3/users/531ba33d30b94fd48d2458b41e4fc705` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:19:08.288182 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18add6f7-ed76-4dfb-9a3f-f118c0709f22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=531ba33d30b94fd48d2458b41e4fc705)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:19:08.290115 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18add6f7-ed76-4dfb-9a3f-f118c0709f22 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:19:08.466168 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-18add6f7-ed76-4dfb-9a3f-f118c0709f22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '531ba33d30b94fd48d2458b41e4fc705'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:19:08.550267 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-18add6f7-ed76-4dfb-9a3f-f118c0709f22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '531ba33d30b94fd48d2458b41e4fc705'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:19:08.564160 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-18add6f7-ed76-4dfb-9a3f-f118c0709f22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '531ba33d30b94fd48d2458b41e4fc705'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:19:08.572079 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-18add6f7-ed76-4dfb-9a3f-f118c0709f22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '531ba33d30b94fd48d2458b41e4fc705'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:19:08.574452 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-18add6f7-ed76-4dfb-9a3f-f118c0709f22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '531ba33d30b94fd48d2458b41e4fc705'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:19:08.579573 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1234/2473] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:19:08 2022] DELETE /identity/v3/users/531ba33d30b94fd48d2458b41e4fc705 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:19:08.583954 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbb1c4-cf9c-45de-bea3-3f2a4a32122e None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:19:08.584477 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbb1c4-cf9c-45de-bea3-3f2a4a32122e None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:19:08.584663 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbb1c4-cf9c-45de-bea3-3f2a4a32122e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:19:08.604672 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-4bfbb1c4-cf9c-45de-bea3-3f2a4a32122e None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:19:08.608991 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-4bfbb1c4-cf9c-45de-bea3-3f2a4a32122e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:19:08.665501 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1240/2474] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:19:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:19:08.676029 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18add6f7-ed76-4dfb-9a3f-f118c0709f22 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:19:08.677587 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-18add6f7-ed76-4dfb-9a3f-f118c0709f22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:19:08.736943 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18add6f7-ed76-4dfb-9a3f-f118c0709f22 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:19:08.741664 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12b8a1-6a6b-4615-8f3f-67c0974a9a79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:19:08.742314 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12b8a1-6a6b-4615-8f3f-67c0974a9a79 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:19:08.742595 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12b8a1-6a6b-4615-8f3f-67c0974a9a79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:19:08.742871 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12b8a1-6a6b-4615-8f3f-67c0974a9a79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:19:08.752399 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc12b8a1-6a6b-4615-8f3f-67c0974a9a79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:19:08.753864 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc12b8a1-6a6b-4615-8f3f-67c0974a9a79 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:19:08.763798 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1235/2475] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:19:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:19:09.172140 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfbb1c4-cf9c-45de-bea3-3f2a4a32122e None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:19:09.173611 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-4bfbb1c4-cf9c-45de-bea3-3f2a4a32122e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:19:09.186783 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfbb1c4-cf9c-45de-bea3-3f2a4a32122e None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:19:09.192531 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42fe8d-7e31-4428-8515-ead4e3eae543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:19:09.193250 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42fe8d-7e31-4428-8515-ead4e3eae543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:19:09.193535 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42fe8d-7e31-4428-8515-ead4e3eae543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:19:09.193815 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42fe8d-7e31-4428-8515-ead4e3eae543 admin admin] PATH_INFO: `/v3/projects/ba907d3de4a0453299c23d248256fb23` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:19:09.194945 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b42fe8d-7e31-4428-8515-ead4e3eae543 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba907d3de4a0453299c23d248256fb23)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:19:09.196886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b42fe8d-7e31-4428-8515-ead4e3eae543 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:19:09.303195 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-5b42fe8d-7e31-4428-8515-ead4e3eae543 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba907d3de4a0453299c23d248256fb23', 'request_id': 'req-5b42fe8d-7e31-4428-8515-ead4e3eae543'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:19:09.384048 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-5b42fe8d-7e31-4428-8515-ead4e3eae543 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba907d3de4a0453299c23d248256fb23', 'request_id': 'req-5b42fe8d-7e31-4428-8515-ead4e3eae543'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:19:09.391002 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-5b42fe8d-7e31-4428-8515-ead4e3eae543 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba907d3de4a0453299c23d248256fb23', 'request_id': 'req-5b42fe8d-7e31-4428-8515-ead4e3eae543'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:19:09.403231 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-5b42fe8d-7e31-4428-8515-ead4e3eae543 admin admin] The token cache is being invalidate because project ba907d3de4a0453299c23d248256fb23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:19:09.404026 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-5b42fe8d-7e31-4428-8515-ead4e3eae543 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:19:09.404799 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-5b42fe8d-7e31-4428-8515-ead4e3eae543 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:19:09.406454 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1241/2476] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:19:09 2022] DELETE /identity/v3/projects/ba907d3de4a0453299c23d248256fb23 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:19:18.759350 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:19:19.399904 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:19:45.171521 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5f2a5-7e34-4596-817e-ee0ca4c41a89 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:19:45.172033 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5f2a5-7e34-4596-817e-ee0ca4c41a89 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:19:45.172213 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5f2a5-7e34-4596-817e-ee0ca4c41a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:19:45.191512 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-c4b5f2a5-7e34-4596-817e-ee0ca4c41a89 None None] MFA Rules not processed for user `81523f532f3549589780b2881f857fff`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:19:45.192742 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c4b5f2a5-7e34-4596-817e-ee0ca4c41a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:19:45.251199 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1236/2477] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:19:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:19:55.244239 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=25 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:20:41.977785 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42fe8d-7e31-4428-8515-ead4e3eae543 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:20:41.977785 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-5b42fe8d-7e31-4428-8515-ead4e3eae543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:20:42.032366 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42fe8d-7e31-4428-8515-ead4e3eae543 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:20:42.035852 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7997298-85c7-4bfd-8d12-1df97f8b2638 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:20:42.036486 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7997298-85c7-4bfd-8d12-1df97f8b2638 service cinder] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:20:42.036767 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7997298-85c7-4bfd-8d12-1df97f8b2638 service cinder] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:20:42.037039 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7997298-85c7-4bfd-8d12-1df97f8b2638 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:20:42.039398 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-c7997298-85c7-4bfd-8d12-1df97f8b2638 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:20:42.132908 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7997298-85c7-4bfd-8d12-1df97f8b2638 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:20:42.134335 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7997298-85c7-4bfd-8d12-1df97f8b2638 service cinder] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:20:42.154118 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1242/2478] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:20:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:20:44.129181 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5f2a5-7e34-4596-817e-ee0ca4c41a89 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:20:44.130593 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c4b5f2a5-7e34-4596-817e-ee0ca4c41a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:20:44.186270 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5f2a5-7e34-4596-817e-ee0ca4c41a89 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:20:44.189916 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54385dfa-ae7a-4dae-b711-62a258312b46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:20:44.190520 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54385dfa-ae7a-4dae-b711-62a258312b46 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:20:44.190943 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54385dfa-ae7a-4dae-b711-62a258312b46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:20:44.191225 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54385dfa-ae7a-4dae-b711-62a258312b46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:20:44.192939 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-54385dfa-ae7a-4dae-b711-62a258312b46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:20:44.206639 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54385dfa-ae7a-4dae-b711-62a258312b46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:20:44.208082 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54385dfa-ae7a-4dae-b711-62a258312b46 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:20:44.219636 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1237/2479] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:20:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:20:51.956846 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91496c73-2651-4338-a71e-4ebf27be2f58 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:20:51.957323 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91496c73-2651-4338-a71e-4ebf27be2f58 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:20:51.957424 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91496c73-2651-4338-a71e-4ebf27be2f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:20:51.977808 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-91496c73-2651-4338-a71e-4ebf27be2f58 None None] MFA Rules not processed for user `81523f532f3549589780b2881f857fff`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:20:51.978921 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-91496c73-2651-4338-a71e-4ebf27be2f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:20:51.986131 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1243/2480] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:20:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:20:54.214646 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=26 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:21:01.971343 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=69 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:21:04.120742 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54385dfa-ae7a-4dae-b711-62a258312b46 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:21:04.129614 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54385dfa-ae7a-4dae-b711-62a258312b46 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:21:04.133310 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151f15e-0124-40b0-aaa0-514182dd2788 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:21:04.133916 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151f15e-0124-40b0-aaa0-514182dd2788 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:21:04.134201 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151f15e-0124-40b0-aaa0-514182dd2788 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:21:04.134481 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151f15e-0124-40b0-aaa0-514182dd2788 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:21:04.136241 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3151f15e-0124-40b0-aaa0-514182dd2788 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:21:04.145796 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3151f15e-0124-40b0-aaa0-514182dd2788 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:21:04.147246 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3151f15e-0124-40b0-aaa0-514182dd2788 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:21:04.155715 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1238/2481] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:21:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:21:14.152164 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=6 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:21:55.261930 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91496c73-2651-4338-a71e-4ebf27be2f58 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:21:55.266610 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-91496c73-2651-4338-a71e-4ebf27be2f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:21:55.279937 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91496c73-2651-4338-a71e-4ebf27be2f58 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:21:55.285481 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a313f65-4a9c-4654-aec0-f1f5855b8094 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:21:55.286090 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a313f65-4a9c-4654-aec0-f1f5855b8094 service nova] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:21:55.286374 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a313f65-4a9c-4654-aec0-f1f5855b8094 service nova] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:21:55.286651 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a313f65-4a9c-4654-aec0-f1f5855b8094 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:21:55.288384 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-4a313f65-4a9c-4654-aec0-f1f5855b8094 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:21:55.300924 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a313f65-4a9c-4654-aec0-f1f5855b8094 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:21:55.302740 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a313f65-4a9c-4654-aec0-f1f5855b8094 service nova] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:21:55.315166 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1244/2482] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:21:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:22:05.309773 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=6 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:22:05.487884 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151f15e-0124-40b0-aaa0-514182dd2788 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:05.487884 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3151f15e-0124-40b0-aaa0-514182dd2788 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:05.554411 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151f15e-0124-40b0-aaa0-514182dd2788 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:05.559157 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715ec0b-22a2-4273-b99b-5a069d50cbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:05.559801 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715ec0b-22a2-4273-b99b-5a069d50cbd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:05.560111 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715ec0b-22a2-4273-b99b-5a069d50cbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:05.560398 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715ec0b-22a2-4273-b99b-5a069d50cbd5 admin admin] PATH_INFO: `/v3/users/81523f532f3549589780b2881f857fff` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:05.561599 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c715ec0b-22a2-4273-b99b-5a069d50cbd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81523f532f3549589780b2881f857fff)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:05.563695 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c715ec0b-22a2-4273-b99b-5a069d50cbd5 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:05.767319 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c715ec0b-22a2-4273-b99b-5a069d50cbd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81523f532f3549589780b2881f857fff'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:05.827035 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c715ec0b-22a2-4273-b99b-5a069d50cbd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81523f532f3549589780b2881f857fff'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:05.839558 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c715ec0b-22a2-4273-b99b-5a069d50cbd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81523f532f3549589780b2881f857fff'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:05.847332 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c715ec0b-22a2-4273-b99b-5a069d50cbd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81523f532f3549589780b2881f857fff'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:05.848000 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c715ec0b-22a2-4273-b99b-5a069d50cbd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81523f532f3549589780b2881f857fff'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:05.853857 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1239/2483] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:22:05 2022] DELETE /identity/v3/users/81523f532f3549589780b2881f857fff => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:22:06.074338 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a313f65-4a9c-4654-aec0-f1f5855b8094 service nova] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:06.085381 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a313f65-4a9c-4654-aec0-f1f5855b8094 service nova] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:06.142291 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb4ff1-6b70-46a5-8d67-eb4ba1f6494d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:06.142927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb4ff1-6b70-46a5-8d67-eb4ba1f6494d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:06.143212 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb4ff1-6b70-46a5-8d67-eb4ba1f6494d admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:06.143491 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb4ff1-6b70-46a5-8d67-eb4ba1f6494d admin admin] PATH_INFO: `/v3/projects/3c58e907109248188aacd4d5ed3ffadd` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:06.144627 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb4ff1-6b70-46a5-8d67-eb4ba1f6494d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c58e907109248188aacd4d5ed3ffadd)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:06.146537 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb4ff1-6b70-46a5-8d67-eb4ba1f6494d admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:06.261194 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-78bb4ff1-6b70-46a5-8d67-eb4ba1f6494d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c58e907109248188aacd4d5ed3ffadd', 'request_id': 'req-78bb4ff1-6b70-46a5-8d67-eb4ba1f6494d'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:06.342374 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-78bb4ff1-6b70-46a5-8d67-eb4ba1f6494d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c58e907109248188aacd4d5ed3ffadd', 'request_id': 'req-78bb4ff1-6b70-46a5-8d67-eb4ba1f6494d'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:06.349174 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-78bb4ff1-6b70-46a5-8d67-eb4ba1f6494d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c58e907109248188aacd4d5ed3ffadd', 'request_id': 'req-78bb4ff1-6b70-46a5-8d67-eb4ba1f6494d'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:06.359862 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-78bb4ff1-6b70-46a5-8d67-eb4ba1f6494d admin admin] The token cache is being invalidate because project 3c58e907109248188aacd4d5ed3ffadd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:22:06.360113 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-78bb4ff1-6b70-46a5-8d67-eb4ba1f6494d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:06.360762 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-78bb4ff1-6b70-46a5-8d67-eb4ba1f6494d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:06.362232 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1245/2484] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:22:06 2022] DELETE /identity/v3/projects/3c58e907109248188aacd4d5ed3ffadd => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:22:06.367258 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3f33b-ee45-4cc4-925a-bc1817e7ae5a None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:06.367548 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3f33b-ee45-4cc4-925a-bc1817e7ae5a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:06.367826 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3f33b-ee45-4cc4-925a-bc1817e7ae5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:06.387639 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-02f3f33b-ee45-4cc4-925a-bc1817e7ae5a None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:22:06.388879 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-02f3f33b-ee45-4cc4-925a-bc1817e7ae5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:06.445899 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1240/2485] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:22:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:22:06.455212 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e14f5-c819-45a3-b81c-e53209e05b3c None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:06.455497 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e14f5-c819-45a3-b81c-e53209e05b3c None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:06.455771 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e14f5-c819-45a3-b81c-e53209e05b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:06.474980 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-6d0e14f5-c819-45a3-b81c-e53209e05b3c None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:22:06.476206 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-6d0e14f5-c819-45a3-b81c-e53209e05b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:06.484353 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1246/2486] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:22:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:22:06.488508 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3f33b-ee45-4cc4-925a-bc1817e7ae5a None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:06.498797 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3f33b-ee45-4cc4-925a-bc1817e7ae5a None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:06.503287 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bffd294-503b-499c-9732-1a51674ab3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:06.503887 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffd294-503b-499c-9732-1a51674ab3c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:06.504206 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffd294-503b-499c-9732-1a51674ab3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:06.504482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffd294-503b-499c-9732-1a51674ab3c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:06.505121 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bffd294-503b-499c-9732-1a51674ab3c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:22:06.505424 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bffd294-503b-499c-9732-1a51674ab3c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:06.507024 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bffd294-503b-499c-9732-1a51674ab3c7 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:06.519036 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1241/2487] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:22:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:22:06.523331 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e14f5-c819-45a3-b81c-e53209e05b3c None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:06.532533 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e14f5-c819-45a3-b81c-e53209e05b3c None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:06.537085 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53cd10-f5bd-4fd5-903d-d3a08761a6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:06.537679 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53cd10-f5bd-4fd5-903d-d3a08761a6c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:06.537958 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53cd10-f5bd-4fd5-903d-d3a08761a6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:06.538231 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53cd10-f5bd-4fd5-903d-d3a08761a6c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:06.538856 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53cd10-f5bd-4fd5-903d-d3a08761a6c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:06.540774 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53cd10-f5bd-4fd5-903d-d3a08761a6c5 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:06.646083 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1247/2488] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:22:06 2022] POST /identity/v3/projects => generated 403 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:22:06.650299 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bffd294-503b-499c-9732-1a51674ab3c7 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:06.660588 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bffd294-503b-499c-9732-1a51674ab3c7 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:06.664644 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:22:06.716714 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0ec6e-1c7e-4778-8577-8f9a323cd322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:06.717329 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0ec6e-1c7e-4778-8577-8f9a323cd322 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:06.717614 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0ec6e-1c7e-4778-8577-8f9a323cd322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:06.717898 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0ec6e-1c7e-4778-8577-8f9a323cd322 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:06.718542 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0ec6e-1c7e-4778-8577-8f9a323cd322 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:06.720517 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0ec6e-1c7e-4778-8577-8f9a323cd322 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:06.867272 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1242/2489] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:22:06 2022] POST /identity/v3/users => generated 302 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:22:06.872255 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53cd10-f5bd-4fd5-903d-d3a08761a6c5 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:06.882502 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53cd10-f5bd-4fd5-903d-d3a08761a6c5 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:06.887021 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf2d06-7519-4459-b89b-cf5bd98bcd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:06.892948 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf2d06-7519-4459-b89b-cf5bd98bcd95 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:06.892948 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf2d06-7519-4459-b89b-cf5bd98bcd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:06.892948 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf2d06-7519-4459-b89b-cf5bd98bcd95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:06.892948 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf2d06-7519-4459-b89b-cf5bd98bcd95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:06.892948 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf2d06-7519-4459-b89b-cf5bd98bcd95 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:06.900110 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1248/2490] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:22:06.903915 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0ec6e-1c7e-4778-8577-8f9a323cd322 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:06.914262 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0ec6e-1c7e-4778-8577-8f9a323cd322 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:06.919626 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd365cd-f2bb-4002-9903-b0120989ac8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:06.920255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd365cd-f2bb-4002-9903-b0120989ac8b admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:06.920535 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd365cd-f2bb-4002-9903-b0120989ac8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:06.920811 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd365cd-f2bb-4002-9903-b0120989ac8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:06.921443 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd365cd-f2bb-4002-9903-b0120989ac8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:06.923071 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd365cd-f2bb-4002-9903-b0120989ac8b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:06.932866 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1243/2491] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:22:06.937447 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf2d06-7519-4459-b89b-cf5bd98bcd95 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:06.947238 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf2d06-7519-4459-b89b-cf5bd98bcd95 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:06.952215 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2187b-5dff-4795-affa-faae85da0751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:06.952855 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2187b-5dff-4795-affa-faae85da0751 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:06.953137 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2187b-5dff-4795-affa-faae85da0751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:06.953417 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2187b-5dff-4795-affa-faae85da0751 admin admin] PATH_INFO: `/v3/projects/c7c0d8ca86604ea8811bbd2989d45502/users/7d95899da86e443a96e8cd395477094f/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:06.968313 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2187b-5dff-4795-affa-faae85da0751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7c0d8ca86604ea8811bbd2989d45502, user_id=7d95899da86e443a96e8cd395477094f, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:06.970932 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2187b-5dff-4795-affa-faae85da0751 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:07.050127 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1249/2492] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:22:06 2022] PUT /identity/v3/projects/c7c0d8ca86604ea8811bbd2989d45502/users/7d95899da86e443a96e8cd395477094f/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:22:07.060480 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc87f38-b98a-4b07-bcf1-3a47f6c5d97a None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:07.060770 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc87f38-b98a-4b07-bcf1-3a47f6c5d97a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:07.061065 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc87f38-b98a-4b07-bcf1-3a47f6c5d97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:07.090979 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-bfc87f38-b98a-4b07-bcf1-3a47f6c5d97a None None] MFA Rules not processed for user `7d95899da86e443a96e8cd395477094f`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:22:07.092251 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-bfc87f38-b98a-4b07-bcf1-3a47f6c5d97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:07.278717 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1244/2493] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:22:07 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:22:07.283237 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2187b-5dff-4795-affa-faae85da0751 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:07.313018 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:22:07.344431 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2187b-5dff-4795-affa-faae85da0751 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:07.349048 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a42ee7-9f8f-4ff0-8f3b-e2c6f1b11d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:07.349658 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a42ee7-9f8f-4ff0-8f3b-e2c6f1b11d98 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:07.349938 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a42ee7-9f8f-4ff0-8f3b-e2c6f1b11d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:07.350211 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a42ee7-9f8f-4ff0-8f3b-e2c6f1b11d98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:07.350860 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a42ee7-9f8f-4ff0-8f3b-e2c6f1b11d98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:07.352794 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a42ee7-9f8f-4ff0-8f3b-e2c6f1b11d98 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:07.432087 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1250/2494] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:22:07 2022] POST /identity/v3/projects => generated 405 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:22:07.436149 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc87f38-b98a-4b07-bcf1-3a47f6c5d97a None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:07.446615 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc87f38-b98a-4b07-bcf1-3a47f6c5d97a None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:07.501547 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f125c-a770-46df-b9e8-316ff0053b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:07.502118 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f125c-a770-46df-b9e8-316ff0053b18 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:07.502401 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f125c-a770-46df-b9e8-316ff0053b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:07.502673 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f125c-a770-46df-b9e8-316ff0053b18 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:07.503292 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f125c-a770-46df-b9e8-316ff0053b18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:07.505291 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f125c-a770-46df-b9e8-316ff0053b18 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:07.593434 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1245/2495] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:22:07 2022] POST /identity/v3/users => generated 309 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:22:07.597539 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a42ee7-9f8f-4ff0-8f3b-e2c6f1b11d98 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:07.608694 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a42ee7-9f8f-4ff0-8f3b-e2c6f1b11d98 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:07.613241 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226f5ab-2802-4fa1-ab44-cb7b7ad24677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:07.613839 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226f5ab-2802-4fa1-ab44-cb7b7ad24677 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:07.614166 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226f5ab-2802-4fa1-ab44-cb7b7ad24677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:07.614417 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226f5ab-2802-4fa1-ab44-cb7b7ad24677 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:07.615050 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f226f5ab-2802-4fa1-ab44-cb7b7ad24677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:07.616666 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f226f5ab-2802-4fa1-ab44-cb7b7ad24677 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:07.626542 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1251/2496] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:22:07.630569 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f125c-a770-46df-b9e8-316ff0053b18 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:07.637713 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:22:07.640998 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f125c-a770-46df-b9e8-316ff0053b18 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:07.645558 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cbe384-7e78-4eb8-aa9e-905eecabd696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:07.646208 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbe384-7e78-4eb8-aa9e-905eecabd696 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:07.646486 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbe384-7e78-4eb8-aa9e-905eecabd696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:07.652149 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbe384-7e78-4eb8-aa9e-905eecabd696 admin admin] PATH_INFO: `/v3/projects/188b43ed100a48ef9807c5d26dba94a2/users/7bea38d922bf4273b63e77087cb5d325/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:07.662785 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cbe384-7e78-4eb8-aa9e-905eecabd696 admin admin] RBAC: Authorizing `identity:create_grant(project_id=188b43ed100a48ef9807c5d26dba94a2, user_id=7bea38d922bf4273b63e77087cb5d325, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:07.665469 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cbe384-7e78-4eb8-aa9e-905eecabd696 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:07.727701 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1246/2497] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:22:07 2022] PUT /identity/v3/projects/188b43ed100a48ef9807c5d26dba94a2/users/7bea38d922bf4273b63e77087cb5d325/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:22:07.731665 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226f5ab-2802-4fa1-ab44-cb7b7ad24677 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:07.741799 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226f5ab-2802-4fa1-ab44-cb7b7ad24677 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:07.797328 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec60da-1688-467e-bcf2-0a23a672e675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:07.797932 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec60da-1688-467e-bcf2-0a23a672e675 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:07.798215 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec60da-1688-467e-bcf2-0a23a672e675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:07.798487 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec60da-1688-467e-bcf2-0a23a672e675 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:07.799123 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec60da-1688-467e-bcf2-0a23a672e675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:07.800762 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec60da-1688-467e-bcf2-0a23a672e675 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:07.810266 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1252/2498] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:22:07.814369 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cbe384-7e78-4eb8-aa9e-905eecabd696 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:07.825064 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cbe384-7e78-4eb8-aa9e-905eecabd696 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:07.829722 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea3dfb-c5fc-4ef4-ad00-4af02f7017ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:07.830385 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea3dfb-c5fc-4ef4-ad00-4af02f7017ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:07.830665 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea3dfb-c5fc-4ef4-ad00-4af02f7017ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:07.830939 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea3dfb-c5fc-4ef4-ad00-4af02f7017ba admin admin] PATH_INFO: `/v3/projects/188b43ed100a48ef9807c5d26dba94a2/users/7bea38d922bf4273b63e77087cb5d325/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:07.832885 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ea3dfb-c5fc-4ef4-ad00-4af02f7017ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=188b43ed100a48ef9807c5d26dba94a2, user_id=7bea38d922bf4273b63e77087cb5d325, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:07.835511 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ea3dfb-c5fc-4ef4-ad00-4af02f7017ba admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:07.846779 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1247/2499] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:22:07 2022] PUT /identity/v3/projects/188b43ed100a48ef9807c5d26dba94a2/users/7bea38d922bf4273b63e77087cb5d325/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:22:07.858605 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22353751-d930-445f-b059-415a91ac4900 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:07.858889 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22353751-d930-445f-b059-415a91ac4900 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:07.859162 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22353751-d930-445f-b059-415a91ac4900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:07.887722 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-22353751-d930-445f-b059-415a91ac4900 None None] MFA Rules not processed for user `7bea38d922bf4273b63e77087cb5d325`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:22:07.889034 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-22353751-d930-445f-b059-415a91ac4900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:07.957477 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1253/2500] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:22:07 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:22:07.969035 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea3dfb-c5fc-4ef4-ad00-4af02f7017ba admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:07.970763 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d6ea3dfb-c5fc-4ef4-ad00-4af02f7017ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:08.027029 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea3dfb-c5fc-4ef4-ad00-4af02f7017ba admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:08.031298 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473229ce-1eb1-4b8a-9e56-eed93d8e723b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:08.031907 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473229ce-1eb1-4b8a-9e56-eed93d8e723b service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:08.032219 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473229ce-1eb1-4b8a-9e56-eed93d8e723b service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:08.032496 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473229ce-1eb1-4b8a-9e56-eed93d8e723b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:08.041534 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473229ce-1eb1-4b8a-9e56-eed93d8e723b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:08.042961 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473229ce-1eb1-4b8a-9e56-eed93d8e723b service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:08.052912 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1248/2501] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:22:07 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:22:08.192661 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22353751-d930-445f-b059-415a91ac4900 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:08.218336 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:22:08.254927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22353751-d930-445f-b059-415a91ac4900 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:08.259464 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef299aa-14a5-4197-9169-ba599d440986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:08.260118 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef299aa-14a5-4197-9169-ba599d440986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:08.260406 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef299aa-14a5-4197-9169-ba599d440986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:08.260682 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef299aa-14a5-4197-9169-ba599d440986 admin admin] PATH_INFO: `/v3/users/7d95899da86e443a96e8cd395477094f` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:08.261800 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef299aa-14a5-4197-9169-ba599d440986 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d95899da86e443a96e8cd395477094f)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:08.263792 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef299aa-14a5-4197-9169-ba599d440986 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:08.432633 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-cef299aa-14a5-4197-9169-ba599d440986 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d95899da86e443a96e8cd395477094f'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:08.495695 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-cef299aa-14a5-4197-9169-ba599d440986 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d95899da86e443a96e8cd395477094f'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:08.508761 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-cef299aa-14a5-4197-9169-ba599d440986 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d95899da86e443a96e8cd395477094f'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:08.509387 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-cef299aa-14a5-4197-9169-ba599d440986 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d95899da86e443a96e8cd395477094f'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:08.516336 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-cef299aa-14a5-4197-9169-ba599d440986 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d95899da86e443a96e8cd395477094f'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:08.522198 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1254/2502] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:22:08 2022] DELETE /identity/v3/users/7d95899da86e443a96e8cd395477094f => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:22:08.526673 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc6a28-4898-4d8b-a984-24866726e755 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:08.527155 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc6a28-4898-4d8b-a984-24866726e755 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:08.527263 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc6a28-4898-4d8b-a984-24866726e755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:08.546088 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-65fc6a28-4898-4d8b-a984-24866726e755 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:22:08.547281 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-65fc6a28-4898-4d8b-a984-24866726e755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:08.603615 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1249/2503] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:22:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:22:08.614068 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef299aa-14a5-4197-9169-ba599d440986 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:08.615494 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-cef299aa-14a5-4197-9169-ba599d440986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:08.672568 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef299aa-14a5-4197-9169-ba599d440986 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:08.676218 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d44c32-0930-4c1f-8ef8-df87ba562e3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:08.676829 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d44c32-0930-4c1f-8ef8-df87ba562e3c service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:08.677114 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d44c32-0930-4c1f-8ef8-df87ba562e3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:08.677387 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d44c32-0930-4c1f-8ef8-df87ba562e3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:08.687004 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d44c32-0930-4c1f-8ef8-df87ba562e3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:08.688417 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d44c32-0930-4c1f-8ef8-df87ba562e3c service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:08.697647 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1255/2504] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:22:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:22:09.112471 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc6a28-4898-4d8b-a984-24866726e755 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:09.113980 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-65fc6a28-4898-4d8b-a984-24866726e755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:09.126140 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc6a28-4898-4d8b-a984-24866726e755 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:09.130845 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc73b5-662c-4565-b414-7876dd2d8086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:09.131485 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc73b5-662c-4565-b414-7876dd2d8086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:09.131766 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc73b5-662c-4565-b414-7876dd2d8086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:09.132049 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc73b5-662c-4565-b414-7876dd2d8086 admin admin] PATH_INFO: `/v3/projects/c7c0d8ca86604ea8811bbd2989d45502` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:09.133231 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc73b5-662c-4565-b414-7876dd2d8086 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7c0d8ca86604ea8811bbd2989d45502)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:09.135110 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc73b5-662c-4565-b414-7876dd2d8086 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:09.236868 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-8dfc73b5-662c-4565-b414-7876dd2d8086 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7c0d8ca86604ea8811bbd2989d45502', 'request_id': 'req-8dfc73b5-662c-4565-b414-7876dd2d8086'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:09.244664 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-8dfc73b5-662c-4565-b414-7876dd2d8086 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7c0d8ca86604ea8811bbd2989d45502', 'request_id': 'req-8dfc73b5-662c-4565-b414-7876dd2d8086'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:09.317095 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-8dfc73b5-662c-4565-b414-7876dd2d8086 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7c0d8ca86604ea8811bbd2989d45502', 'request_id': 'req-8dfc73b5-662c-4565-b414-7876dd2d8086'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:09.322134 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:22:09.335267 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-8dfc73b5-662c-4565-b414-7876dd2d8086 admin admin] The token cache is being invalidate because project c7c0d8ca86604ea8811bbd2989d45502 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:22:09.335556 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-8dfc73b5-662c-4565-b414-7876dd2d8086 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:09.336508 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-8dfc73b5-662c-4565-b414-7876dd2d8086 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:09.342833 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1250/2505] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:22:09 2022] DELETE /identity/v3/projects/c7c0d8ca86604ea8811bbd2989d45502 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:22:09.343540 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d44c32-0930-4c1f-8ef8-df87ba562e3c service neutron] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:09.352867 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d44c32-0930-4c1f-8ef8-df87ba562e3c service neutron] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:09.397693 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:22:09.414684 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b9e63-7b9f-4647-b7ee-6e0408b20f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:09.419453 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b9e63-7b9f-4647-b7ee-6e0408b20f66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:09.419453 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b9e63-7b9f-4647-b7ee-6e0408b20f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:09.419453 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b9e63-7b9f-4647-b7ee-6e0408b20f66 admin admin] PATH_INFO: `/v3/users/7bea38d922bf4273b63e77087cb5d325` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:09.419453 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2b9e63-7b9f-4647-b7ee-6e0408b20f66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bea38d922bf4273b63e77087cb5d325)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:09.419453 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2b9e63-7b9f-4647-b7ee-6e0408b20f66 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:09.656112 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-fe2b9e63-7b9f-4647-b7ee-6e0408b20f66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bea38d922bf4273b63e77087cb5d325'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:09.745431 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-fe2b9e63-7b9f-4647-b7ee-6e0408b20f66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bea38d922bf4273b63e77087cb5d325'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:09.758651 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-fe2b9e63-7b9f-4647-b7ee-6e0408b20f66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bea38d922bf4273b63e77087cb5d325'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:09.759526 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-fe2b9e63-7b9f-4647-b7ee-6e0408b20f66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bea38d922bf4273b63e77087cb5d325'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:09.767147 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-fe2b9e63-7b9f-4647-b7ee-6e0408b20f66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bea38d922bf4273b63e77087cb5d325'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:09.773105 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1256/2506] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:22:09 2022] DELETE /identity/v3/users/7bea38d922bf4273b63e77087cb5d325 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:22:10.164182 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc73b5-662c-4565-b414-7876dd2d8086 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:10.165791 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8dfc73b5-662c-4565-b414-7876dd2d8086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:10.181125 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc73b5-662c-4565-b414-7876dd2d8086 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:10.239007 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96178a13-2a30-4b3e-b46e-bb652b96fa20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:10.239646 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96178a13-2a30-4b3e-b46e-bb652b96fa20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:10.239930 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96178a13-2a30-4b3e-b46e-bb652b96fa20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:10.240246 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96178a13-2a30-4b3e-b46e-bb652b96fa20 admin admin] PATH_INFO: `/v3/projects/188b43ed100a48ef9807c5d26dba94a2` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:10.241368 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96178a13-2a30-4b3e-b46e-bb652b96fa20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=188b43ed100a48ef9807c5d26dba94a2)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:10.243261 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96178a13-2a30-4b3e-b46e-bb652b96fa20 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:10.523984 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-96178a13-2a30-4b3e-b46e-bb652b96fa20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '188b43ed100a48ef9807c5d26dba94a2', 'request_id': 'req-96178a13-2a30-4b3e-b46e-bb652b96fa20'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:10.530403 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-96178a13-2a30-4b3e-b46e-bb652b96fa20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '188b43ed100a48ef9807c5d26dba94a2', 'request_id': 'req-96178a13-2a30-4b3e-b46e-bb652b96fa20'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:10.602394 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-96178a13-2a30-4b3e-b46e-bb652b96fa20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '188b43ed100a48ef9807c5d26dba94a2', 'request_id': 'req-96178a13-2a30-4b3e-b46e-bb652b96fa20'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:10.613959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-96178a13-2a30-4b3e-b46e-bb652b96fa20 admin admin] The token cache is being invalidate because project 188b43ed100a48ef9807c5d26dba94a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:22:10.614247 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-96178a13-2a30-4b3e-b46e-bb652b96fa20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:10.614857 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-96178a13-2a30-4b3e-b46e-bb652b96fa20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:10.616366 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1251/2507] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:22:10 2022] DELETE /identity/v3/projects/188b43ed100a48ef9807c5d26dba94a2 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:22:10.621756 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621ac87-053e-48f7-93db-bf620cc2bb6a None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:10.622056 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621ac87-053e-48f7-93db-bf620cc2bb6a None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:10.622331 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621ac87-053e-48f7-93db-bf620cc2bb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:10.642497 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-9621ac87-053e-48f7-93db-bf620cc2bb6a None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:22:10.643706 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-9621ac87-053e-48f7-93db-bf620cc2bb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:10.701990 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1257/2508] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:22:10.709762 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231c5a0-b1df-43b6-ba47-49ebeb7112b0 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:10.710156 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231c5a0-b1df-43b6-ba47-49ebeb7112b0 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:10.710504 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231c5a0-b1df-43b6-ba47-49ebeb7112b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:10.731446 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-7231c5a0-b1df-43b6-ba47-49ebeb7112b0 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:22:10.732984 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7231c5a0-b1df-43b6-ba47-49ebeb7112b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:10.740834 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1252/2509] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:22:10.744944 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621ac87-053e-48f7-93db-bf620cc2bb6a None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:10.755043 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621ac87-053e-48f7-93db-bf620cc2bb6a None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:10.759564 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318243f6-c983-4c8c-9c1d-69ebb1fab906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:10.760182 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318243f6-c983-4c8c-9c1d-69ebb1fab906 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:10.760464 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318243f6-c983-4c8c-9c1d-69ebb1fab906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:10.760735 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318243f6-c983-4c8c-9c1d-69ebb1fab906 admin admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:10.761366 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318243f6-c983-4c8c-9c1d-69ebb1fab906 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:22:10.761668 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318243f6-c983-4c8c-9c1d-69ebb1fab906 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:10.763262 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318243f6-c983-4c8c-9c1d-69ebb1fab906 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:10.774507 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1258/2510] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:22:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:22:10.779680 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231c5a0-b1df-43b6-ba47-49ebeb7112b0 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:10.789294 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231c5a0-b1df-43b6-ba47-49ebeb7112b0 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:10.794553 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e02df-3467-460f-9e98-0127df2c72c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:10.795153 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e02df-3467-460f-9e98-0127df2c72c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:10.795467 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e02df-3467-460f-9e98-0127df2c72c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:10.795754 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e02df-3467-460f-9e98-0127df2c72c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:10.796410 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e02df-3467-460f-9e98-0127df2c72c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:10.798284 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e02df-3467-460f-9e98-0127df2c72c1 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:10.891723 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1253/2511] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:22:10 2022] POST /identity/v3/projects => generated 363 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:22:10.895953 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318243f6-c983-4c8c-9c1d-69ebb1fab906 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:10.906082 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318243f6-c983-4c8c-9c1d-69ebb1fab906 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:10.952917 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:22:10.962901 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21234e-0630-4013-bd8d-20be06d36d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:10.965555 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21234e-0630-4013-bd8d-20be06d36d37 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:10.965555 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21234e-0630-4013-bd8d-20be06d36d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:10.965555 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21234e-0630-4013-bd8d-20be06d36d37 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:10.965555 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db21234e-0630-4013-bd8d-20be06d36d37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:10.967132 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db21234e-0630-4013-bd8d-20be06d36d37 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:11.026956 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1259/2512] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:22:10 2022] POST /identity/v3/users => generated 282 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:22:11.031646 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e02df-3467-460f-9e98-0127df2c72c1 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:11.042062 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e02df-3467-460f-9e98-0127df2c72c1 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:11.047485 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bc741-3dec-4bb7-978e-012b4d206974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:11.048118 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bc741-3dec-4bb7-978e-012b4d206974 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:11.048402 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bc741-3dec-4bb7-978e-012b4d206974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:11.048676 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bc741-3dec-4bb7-978e-012b4d206974 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:11.049315 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bc741-3dec-4bb7-978e-012b4d206974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:11.050911 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bc741-3dec-4bb7-978e-012b4d206974 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:11.061241 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1254/2513] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:22:11.065152 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21234e-0630-4013-bd8d-20be06d36d37 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:11.075000 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21234e-0630-4013-bd8d-20be06d36d37 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:11.080070 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9fdfc-9572-46a6-8477-7b630ad37cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:11.080668 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9fdfc-9572-46a6-8477-7b630ad37cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:11.080950 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9fdfc-9572-46a6-8477-7b630ad37cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:11.081231 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9fdfc-9572-46a6-8477-7b630ad37cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:11.081870 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9fdfc-9572-46a6-8477-7b630ad37cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:11.083445 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9fdfc-9572-46a6-8477-7b630ad37cb4 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:11.094613 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1260/2514] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:22:11.098695 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bc741-3dec-4bb7-978e-012b4d206974 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:11.109495 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bc741-3dec-4bb7-978e-012b4d206974 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:11.114064 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb015b-b2b4-42dd-ab36-407c3f178aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:11.114709 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb015b-b2b4-42dd-ab36-407c3f178aa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:11.114989 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb015b-b2b4-42dd-ab36-407c3f178aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:11.115263 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb015b-b2b4-42dd-ab36-407c3f178aa0 admin admin] PATH_INFO: `/v3/projects/bef805c0d5f246bd92855668bf333c3f/users/33a52ed80311427693c92c188317e2c7/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:11.129433 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb015b-b2b4-42dd-ab36-407c3f178aa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bef805c0d5f246bd92855668bf333c3f, user_id=33a52ed80311427693c92c188317e2c7, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:11.132151 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb015b-b2b4-42dd-ab36-407c3f178aa0 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:11.219900 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1255/2515] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:22:11 2022] PUT /identity/v3/projects/bef805c0d5f246bd92855668bf333c3f/users/33a52ed80311427693c92c188317e2c7/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:22:11.230246 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88553f3b-2286-45fe-bdb8-d6bd88a261a9 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:11.231108 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88553f3b-2286-45fe-bdb8-d6bd88a261a9 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:11.231402 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88553f3b-2286-45fe-bdb8-d6bd88a261a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:11.258924 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-88553f3b-2286-45fe-bdb8-d6bd88a261a9 None None] MFA Rules not processed for user `33a52ed80311427693c92c188317e2c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:22:11.260172 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-88553f3b-2286-45fe-bdb8-d6bd88a261a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:11.322508 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1261/2516] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:22:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:22:11.327507 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb015b-b2b4-42dd-ab36-407c3f178aa0 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:11.348494 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:22:11.388530 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb015b-b2b4-42dd-ab36-407c3f178aa0 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:11.393385 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2920e22-0ce5-4b5d-882b-a4248e4aaea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:11.393983 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2920e22-0ce5-4b5d-882b-a4248e4aaea5 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:11.394261 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2920e22-0ce5-4b5d-882b-a4248e4aaea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:11.394534 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2920e22-0ce5-4b5d-882b-a4248e4aaea5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:11.395169 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2920e22-0ce5-4b5d-882b-a4248e4aaea5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:11.397121 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2920e22-0ce5-4b5d-882b-a4248e4aaea5 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:11.462080 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1256/2517] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:22:11 2022] POST /identity/v3/projects => generated 365 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:22:11.466979 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88553f3b-2286-45fe-bdb8-d6bd88a261a9 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:11.477533 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88553f3b-2286-45fe-bdb8-d6bd88a261a9 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:11.533136 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01b7b0-9b9d-40e8-8a19-fd191cc76037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:11.533737 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01b7b0-9b9d-40e8-8a19-fd191cc76037 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:11.534019 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01b7b0-9b9d-40e8-8a19-fd191cc76037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:11.534292 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01b7b0-9b9d-40e8-8a19-fd191cc76037 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:11.534913 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01b7b0-9b9d-40e8-8a19-fd191cc76037 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:11.536852 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01b7b0-9b9d-40e8-8a19-fd191cc76037 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:11.598873 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1262/2518] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:22:11 2022] POST /identity/v3/users => generated 289 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:22:11.603809 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2920e22-0ce5-4b5d-882b-a4248e4aaea5 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:11.614349 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2920e22-0ce5-4b5d-882b-a4248e4aaea5 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:11.620924 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a5bb6-ce71-4982-a343-2ba141f1c8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:11.621533 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a5bb6-ce71-4982-a343-2ba141f1c8af admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:11.621816 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a5bb6-ce71-4982-a343-2ba141f1c8af admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:11.622090 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a5bb6-ce71-4982-a343-2ba141f1c8af admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:11.622733 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a5bb6-ce71-4982-a343-2ba141f1c8af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:11.624366 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a5bb6-ce71-4982-a343-2ba141f1c8af admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:11.636011 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1257/2519] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:22:11.640749 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01b7b0-9b9d-40e8-8a19-fd191cc76037 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:11.650632 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01b7b0-9b9d-40e8-8a19-fd191cc76037 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:11.655910 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79157b2c-4bde-4aa8-aa9d-843aac2182d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:11.656599 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79157b2c-4bde-4aa8-aa9d-843aac2182d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:11.656886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79157b2c-4bde-4aa8-aa9d-843aac2182d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:11.657163 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79157b2c-4bde-4aa8-aa9d-843aac2182d1 admin admin] PATH_INFO: `/v3/projects/578f7a7cdf6946049d629f6f4412b3c7/users/1b0bc7500f6b4b10a91f1cc58d70269c/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:11.672303 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79157b2c-4bde-4aa8-aa9d-843aac2182d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=578f7a7cdf6946049d629f6f4412b3c7, user_id=1b0bc7500f6b4b10a91f1cc58d70269c, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:11.674963 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79157b2c-4bde-4aa8-aa9d-843aac2182d1 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:11.790953 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1263/2520] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:22:11 2022] PUT /identity/v3/projects/578f7a7cdf6946049d629f6f4412b3c7/users/1b0bc7500f6b4b10a91f1cc58d70269c/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:22:11.796252 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a5bb6-ce71-4982-a343-2ba141f1c8af admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:11.805061 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a5bb6-ce71-4982-a343-2ba141f1c8af admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:11.861762 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87daef13-4bf4-4f90-b86e-ac6bf672a47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:11.862400 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87daef13-4bf4-4f90-b86e-ac6bf672a47c admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:11.862687 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87daef13-4bf4-4f90-b86e-ac6bf672a47c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:11.862994 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87daef13-4bf4-4f90-b86e-ac6bf672a47c admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:11.863650 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87daef13-4bf4-4f90-b86e-ac6bf672a47c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:11.865393 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87daef13-4bf4-4f90-b86e-ac6bf672a47c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:11.875762 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1258/2521] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:22:11.879881 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79157b2c-4bde-4aa8-aa9d-843aac2182d1 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:11.890833 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79157b2c-4bde-4aa8-aa9d-843aac2182d1 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:11.895556 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b512c-9c7b-4144-af32-038fc411a464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:11.896251 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b512c-9c7b-4144-af32-038fc411a464 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:11.896533 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b512c-9c7b-4144-af32-038fc411a464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:11.896809 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b512c-9c7b-4144-af32-038fc411a464 admin admin] PATH_INFO: `/v3/projects/578f7a7cdf6946049d629f6f4412b3c7/users/1b0bc7500f6b4b10a91f1cc58d70269c/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:11.898773 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b512c-9c7b-4144-af32-038fc411a464 admin admin] RBAC: Authorizing `identity:create_grant(project_id=578f7a7cdf6946049d629f6f4412b3c7, user_id=1b0bc7500f6b4b10a91f1cc58d70269c, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:11.901529 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b512c-9c7b-4144-af32-038fc411a464 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:11.911650 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1264/2522] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:22:11 2022] PUT /identity/v3/projects/578f7a7cdf6946049d629f6f4412b3c7/users/1b0bc7500f6b4b10a91f1cc58d70269c/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:22:11.976077 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c21f0-f1bf-4295-bcc6-cedf576745d8 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:11.976374 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c21f0-f1bf-4295-bcc6-cedf576745d8 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:11.976658 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c21f0-f1bf-4295-bcc6-cedf576745d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:12.004686 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-ef3c21f0-f1bf-4295-bcc6-cedf576745d8 None None] MFA Rules not processed for user `1b0bc7500f6b4b10a91f1cc58d70269c`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:22:12.005915 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ef3c21f0-f1bf-4295-bcc6-cedf576745d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:12.072870 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1259/2523] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:22:11 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:22:12.084416 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b512c-9c7b-4144-af32-038fc411a464 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:12.086090 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-a78b512c-9c7b-4144-af32-038fc411a464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:12.101510 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:22:12.145356 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b512c-9c7b-4144-af32-038fc411a464 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:12.149101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636b141-275e-4cff-9637-83473ca5e2b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:12.149710 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636b141-275e-4cff-9637-83473ca5e2b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:12.149992 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636b141-275e-4cff-9637-83473ca5e2b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:12.150266 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636b141-275e-4cff-9637-83473ca5e2b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:12.159107 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636b141-275e-4cff-9637-83473ca5e2b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:12.160577 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636b141-275e-4cff-9637-83473ca5e2b9 service cinder] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:12.170326 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1265/2524] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:22:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:22:12.377220 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c21f0-f1bf-4295-bcc6-cedf576745d8 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:12.386855 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c21f0-f1bf-4295-bcc6-cedf576745d8 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:12.390413 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad82c62d-dd7e-43be-9441-bf6ef0857f3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:12.391006 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82c62d-dd7e-43be-9441-bf6ef0857f3e service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:12.391282 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82c62d-dd7e-43be-9441-bf6ef0857f3e service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:12.391550 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82c62d-dd7e-43be-9441-bf6ef0857f3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:12.403255 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:22:12.447819 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad82c62d-dd7e-43be-9441-bf6ef0857f3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:12.449401 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad82c62d-dd7e-43be-9441-bf6ef0857f3e service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:12.458381 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1260/2525] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:22:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:22:20.810907 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636b141-275e-4cff-9637-83473ca5e2b9 service cinder] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:20.873849 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636b141-275e-4cff-9637-83473ca5e2b9 service cinder] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:20.878350 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ef51e-a74a-4dae-8734-add35d8784f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:20.878975 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ef51e-a74a-4dae-8734-add35d8784f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:20.879255 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ef51e-a74a-4dae-8734-add35d8784f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:20.879528 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ef51e-a74a-4dae-8734-add35d8784f1 admin admin] PATH_INFO: `/v3/users/33a52ed80311427693c92c188317e2c7` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:20.880651 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ef51e-a74a-4dae-8734-add35d8784f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33a52ed80311427693c92c188317e2c7)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:20.882595 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ef51e-a74a-4dae-8734-add35d8784f1 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:21.072989 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-e61ef51e-a74a-4dae-8734-add35d8784f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33a52ed80311427693c92c188317e2c7'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:21.162083 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-e61ef51e-a74a-4dae-8734-add35d8784f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33a52ed80311427693c92c188317e2c7'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:21.174799 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-e61ef51e-a74a-4dae-8734-add35d8784f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33a52ed80311427693c92c188317e2c7'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:21.175440 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-e61ef51e-a74a-4dae-8734-add35d8784f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33a52ed80311427693c92c188317e2c7'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:21.182565 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-e61ef51e-a74a-4dae-8734-add35d8784f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33a52ed80311427693c92c188317e2c7'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:21.189106 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1266/2526] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:22:20 2022] DELETE /identity/v3/users/33a52ed80311427693c92c188317e2c7 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:22:21.193645 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7f749-ebf3-4797-9f53-e6d92f8ba03d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:21.194139 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7f749-ebf3-4797-9f53-e6d92f8ba03d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:21.194244 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7f749-ebf3-4797-9f53-e6d92f8ba03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:21.212723 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-e9d7f749-ebf3-4797-9f53-e6d92f8ba03d None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:22:21.213925 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e9d7f749-ebf3-4797-9f53-e6d92f8ba03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:21.272443 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1261/2527] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:22:21.282092 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ef51e-a74a-4dae-8734-add35d8784f1 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:21.283481 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-e61ef51e-a74a-4dae-8734-add35d8784f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:21.318961 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:22:21.340196 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ef51e-a74a-4dae-8734-add35d8784f1 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:21.343919 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a255cd2-8b8e-4b3b-b9ab-57ec647ab4b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:21.344563 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a255cd2-8b8e-4b3b-b9ab-57ec647ab4b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:21.344847 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a255cd2-8b8e-4b3b-b9ab-57ec647ab4b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:21.345121 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a255cd2-8b8e-4b3b-b9ab-57ec647ab4b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:21.354778 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a255cd2-8b8e-4b3b-b9ab-57ec647ab4b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:21.356770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a255cd2-8b8e-4b3b-b9ab-57ec647ab4b2 service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:21.366525 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1267/2528] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:22:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:22:21.753967 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7f749-ebf3-4797-9f53-e6d92f8ba03d None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:21.756254 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e9d7f749-ebf3-4797-9f53-e6d92f8ba03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:21.767330 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7f749-ebf3-4797-9f53-e6d92f8ba03d None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:21.771971 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3855f99-77f1-4f47-9e5f-9d53ddda66a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:21.772699 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3855f99-77f1-4f47-9e5f-9d53ddda66a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:21.772922 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3855f99-77f1-4f47-9e5f-9d53ddda66a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:21.773193 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3855f99-77f1-4f47-9e5f-9d53ddda66a2 admin admin] PATH_INFO: `/v3/projects/bef805c0d5f246bd92855668bf333c3f` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:21.774853 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3855f99-77f1-4f47-9e5f-9d53ddda66a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bef805c0d5f246bd92855668bf333c3f)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:21.776333 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3855f99-77f1-4f47-9e5f-9d53ddda66a2 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:21.895276 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-a3855f99-77f1-4f47-9e5f-9d53ddda66a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bef805c0d5f246bd92855668bf333c3f', 'request_id': 'req-a3855f99-77f1-4f47-9e5f-9d53ddda66a2'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:21.903566 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-a3855f99-77f1-4f47-9e5f-9d53ddda66a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bef805c0d5f246bd92855668bf333c3f', 'request_id': 'req-a3855f99-77f1-4f47-9e5f-9d53ddda66a2'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:21.973617 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-a3855f99-77f1-4f47-9e5f-9d53ddda66a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bef805c0d5f246bd92855668bf333c3f', 'request_id': 'req-a3855f99-77f1-4f47-9e5f-9d53ddda66a2'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:21.984551 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-a3855f99-77f1-4f47-9e5f-9d53ddda66a2 admin admin] The token cache is being invalidate because project bef805c0d5f246bd92855668bf333c3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:22:21.984842 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-a3855f99-77f1-4f47-9e5f-9d53ddda66a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:21.985498 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-a3855f99-77f1-4f47-9e5f-9d53ddda66a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:21.986986 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1262/2529] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:22:21 2022] DELETE /identity/v3/projects/bef805c0d5f246bd92855668bf333c3f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:22:21.990936 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a255cd2-8b8e-4b3b-b9ab-57ec647ab4b2 service neutron] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:22.000711 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a255cd2-8b8e-4b3b-b9ab-57ec647ab4b2 service neutron] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:22.056875 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35d5d4-aa04-4f2f-8e1e-922910c9bcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:22.057502 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35d5d4-aa04-4f2f-8e1e-922910c9bcc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:22.057781 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35d5d4-aa04-4f2f-8e1e-922910c9bcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:22.058052 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35d5d4-aa04-4f2f-8e1e-922910c9bcc2 admin admin] PATH_INFO: `/v3/users/1b0bc7500f6b4b10a91f1cc58d70269c` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:22.059185 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca35d5d4-aa04-4f2f-8e1e-922910c9bcc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b0bc7500f6b4b10a91f1cc58d70269c)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:22.061125 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca35d5d4-aa04-4f2f-8e1e-922910c9bcc2 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:22.261409 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-ca35d5d4-aa04-4f2f-8e1e-922910c9bcc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b0bc7500f6b4b10a91f1cc58d70269c'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:22.339573 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-ca35d5d4-aa04-4f2f-8e1e-922910c9bcc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b0bc7500f6b4b10a91f1cc58d70269c'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:22.352000 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-ca35d5d4-aa04-4f2f-8e1e-922910c9bcc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b0bc7500f6b4b10a91f1cc58d70269c'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:22.352686 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-ca35d5d4-aa04-4f2f-8e1e-922910c9bcc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b0bc7500f6b4b10a91f1cc58d70269c'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:22.359692 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-ca35d5d4-aa04-4f2f-8e1e-922910c9bcc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b0bc7500f6b4b10a91f1cc58d70269c'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:22.365528 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1268/2530] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:22:21 2022] DELETE /identity/v3/users/1b0bc7500f6b4b10a91f1cc58d70269c => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:22:22.800685 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3855f99-77f1-4f47-9e5f-9d53ddda66a2 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:22.802218 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a3855f99-77f1-4f47-9e5f-9d53ddda66a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:22.816556 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3855f99-77f1-4f47-9e5f-9d53ddda66a2 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:22.851388 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:22:22.876600 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347da847-0c67-4103-9a44-4f23e765b705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:22.877246 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347da847-0c67-4103-9a44-4f23e765b705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:22.877532 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347da847-0c67-4103-9a44-4f23e765b705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:22.877806 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347da847-0c67-4103-9a44-4f23e765b705 admin admin] PATH_INFO: `/v3/projects/578f7a7cdf6946049d629f6f4412b3c7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:22.879298 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347da847-0c67-4103-9a44-4f23e765b705 admin admin] RBAC: Authorizing `identity:delete_project(project_id=578f7a7cdf6946049d629f6f4412b3c7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:22.881490 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347da847-0c67-4103-9a44-4f23e765b705 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:22.988712 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-347da847-0c67-4103-9a44-4f23e765b705 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '578f7a7cdf6946049d629f6f4412b3c7', 'request_id': 'req-347da847-0c67-4103-9a44-4f23e765b705'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:22.995345 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-347da847-0c67-4103-9a44-4f23e765b705 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '578f7a7cdf6946049d629f6f4412b3c7', 'request_id': 'req-347da847-0c67-4103-9a44-4f23e765b705'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:23.066913 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-347da847-0c67-4103-9a44-4f23e765b705 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '578f7a7cdf6946049d629f6f4412b3c7', 'request_id': 'req-347da847-0c67-4103-9a44-4f23e765b705'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:23.078181 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-347da847-0c67-4103-9a44-4f23e765b705 admin admin] The token cache is being invalidate because project 578f7a7cdf6946049d629f6f4412b3c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:22:23.078454 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-347da847-0c67-4103-9a44-4f23e765b705 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:23.079098 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-347da847-0c67-4103-9a44-4f23e765b705 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:23.080632 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1263/2531] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:22:22 2022] DELETE /identity/v3/projects/578f7a7cdf6946049d629f6f4412b3c7 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:22:23.085564 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a8d7d-75c3-4505-b365-6c677af02694 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:23.088804 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a8d7d-75c3-4505-b365-6c677af02694 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:23.088804 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a8d7d-75c3-4505-b365-6c677af02694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:23.107146 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-601a8d7d-75c3-4505-b365-6c677af02694 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:22:23.108641 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-601a8d7d-75c3-4505-b365-6c677af02694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:23.156569 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:22:23.168539 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1269/2532] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:22:23.176461 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cf50b-aa13-4e7c-afd4-5a1e36537e9a None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:23.176750 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cf50b-aa13-4e7c-afd4-5a1e36537e9a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:23.177027 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cf50b-aa13-4e7c-afd4-5a1e36537e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:23.196758 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-158cf50b-aa13-4e7c-afd4-5a1e36537e9a None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:22:23.198013 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-158cf50b-aa13-4e7c-afd4-5a1e36537e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:23.206245 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1264/2533] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:22:23.211508 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a8d7d-75c3-4505-b365-6c677af02694 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:23.221724 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a8d7d-75c3-4505-b365-6c677af02694 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:23.227205 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847b4ec-afd8-4024-80fc-2229862d5191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:23.227821 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847b4ec-afd8-4024-80fc-2229862d5191 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:23.228129 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847b4ec-afd8-4024-80fc-2229862d5191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:23.228407 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847b4ec-afd8-4024-80fc-2229862d5191 admin admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:23.229047 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a847b4ec-afd8-4024-80fc-2229862d5191 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:22:23.229348 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a847b4ec-afd8-4024-80fc-2229862d5191 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:23.231630 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a847b4ec-afd8-4024-80fc-2229862d5191 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:23.243739 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1270/2534] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:22:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:22:23.249331 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158cf50b-aa13-4e7c-afd4-5a1e36537e9a None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:23.261860 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158cf50b-aa13-4e7c-afd4-5a1e36537e9a None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:23.266516 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848631bd-9c46-4b8e-963e-24b709213273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:23.267176 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848631bd-9c46-4b8e-963e-24b709213273 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:23.267463 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848631bd-9c46-4b8e-963e-24b709213273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:23.267737 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848631bd-9c46-4b8e-963e-24b709213273 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:23.268419 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848631bd-9c46-4b8e-963e-24b709213273 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:23.270316 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848631bd-9c46-4b8e-963e-24b709213273 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:23.364766 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1265/2535] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:22:23 2022] POST /identity/v3/projects => generated 365 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:22:23.369007 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847b4ec-afd8-4024-80fc-2229862d5191 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:23.379120 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847b4ec-afd8-4024-80fc-2229862d5191 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:23.435140 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014c27f-adc3-486b-a334-742f82b782a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:23.435738 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014c27f-adc3-486b-a334-742f82b782a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:23.436014 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014c27f-adc3-486b-a334-742f82b782a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:23.436315 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014c27f-adc3-486b-a334-742f82b782a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:23.436941 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014c27f-adc3-486b-a334-742f82b782a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:23.438846 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014c27f-adc3-486b-a334-742f82b782a3 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:23.510957 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1271/2536] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:22:23 2022] POST /identity/v3/users => generated 283 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:22:23.520790 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848631bd-9c46-4b8e-963e-24b709213273 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:23.531752 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848631bd-9c46-4b8e-963e-24b709213273 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:23.536438 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f2233-f1b0-402d-b60a-e4b9209692de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:23.537032 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f2233-f1b0-402d-b60a-e4b9209692de admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:23.537310 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f2233-f1b0-402d-b60a-e4b9209692de admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:23.537578 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f2233-f1b0-402d-b60a-e4b9209692de admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:23.538216 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f2233-f1b0-402d-b60a-e4b9209692de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:23.539789 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f2233-f1b0-402d-b60a-e4b9209692de admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:23.549551 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1266/2537] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:22:23.553242 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014c27f-adc3-486b-a334-742f82b782a3 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:23.563101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014c27f-adc3-486b-a334-742f82b782a3 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:23.567700 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174b004-a29a-4af3-a8a8-0bfb739ad4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:23.568322 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174b004-a29a-4af3-a8a8-0bfb739ad4fb admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:23.568602 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174b004-a29a-4af3-a8a8-0bfb739ad4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:23.568873 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174b004-a29a-4af3-a8a8-0bfb739ad4fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:23.569533 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174b004-a29a-4af3-a8a8-0bfb739ad4fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:23.571110 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174b004-a29a-4af3-a8a8-0bfb739ad4fb admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:23.582131 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1272/2538] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:22:23.586006 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f2233-f1b0-402d-b60a-e4b9209692de admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:23.596405 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f2233-f1b0-402d-b60a-e4b9209692de admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:23.600990 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c012630-85c8-42ec-b394-2454e9eeea17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:23.601627 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c012630-85c8-42ec-b394-2454e9eeea17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:23.601907 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c012630-85c8-42ec-b394-2454e9eeea17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:23.602181 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c012630-85c8-42ec-b394-2454e9eeea17 admin admin] PATH_INFO: `/v3/projects/d0611ea3fa134871a3d7f46af6482ba5/users/1075d969769d4a96800e7126f9f9b085/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:23.616605 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c012630-85c8-42ec-b394-2454e9eeea17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0611ea3fa134871a3d7f46af6482ba5, user_id=1075d969769d4a96800e7126f9f9b085, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:23.619218 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c012630-85c8-42ec-b394-2454e9eeea17 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:23.683957 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1267/2539] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:22:23 2022] PUT /identity/v3/projects/d0611ea3fa134871a3d7f46af6482ba5/users/1075d969769d4a96800e7126f9f9b085/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:22:23.693774 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c6b0b-b25b-4692-861e-227542e65b61 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:23.694062 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c6b0b-b25b-4692-861e-227542e65b61 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:23.694343 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c6b0b-b25b-4692-861e-227542e65b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:23.722340 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-ed8c6b0b-b25b-4692-861e-227542e65b61 None None] MFA Rules not processed for user `1075d969769d4a96800e7126f9f9b085`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:22:23.723548 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-ed8c6b0b-b25b-4692-861e-227542e65b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:23.790331 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1273/2540] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:22:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:22:23.795382 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c012630-85c8-42ec-b394-2454e9eeea17 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:23.858226 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c012630-85c8-42ec-b394-2454e9eeea17 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:23.862817 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90254a28-cf60-4153-b0d0-cca065b65a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:23.864765 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90254a28-cf60-4153-b0d0-cca065b65a1f admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:23.864765 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90254a28-cf60-4153-b0d0-cca065b65a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:23.864765 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90254a28-cf60-4153-b0d0-cca065b65a1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:23.864765 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90254a28-cf60-4153-b0d0-cca065b65a1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:23.866634 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90254a28-cf60-4153-b0d0-cca065b65a1f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:23.875779 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:22:23.976226 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1268/2541] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:22:23 2022] POST /identity/v3/projects => generated 365 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:22:23.980321 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c6b0b-b25b-4692-861e-227542e65b61 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:23.991569 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c6b0b-b25b-4692-861e-227542e65b61 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:24.037673 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:22:24.047923 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021144a-1eb8-43e7-a739-0510f7d35acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:24.048699 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021144a-1eb8-43e7-a739-0510f7d35acb admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:24.048982 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021144a-1eb8-43e7-a739-0510f7d35acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:24.049278 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021144a-1eb8-43e7-a739-0510f7d35acb admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:24.049921 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3021144a-1eb8-43e7-a739-0510f7d35acb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:24.051912 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3021144a-1eb8-43e7-a739-0510f7d35acb admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:24.153051 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1274/2542] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:22:23 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:22:24.156860 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90254a28-cf60-4153-b0d0-cca065b65a1f admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:24.167313 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90254a28-cf60-4153-b0d0-cca065b65a1f admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:24.171999 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41905d19-e0bb-4626-b449-59c50b0400eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:24.172643 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41905d19-e0bb-4626-b449-59c50b0400eb admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:24.172929 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41905d19-e0bb-4626-b449-59c50b0400eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:24.173202 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41905d19-e0bb-4626-b449-59c50b0400eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:24.173838 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41905d19-e0bb-4626-b449-59c50b0400eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:24.175431 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41905d19-e0bb-4626-b449-59c50b0400eb admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:24.185219 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1269/2543] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:22:24.189229 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021144a-1eb8-43e7-a739-0510f7d35acb admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:24.199704 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021144a-1eb8-43e7-a739-0510f7d35acb admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:24.204428 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88403b-9874-4b72-bade-fe347af2c263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:24.205074 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88403b-9874-4b72-bade-fe347af2c263 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:24.205359 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88403b-9874-4b72-bade-fe347af2c263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:24.205633 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88403b-9874-4b72-bade-fe347af2c263 admin admin] PATH_INFO: `/v3/projects/d94020b6a1854b32be95bd467ce1e287/users/25f9e9dced704a5d8b4c064343247e43/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:24.220977 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88403b-9874-4b72-bade-fe347af2c263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d94020b6a1854b32be95bd467ce1e287, user_id=25f9e9dced704a5d8b4c064343247e43, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:24.223627 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88403b-9874-4b72-bade-fe347af2c263 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:24.312154 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1275/2544] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:22:24 2022] PUT /identity/v3/projects/d94020b6a1854b32be95bd467ce1e287/users/25f9e9dced704a5d8b4c064343247e43/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:22:24.316122 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41905d19-e0bb-4626-b449-59c50b0400eb admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:24.326925 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41905d19-e0bb-4626-b449-59c50b0400eb admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:24.383077 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a4e61-fa07-41ff-bd1d-060c4856a09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:24.383710 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a4e61-fa07-41ff-bd1d-060c4856a09d admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:24.383995 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a4e61-fa07-41ff-bd1d-060c4856a09d admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:24.384300 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a4e61-fa07-41ff-bd1d-060c4856a09d admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:24.384931 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727a4e61-fa07-41ff-bd1d-060c4856a09d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:24.387066 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727a4e61-fa07-41ff-bd1d-060c4856a09d admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:24.396506 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1270/2545] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:22:24.400644 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88403b-9874-4b72-bade-fe347af2c263 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:24.411589 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88403b-9874-4b72-bade-fe347af2c263 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:24.416396 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e27bbf-208f-4bd8-8fcb-004919aea71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:24.417054 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e27bbf-208f-4bd8-8fcb-004919aea71c admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:24.417341 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e27bbf-208f-4bd8-8fcb-004919aea71c admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:24.417616 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e27bbf-208f-4bd8-8fcb-004919aea71c admin admin] PATH_INFO: `/v3/projects/d94020b6a1854b32be95bd467ce1e287/users/25f9e9dced704a5d8b4c064343247e43/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:24.419516 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e27bbf-208f-4bd8-8fcb-004919aea71c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d94020b6a1854b32be95bd467ce1e287, user_id=25f9e9dced704a5d8b4c064343247e43, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:24.422176 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e27bbf-208f-4bd8-8fcb-004919aea71c admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:24.432415 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1276/2546] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:22:24 2022] PUT /identity/v3/projects/d94020b6a1854b32be95bd467ce1e287/users/25f9e9dced704a5d8b4c064343247e43/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:22:24.444253 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ca6fc-fc96-43ae-9b68-bae19e5de25c None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:24.444544 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ca6fc-fc96-43ae-9b68-bae19e5de25c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:24.444824 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ca6fc-fc96-43ae-9b68-bae19e5de25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:24.472407 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-a44ca6fc-fc96-43ae-9b68-bae19e5de25c None None] MFA Rules not processed for user `25f9e9dced704a5d8b4c064343247e43`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:22:24.473607 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a44ca6fc-fc96-43ae-9b68-bae19e5de25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:24.540281 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1271/2547] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:22:24 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:22:24.552083 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e27bbf-208f-4bd8-8fcb-004919aea71c admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:24.553805 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-f0e27bbf-208f-4bd8-8fcb-004919aea71c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:24.616387 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e27bbf-208f-4bd8-8fcb-004919aea71c admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:24.619978 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbd095-11ad-4244-9f55-15379767bf2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:24.620619 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbd095-11ad-4244-9f55-15379767bf2b service cinder] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:24.621412 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbd095-11ad-4244-9f55-15379767bf2b service cinder] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:24.621685 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbd095-11ad-4244-9f55-15379767bf2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:24.630465 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dbd095-11ad-4244-9f55-15379767bf2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:24.631889 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dbd095-11ad-4244-9f55-15379767bf2b service cinder] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:24.641833 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1277/2548] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:22:24 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:22:24.869310 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ca6fc-fc96-43ae-9b68-bae19e5de25c None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:24.879588 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ca6fc-fc96-43ae-9b68-bae19e5de25c None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:24.883179 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82586724-3e3f-4100-8b00-ba47a235c1ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:24.883778 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82586724-3e3f-4100-8b00-ba47a235c1ed service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:24.884074 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82586724-3e3f-4100-8b00-ba47a235c1ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:24.884361 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82586724-3e3f-4100-8b00-ba47a235c1ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:24.941244 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82586724-3e3f-4100-8b00-ba47a235c1ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:24.942669 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82586724-3e3f-4100-8b00-ba47a235c1ed service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:24.946157 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:22:24.951968 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1272/2549] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:22:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:22:28.458749 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbd095-11ad-4244-9f55-15379767bf2b service cinder] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:28.519995 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbd095-11ad-4244-9f55-15379767bf2b service cinder] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:28.524454 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61704762-fba1-4083-8c9a-ea5ff3e1a6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:28.525082 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61704762-fba1-4083-8c9a-ea5ff3e1a6b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:28.525366 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61704762-fba1-4083-8c9a-ea5ff3e1a6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:28.525644 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61704762-fba1-4083-8c9a-ea5ff3e1a6b1 admin admin] PATH_INFO: `/v3/users/1075d969769d4a96800e7126f9f9b085` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:28.526757 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61704762-fba1-4083-8c9a-ea5ff3e1a6b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1075d969769d4a96800e7126f9f9b085)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:28.528727 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61704762-fba1-4083-8c9a-ea5ff3e1a6b1 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:28.690257 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-61704762-fba1-4083-8c9a-ea5ff3e1a6b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1075d969769d4a96800e7126f9f9b085'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:28.691938 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:22:28.784793 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-61704762-fba1-4083-8c9a-ea5ff3e1a6b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1075d969769d4a96800e7126f9f9b085'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:28.797811 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-61704762-fba1-4083-8c9a-ea5ff3e1a6b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1075d969769d4a96800e7126f9f9b085'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:28.798448 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-61704762-fba1-4083-8c9a-ea5ff3e1a6b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1075d969769d4a96800e7126f9f9b085'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:28.805282 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-61704762-fba1-4083-8c9a-ea5ff3e1a6b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1075d969769d4a96800e7126f9f9b085'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:28.811902 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1278/2550] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:22:28 2022] DELETE /identity/v3/users/1075d969769d4a96800e7126f9f9b085 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:22:28.816351 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54940f81-f11f-44ac-bda6-654ea373ce5a None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:28.816818 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54940f81-f11f-44ac-bda6-654ea373ce5a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:28.816917 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54940f81-f11f-44ac-bda6-654ea373ce5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:28.835272 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-54940f81-f11f-44ac-bda6-654ea373ce5a None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:22:28.836514 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-54940f81-f11f-44ac-bda6-654ea373ce5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:28.893914 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1273/2551] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:22:28.903443 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61704762-fba1-4083-8c9a-ea5ff3e1a6b1 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:28.904982 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-61704762-fba1-4083-8c9a-ea5ff3e1a6b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:28.961372 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61704762-fba1-4083-8c9a-ea5ff3e1a6b1 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:28.965616 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e38b6f-2715-41b9-851e-4b15845192c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:28.966227 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e38b6f-2715-41b9-851e-4b15845192c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:28.966505 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e38b6f-2715-41b9-851e-4b15845192c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:28.966777 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e38b6f-2715-41b9-851e-4b15845192c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:28.975899 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e38b6f-2715-41b9-851e-4b15845192c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:28.977351 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e38b6f-2715-41b9-851e-4b15845192c3 service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:28.987882 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1279/2552] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:22:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:22:29.359732 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54940f81-f11f-44ac-bda6-654ea373ce5a None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:29.361180 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-54940f81-f11f-44ac-bda6-654ea373ce5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:29.372816 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54940f81-f11f-44ac-bda6-654ea373ce5a None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:29.377632 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc725b-cb38-49f4-95f8-90bb51539acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:29.378329 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc725b-cb38-49f4-95f8-90bb51539acf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:29.378616 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc725b-cb38-49f4-95f8-90bb51539acf admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:29.378888 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc725b-cb38-49f4-95f8-90bb51539acf admin admin] PATH_INFO: `/v3/projects/d0611ea3fa134871a3d7f46af6482ba5` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:29.380027 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc725b-cb38-49f4-95f8-90bb51539acf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0611ea3fa134871a3d7f46af6482ba5)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:29.382026 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc725b-cb38-49f4-95f8-90bb51539acf admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:29.493391 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-dedc725b-cb38-49f4-95f8-90bb51539acf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0611ea3fa134871a3d7f46af6482ba5', 'request_id': 'req-dedc725b-cb38-49f4-95f8-90bb51539acf'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:29.499648 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-dedc725b-cb38-49f4-95f8-90bb51539acf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0611ea3fa134871a3d7f46af6482ba5', 'request_id': 'req-dedc725b-cb38-49f4-95f8-90bb51539acf'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:29.573517 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-dedc725b-cb38-49f4-95f8-90bb51539acf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0611ea3fa134871a3d7f46af6482ba5', 'request_id': 'req-dedc725b-cb38-49f4-95f8-90bb51539acf'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:29.584940 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-dedc725b-cb38-49f4-95f8-90bb51539acf admin admin] The token cache is being invalidate because project d0611ea3fa134871a3d7f46af6482ba5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:22:29.585229 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-dedc725b-cb38-49f4-95f8-90bb51539acf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:29.585852 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-dedc725b-cb38-49f4-95f8-90bb51539acf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:29.587315 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1274/2553] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:22:29 2022] DELETE /identity/v3/projects/d0611ea3fa134871a3d7f46af6482ba5 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:22:29.592127 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e38b6f-2715-41b9-851e-4b15845192c3 service neutron] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:29.601755 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e38b6f-2715-41b9-851e-4b15845192c3 service neutron] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:29.656987 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ffc32-40e5-4d7c-a72b-bd721fbf6552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:29.657609 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ffc32-40e5-4d7c-a72b-bd721fbf6552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:29.657892 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ffc32-40e5-4d7c-a72b-bd721fbf6552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:29.658165 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ffc32-40e5-4d7c-a72b-bd721fbf6552 admin admin] PATH_INFO: `/v3/users/25f9e9dced704a5d8b4c064343247e43` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:29.659268 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0ffc32-40e5-4d7c-a72b-bd721fbf6552 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25f9e9dced704a5d8b4c064343247e43)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:29.661218 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0ffc32-40e5-4d7c-a72b-bd721fbf6552 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:29.827634 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-fe0ffc32-40e5-4d7c-a72b-bd721fbf6552 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25f9e9dced704a5d8b4c064343247e43'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:29.894984 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-fe0ffc32-40e5-4d7c-a72b-bd721fbf6552 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25f9e9dced704a5d8b4c064343247e43'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:29.906113 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:22:29.907271 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-fe0ffc32-40e5-4d7c-a72b-bd721fbf6552 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25f9e9dced704a5d8b4c064343247e43'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:29.907906 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-fe0ffc32-40e5-4d7c-a72b-bd721fbf6552 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25f9e9dced704a5d8b4c064343247e43'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:29.914857 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-fe0ffc32-40e5-4d7c-a72b-bd721fbf6552 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25f9e9dced704a5d8b4c064343247e43'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:29.920900 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1280/2554] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:22:29 2022] DELETE /identity/v3/users/25f9e9dced704a5d8b4c064343247e43 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:22:30.315060 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc725b-cb38-49f4-95f8-90bb51539acf admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:30.316645 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-dedc725b-cb38-49f4-95f8-90bb51539acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:30.330214 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc725b-cb38-49f4-95f8-90bb51539acf admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:30.390272 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1de9b9-cd6d-4f23-bc51-60480e9d78c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:30.390906 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1de9b9-cd6d-4f23-bc51-60480e9d78c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:30.391188 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1de9b9-cd6d-4f23-bc51-60480e9d78c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:30.391463 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1de9b9-cd6d-4f23-bc51-60480e9d78c8 admin admin] PATH_INFO: `/v3/projects/d94020b6a1854b32be95bd467ce1e287` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:30.392605 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1de9b9-cd6d-4f23-bc51-60480e9d78c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d94020b6a1854b32be95bd467ce1e287)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:30.394496 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1de9b9-cd6d-4f23-bc51-60480e9d78c8 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:30.418926 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:22:30.483875 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-cd1de9b9-cd6d-4f23-bc51-60480e9d78c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd94020b6a1854b32be95bd467ce1e287', 'request_id': 'req-cd1de9b9-cd6d-4f23-bc51-60480e9d78c8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:30.490035 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-cd1de9b9-cd6d-4f23-bc51-60480e9d78c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd94020b6a1854b32be95bd467ce1e287', 'request_id': 'req-cd1de9b9-cd6d-4f23-bc51-60480e9d78c8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:30.569242 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-cd1de9b9-cd6d-4f23-bc51-60480e9d78c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd94020b6a1854b32be95bd467ce1e287', 'request_id': 'req-cd1de9b9-cd6d-4f23-bc51-60480e9d78c8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:30.580045 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-cd1de9b9-cd6d-4f23-bc51-60480e9d78c8 admin admin] The token cache is being invalidate because project d94020b6a1854b32be95bd467ce1e287 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:22:30.580559 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-cd1de9b9-cd6d-4f23-bc51-60480e9d78c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:30.581741 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-cd1de9b9-cd6d-4f23-bc51-60480e9d78c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:30.583291 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1275/2555] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:22:30 2022] DELETE /identity/v3/projects/d94020b6a1854b32be95bd467ce1e287 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:22:30.588126 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350693e-119f-413c-8ec4-2c99defba7ff None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:30.588417 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350693e-119f-413c-8ec4-2c99defba7ff None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:30.588694 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350693e-119f-413c-8ec4-2c99defba7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:30.611190 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-f350693e-119f-413c-8ec4-2c99defba7ff None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:22:30.613703 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-f350693e-119f-413c-8ec4-2c99defba7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:30.671577 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1281/2556] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:22:30.679323 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d2a0f-7fa6-424d-bca1-517944bb270b None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:30.679608 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d2a0f-7fa6-424d-bca1-517944bb270b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:30.679883 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d2a0f-7fa6-424d-bca1-517944bb270b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:30.699204 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-bd3d2a0f-7fa6-424d-bca1-517944bb270b None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:22:30.700437 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-bd3d2a0f-7fa6-424d-bca1-517944bb270b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:30.708620 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1276/2557] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:22:30.712808 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350693e-119f-413c-8ec4-2c99defba7ff None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:30.722939 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350693e-119f-413c-8ec4-2c99defba7ff None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:30.727505 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5a6c9-6bc9-4923-8c6b-85a5b22504e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:30.728133 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5a6c9-6bc9-4923-8c6b-85a5b22504e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:30.728420 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5a6c9-6bc9-4923-8c6b-85a5b22504e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:30.728700 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5a6c9-6bc9-4923-8c6b-85a5b22504e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:30.729343 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f5a6c9-6bc9-4923-8c6b-85a5b22504e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81622) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:22:30.729675 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f5a6c9-6bc9-4923-8c6b-85a5b22504e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:30.731878 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f5a6c9-6bc9-4923-8c6b-85a5b22504e1 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:30.743932 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1282/2558] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:22:30.747968 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d2a0f-7fa6-424d-bca1-517944bb270b None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:30.757237 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d2a0f-7fa6-424d-bca1-517944bb270b None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:30.761855 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5d18c-7df6-4e00-a7d1-a583cf367887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:30.762486 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5d18c-7df6-4e00-a7d1-a583cf367887 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:30.762763 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5d18c-7df6-4e00-a7d1-a583cf367887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:30.763032 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5d18c-7df6-4e00-a7d1-a583cf367887 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:30.763689 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5d18c-7df6-4e00-a7d1-a583cf367887 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:30.765830 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5d18c-7df6-4e00-a7d1-a583cf367887 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:30.845377 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1277/2559] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:22:30 2022] POST /identity/v3/projects => generated 367 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:22:30.849368 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5a6c9-6bc9-4923-8c6b-85a5b22504e1 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:30.859494 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5a6c9-6bc9-4923-8c6b-85a5b22504e1 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:30.916672 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85d440-ac96-420f-93bf-341fbbb3c5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:30.917272 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85d440-ac96-420f-93bf-341fbbb3c5a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:30.917561 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85d440-ac96-420f-93bf-341fbbb3c5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:30.917828 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85d440-ac96-420f-93bf-341fbbb3c5a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:30.918471 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e85d440-ac96-420f-93bf-341fbbb3c5a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:30.920416 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e85d440-ac96-420f-93bf-341fbbb3c5a8 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:30.996127 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1283/2560] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:22:30 2022] POST /identity/v3/users => generated 284 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:22:31.000243 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5d18c-7df6-4e00-a7d1-a583cf367887 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:31.010485 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5d18c-7df6-4e00-a7d1-a583cf367887 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:31.015700 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabeb7e9-41c3-4b71-8510-3df100e6083b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:31.016341 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabeb7e9-41c3-4b71-8510-3df100e6083b admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:31.016627 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabeb7e9-41c3-4b71-8510-3df100e6083b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:31.016905 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabeb7e9-41c3-4b71-8510-3df100e6083b admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:31.017581 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabeb7e9-41c3-4b71-8510-3df100e6083b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:31.019242 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabeb7e9-41c3-4b71-8510-3df100e6083b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:31.030043 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1278/2561] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:22:31.033982 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85d440-ac96-420f-93bf-341fbbb3c5a8 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:31.043886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85d440-ac96-420f-93bf-341fbbb3c5a8 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:31.048454 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b79ed4-219b-4491-bc84-2ab75c423b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:31.049047 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b79ed4-219b-4491-bc84-2ab75c423b7e admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:31.049328 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b79ed4-219b-4491-bc84-2ab75c423b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:31.049600 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b79ed4-219b-4491-bc84-2ab75c423b7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:31.050264 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b79ed4-219b-4491-bc84-2ab75c423b7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:31.051858 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b79ed4-219b-4491-bc84-2ab75c423b7e admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:31.062237 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1284/2562] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:22:31.065993 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabeb7e9-41c3-4b71-8510-3df100e6083b admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:31.076499 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabeb7e9-41c3-4b71-8510-3df100e6083b admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:31.081278 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd09d0-5971-4010-9589-2eb2d73b8f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:31.082033 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd09d0-5971-4010-9589-2eb2d73b8f07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:31.082335 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd09d0-5971-4010-9589-2eb2d73b8f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:31.082609 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd09d0-5971-4010-9589-2eb2d73b8f07 admin admin] PATH_INFO: `/v3/projects/fd53389291754ccd855ecc8079a493bb/users/b2daf38b7c3e4b55a779f49497367798/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:31.097474 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd09d0-5971-4010-9589-2eb2d73b8f07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd53389291754ccd855ecc8079a493bb, user_id=b2daf38b7c3e4b55a779f49497367798, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:31.100132 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd09d0-5971-4010-9589-2eb2d73b8f07 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:31.156803 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1279/2563] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:22:31 2022] PUT /identity/v3/projects/fd53389291754ccd855ecc8079a493bb/users/b2daf38b7c3e4b55a779f49497367798/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:22:31.176522 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915a1a1-472f-4aed-af34-aacd97569732 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:31.176811 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915a1a1-472f-4aed-af34-aacd97569732 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:31.177091 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915a1a1-472f-4aed-af34-aacd97569732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:31.205341 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-4915a1a1-472f-4aed-af34-aacd97569732 None None] MFA Rules not processed for user `b2daf38b7c3e4b55a779f49497367798`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:22:31.206592 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-4915a1a1-472f-4aed-af34-aacd97569732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:31.247931 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:22:31.270534 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1285/2564] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:22:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:22:31.275013 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd09d0-5971-4010-9589-2eb2d73b8f07 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:31.335475 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd09d0-5971-4010-9589-2eb2d73b8f07 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:31.340333 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf9810-d5dc-4b61-942d-460845cf3513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:31.340945 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf9810-d5dc-4b61-942d-460845cf3513 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:31.341225 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf9810-d5dc-4b61-942d-460845cf3513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:31.341498 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf9810-d5dc-4b61-942d-460845cf3513 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:31.342513 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf9810-d5dc-4b61-942d-460845cf3513 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:31.344210 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf9810-d5dc-4b61-942d-460845cf3513 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:31.457086 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1280/2565] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:22:31 2022] POST /identity/v3/projects => generated 369 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:22:31.461112 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915a1a1-472f-4aed-af34-aacd97569732 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:31.471711 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915a1a1-472f-4aed-af34-aacd97569732 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:31.527459 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf543f2-7db1-47ab-91ae-faded21e1c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:31.528080 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf543f2-7db1-47ab-91ae-faded21e1c28 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:31.528388 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf543f2-7db1-47ab-91ae-faded21e1c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:31.528669 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf543f2-7db1-47ab-91ae-faded21e1c28 admin admin] PATH_INFO: `/v3/users` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:31.529319 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf543f2-7db1-47ab-91ae-faded21e1c28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:31.531232 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf543f2-7db1-47ab-91ae-faded21e1c28 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:31.633134 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1286/2566] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:22:31 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:22:31.636942 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf9810-d5dc-4b61-942d-460845cf3513 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:31.647272 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf9810-d5dc-4b61-942d-460845cf3513 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:31.651925 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0797895-7f48-421b-a0f1-d8378265f7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:31.652556 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0797895-7f48-421b-a0f1-d8378265f7a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:31.652837 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0797895-7f48-421b-a0f1-d8378265f7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:31.653110 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0797895-7f48-421b-a0f1-d8378265f7a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:31.653752 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0797895-7f48-421b-a0f1-d8378265f7a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:31.655366 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0797895-7f48-421b-a0f1-d8378265f7a8 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:31.665968 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1281/2567] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:22:31.670619 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf543f2-7db1-47ab-91ae-faded21e1c28 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:31.680590 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf543f2-7db1-47ab-91ae-faded21e1c28 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:31.685804 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392239d-70b9-400c-b476-6763ded19a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:31.686446 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392239d-70b9-400c-b476-6763ded19a12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:31.688179 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392239d-70b9-400c-b476-6763ded19a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:31.688179 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392239d-70b9-400c-b476-6763ded19a12 admin admin] PATH_INFO: `/v3/projects/6a1f2fc4875d405799957633158aad82/users/d2fa4f129b864759a253475ecd04dee0/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:31.701759 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f392239d-70b9-400c-b476-6763ded19a12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a1f2fc4875d405799957633158aad82, user_id=d2fa4f129b864759a253475ecd04dee0, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:31.704493 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f392239d-70b9-400c-b476-6763ded19a12 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:31.775093 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1287/2568] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:22:31 2022] PUT /identity/v3/projects/6a1f2fc4875d405799957633158aad82/users/d2fa4f129b864759a253475ecd04dee0/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:22:31.778908 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0797895-7f48-421b-a0f1-d8378265f7a8 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:31.789210 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0797895-7f48-421b-a0f1-d8378265f7a8 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:31.809487 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:22:31.845959 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373265a-d947-491c-a57f-2c19873b55d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:31.846570 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373265a-d947-491c-a57f-2c19873b55d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:31.846855 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373265a-d947-491c-a57f-2c19873b55d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:31.847133 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373265a-d947-491c-a57f-2c19873b55d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:31.847767 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373265a-d947-491c-a57f-2c19873b55d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:31.849492 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373265a-d947-491c-a57f-2c19873b55d6 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:31.860668 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1282/2569] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:22:31.864798 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392239d-70b9-400c-b476-6763ded19a12 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:31.875674 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392239d-70b9-400c-b476-6763ded19a12 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:31.880261 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294179d1-040c-4978-9197-45727a0e61df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:31.880945 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294179d1-040c-4978-9197-45727a0e61df admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:31.881224 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294179d1-040c-4978-9197-45727a0e61df admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:31.881496 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294179d1-040c-4978-9197-45727a0e61df admin admin] PATH_INFO: `/v3/projects/6a1f2fc4875d405799957633158aad82/users/d2fa4f129b864759a253475ecd04dee0/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:31.883458 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294179d1-040c-4978-9197-45727a0e61df admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a1f2fc4875d405799957633158aad82, user_id=d2fa4f129b864759a253475ecd04dee0, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:31.886110 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294179d1-040c-4978-9197-45727a0e61df admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:31.896675 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1288/2570] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:22:31 2022] PUT /identity/v3/projects/6a1f2fc4875d405799957633158aad82/users/d2fa4f129b864759a253475ecd04dee0/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:22:31.908470 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197db261-9876-47f8-9ea7-7460c7e1daf5 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:31.908768 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197db261-9876-47f8-9ea7-7460c7e1daf5 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:31.909051 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197db261-9876-47f8-9ea7-7460c7e1daf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:31.938598 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-197db261-9876-47f8-9ea7-7460c7e1daf5 None None] MFA Rules not processed for user `d2fa4f129b864759a253475ecd04dee0`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:22:31.939821 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-197db261-9876-47f8-9ea7-7460c7e1daf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:32.005775 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1283/2571] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:22:31 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:22:32.016503 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294179d1-040c-4978-9197-45727a0e61df admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:32.018175 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-294179d1-040c-4978-9197-45727a0e61df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:32.076331 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294179d1-040c-4978-9197-45727a0e61df admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:32.079925 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec09ee-d911-4367-a1da-aecb2b5510d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:32.080623 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec09ee-d911-4367-a1da-aecb2b5510d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:32.080904 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec09ee-d911-4367-a1da-aecb2b5510d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:32.081177 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec09ee-d911-4367-a1da-aecb2b5510d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:32.090445 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec09ee-d911-4367-a1da-aecb2b5510d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:32.091863 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec09ee-d911-4367-a1da-aecb2b5510d8 service cinder] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:32.101154 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1289/2572] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:22:32 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:22:34.802835 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197db261-9876-47f8-9ea7-7460c7e1daf5 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:34.863353 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197db261-9876-47f8-9ea7-7460c7e1daf5 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:34.867881 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e08092-c6c4-480c-92e2-8f5e70b190b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:34.868537 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e08092-c6c4-480c-92e2-8f5e70b190b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:34.868817 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e08092-c6c4-480c-92e2-8f5e70b190b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:34.869093 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e08092-c6c4-480c-92e2-8f5e70b190b2 admin admin] PATH_INFO: `/v3/users/b2daf38b7c3e4b55a779f49497367798` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:34.870193 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e08092-c6c4-480c-92e2-8f5e70b190b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2daf38b7c3e4b55a779f49497367798)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:34.872133 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e08092-c6c4-480c-92e2-8f5e70b190b2 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:35.067453 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:22:35.069151 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-90e08092-c6c4-480c-92e2-8f5e70b190b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2daf38b7c3e4b55a779f49497367798'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:35.150173 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-90e08092-c6c4-480c-92e2-8f5e70b190b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2daf38b7c3e4b55a779f49497367798'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:35.162982 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-90e08092-c6c4-480c-92e2-8f5e70b190b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2daf38b7c3e4b55a779f49497367798'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:35.170027 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-90e08092-c6c4-480c-92e2-8f5e70b190b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2daf38b7c3e4b55a779f49497367798'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:35.170668 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-90e08092-c6c4-480c-92e2-8f5e70b190b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2daf38b7c3e4b55a779f49497367798'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:35.176511 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1284/2573] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:22:34 2022] DELETE /identity/v3/users/b2daf38b7c3e4b55a779f49497367798 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:22:35.180896 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3e9e3-3454-4d84-a926-7b487b676cec None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:35.181362 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3e9e3-3454-4d84-a926-7b487b676cec None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:35.181480 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3e9e3-3454-4d84-a926-7b487b676cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:35.201131 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-7bf3e9e3-3454-4d84-a926-7b487b676cec None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:22:35.202328 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-7bf3e9e3-3454-4d84-a926-7b487b676cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:35.234412 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:22:35.260409 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1290/2574] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:22:35.270758 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e08092-c6c4-480c-92e2-8f5e70b190b2 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:35.272290 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-90e08092-c6c4-480c-92e2-8f5e70b190b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:35.327991 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e08092-c6c4-480c-92e2-8f5e70b190b2 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:35.331549 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59bcc2-2e60-4962-aec1-91fccbba53ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:35.332183 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59bcc2-2e60-4962-aec1-91fccbba53ac service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:35.332467 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59bcc2-2e60-4962-aec1-91fccbba53ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:35.332741 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59bcc2-2e60-4962-aec1-91fccbba53ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:35.341976 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f59bcc2-2e60-4962-aec1-91fccbba53ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:35.343362 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f59bcc2-2e60-4962-aec1-91fccbba53ac service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:35.352726 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1285/2575] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:22:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:22:35.764986 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3e9e3-3454-4d84-a926-7b487b676cec None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:35.766557 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-7bf3e9e3-3454-4d84-a926-7b487b676cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:35.779231 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3e9e3-3454-4d84-a926-7b487b676cec None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:35.784206 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dfccde-3573-4daf-8ba3-63792acbbff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:35.784999 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfccde-3573-4daf-8ba3-63792acbbff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:35.785217 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfccde-3573-4daf-8ba3-63792acbbff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:35.785494 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfccde-3573-4daf-8ba3-63792acbbff0 admin admin] PATH_INFO: `/v3/projects/fd53389291754ccd855ecc8079a493bb` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:35.786599 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dfccde-3573-4daf-8ba3-63792acbbff0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd53389291754ccd855ecc8079a493bb)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:35.788537 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dfccde-3573-4daf-8ba3-63792acbbff0 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:35.901097 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-06dfccde-3573-4daf-8ba3-63792acbbff0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd53389291754ccd855ecc8079a493bb', 'request_id': 'req-06dfccde-3573-4daf-8ba3-63792acbbff0'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:36.037958 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-06dfccde-3573-4daf-8ba3-63792acbbff0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd53389291754ccd855ecc8079a493bb', 'request_id': 'req-06dfccde-3573-4daf-8ba3-63792acbbff0'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:36.045001 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-06dfccde-3573-4daf-8ba3-63792acbbff0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd53389291754ccd855ecc8079a493bb', 'request_id': 'req-06dfccde-3573-4daf-8ba3-63792acbbff0'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:36.055414 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-06dfccde-3573-4daf-8ba3-63792acbbff0 admin admin] The token cache is being invalidate because project fd53389291754ccd855ecc8079a493bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:22:36.055705 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-06dfccde-3573-4daf-8ba3-63792acbbff0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:36.056358 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-06dfccde-3573-4daf-8ba3-63792acbbff0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:36.057835 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1291/2576] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:22:35 2022] DELETE /identity/v3/projects/fd53389291754ccd855ecc8079a493bb => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:22:36.061859 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59bcc2-2e60-4962-aec1-91fccbba53ac service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:36.071367 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59bcc2-2e60-4962-aec1-91fccbba53ac service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:36.126869 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc09381d-280d-4cfe-89cc-91dd62669fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:36.127497 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09381d-280d-4cfe-89cc-91dd62669fd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:36.127777 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09381d-280d-4cfe-89cc-91dd62669fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:36.128048 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09381d-280d-4cfe-89cc-91dd62669fd5 admin admin] PATH_INFO: `/v3/users/d2fa4f129b864759a253475ecd04dee0` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:36.129172 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc09381d-280d-4cfe-89cc-91dd62669fd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2fa4f129b864759a253475ecd04dee0)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:36.131085 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc09381d-280d-4cfe-89cc-91dd62669fd5 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:36.308728 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-dc09381d-280d-4cfe-89cc-91dd62669fd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2fa4f129b864759a253475ecd04dee0'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:36.374764 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-dc09381d-280d-4cfe-89cc-91dd62669fd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2fa4f129b864759a253475ecd04dee0'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:36.385415 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:22:36.388205 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-dc09381d-280d-4cfe-89cc-91dd62669fd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2fa4f129b864759a253475ecd04dee0'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:36.395140 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-dc09381d-280d-4cfe-89cc-91dd62669fd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2fa4f129b864759a253475ecd04dee0'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:36.395771 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-dc09381d-280d-4cfe-89cc-91dd62669fd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2fa4f129b864759a253475ecd04dee0'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:36.401787 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1286/2577] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:22:36 2022] DELETE /identity/v3/users/d2fa4f129b864759a253475ecd04dee0 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:22:36.804934 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dfccde-3573-4daf-8ba3-63792acbbff0 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:36.806373 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-06dfccde-3573-4daf-8ba3-63792acbbff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:36.820452 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dfccde-3573-4daf-8ba3-63792acbbff0 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:36.878287 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137cfdbe-a83d-4fa8-a982-b719cb8dddf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:36.878855 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cfdbe-a83d-4fa8-a982-b719cb8dddf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:36.879139 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cfdbe-a83d-4fa8-a982-b719cb8dddf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:36.879421 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cfdbe-a83d-4fa8-a982-b719cb8dddf3 admin admin] PATH_INFO: `/v3/projects/6a1f2fc4875d405799957633158aad82` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:36.880566 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137cfdbe-a83d-4fa8-a982-b719cb8dddf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a1f2fc4875d405799957633158aad82)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:36.882474 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137cfdbe-a83d-4fa8-a982-b719cb8dddf3 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:36.998577 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-137cfdbe-a83d-4fa8-a982-b719cb8dddf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a1f2fc4875d405799957633158aad82', 'request_id': 'req-137cfdbe-a83d-4fa8-a982-b719cb8dddf3'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:37.076008 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-137cfdbe-a83d-4fa8-a982-b719cb8dddf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a1f2fc4875d405799957633158aad82', 'request_id': 'req-137cfdbe-a83d-4fa8-a982-b719cb8dddf3'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:37.082578 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-137cfdbe-a83d-4fa8-a982-b719cb8dddf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a1f2fc4875d405799957633158aad82', 'request_id': 'req-137cfdbe-a83d-4fa8-a982-b719cb8dddf3'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:37.084590 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:22:37.093070 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-137cfdbe-a83d-4fa8-a982-b719cb8dddf3 admin admin] The token cache is being invalidate because project 6a1f2fc4875d405799957633158aad82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:22:37.093351 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-137cfdbe-a83d-4fa8-a982-b719cb8dddf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:37.097398 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-137cfdbe-a83d-4fa8-a982-b719cb8dddf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:37.097398 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1292/2578] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:22:36 2022] DELETE /identity/v3/projects/6a1f2fc4875d405799957633158aad82 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:22:37.100534 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5cc17-a588-40e6-a876-42a5f457279c None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:37.101000 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5cc17-a588-40e6-a876-42a5f457279c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:37.101125 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5cc17-a588-40e6-a876-42a5f457279c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:37.123839 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-39d5cc17-a588-40e6-a876-42a5f457279c None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:22:37.126275 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-39d5cc17-a588-40e6-a876-42a5f457279c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:37.182639 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1287/2579] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:22:37.190453 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd92886-e8a2-4fda-a761-93f3d11af1f1 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:37.190744 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd92886-e8a2-4fda-a761-93f3d11af1f1 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:37.191020 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd92886-e8a2-4fda-a761-93f3d11af1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:37.210040 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-8bd92886-e8a2-4fda-a761-93f3d11af1f1 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:22:37.211236 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-8bd92886-e8a2-4fda-a761-93f3d11af1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:37.219468 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1293/2580] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:22:37.223760 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d5cc17-a588-40e6-a876-42a5f457279c None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:37.234513 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d5cc17-a588-40e6-a876-42a5f457279c None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:37.239109 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19c546-3f70-4160-83b1-2cc5c8a18a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:37.239707 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19c546-3f70-4160-83b1-2cc5c8a18a06 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:37.239993 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19c546-3f70-4160-83b1-2cc5c8a18a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:37.240301 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19c546-3f70-4160-83b1-2cc5c8a18a06 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:37.240943 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19c546-3f70-4160-83b1-2cc5c8a18a06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:22:37.241249 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19c546-3f70-4160-83b1-2cc5c8a18a06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:37.242836 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19c546-3f70-4160-83b1-2cc5c8a18a06 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:37.254360 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1288/2581] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:22:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:22:37.258402 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd92886-e8a2-4fda-a761-93f3d11af1f1 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:37.267541 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd92886-e8a2-4fda-a761-93f3d11af1f1 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:37.272044 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3ae77-018b-4857-8f9e-2351e99d02a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:37.272660 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3ae77-018b-4857-8f9e-2351e99d02a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:37.272937 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3ae77-018b-4857-8f9e-2351e99d02a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:37.273208 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3ae77-018b-4857-8f9e-2351e99d02a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:37.273836 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e3ae77-018b-4857-8f9e-2351e99d02a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:37.275697 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e3ae77-018b-4857-8f9e-2351e99d02a9 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:37.380914 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1294/2582] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:22:37 2022] POST /identity/v3/projects => generated 369 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:22:37.385096 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19c546-3f70-4160-83b1-2cc5c8a18a06 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:37.395229 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19c546-3f70-4160-83b1-2cc5c8a18a06 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:37.451304 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8aa5dd-c987-4351-a122-0bc610d37c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:37.451844 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8aa5dd-c987-4351-a122-0bc610d37c6d admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:37.452156 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8aa5dd-c987-4351-a122-0bc610d37c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:37.452437 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8aa5dd-c987-4351-a122-0bc610d37c6d admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:37.453066 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8aa5dd-c987-4351-a122-0bc610d37c6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:37.454978 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8aa5dd-c987-4351-a122-0bc610d37c6d admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:37.569541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1289/2583] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:22:37 2022] POST /identity/v3/users => generated 285 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:22:37.573620 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3ae77-018b-4857-8f9e-2351e99d02a9 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:37.584522 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3ae77-018b-4857-8f9e-2351e99d02a9 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:37.588992 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0622939-2345-4fe5-81c7-2b65fa0e0843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:37.589580 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0622939-2345-4fe5-81c7-2b65fa0e0843 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:37.589856 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0622939-2345-4fe5-81c7-2b65fa0e0843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:37.590126 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0622939-2345-4fe5-81c7-2b65fa0e0843 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:37.591433 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0622939-2345-4fe5-81c7-2b65fa0e0843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:37.593046 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0622939-2345-4fe5-81c7-2b65fa0e0843 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:37.602760 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1295/2584] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:22:37.606536 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8aa5dd-c987-4351-a122-0bc610d37c6d admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:37.616749 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8aa5dd-c987-4351-a122-0bc610d37c6d admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:37.621357 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf2386-9957-472f-bebd-8d44b83dd936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:37.621948 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf2386-9957-472f-bebd-8d44b83dd936 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:37.622231 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf2386-9957-472f-bebd-8d44b83dd936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:37.622508 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf2386-9957-472f-bebd-8d44b83dd936 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:37.623158 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cf2386-9957-472f-bebd-8d44b83dd936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:37.624773 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cf2386-9957-472f-bebd-8d44b83dd936 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:37.635179 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1290/2585] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:22:37.639582 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0622939-2345-4fe5-81c7-2b65fa0e0843 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:37.649614 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0622939-2345-4fe5-81c7-2b65fa0e0843 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:37.654733 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1065496-3fdb-465b-beae-bfb2037acb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:37.655373 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1065496-3fdb-465b-beae-bfb2037acb09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:37.655648 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1065496-3fdb-465b-beae-bfb2037acb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:37.655919 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1065496-3fdb-465b-beae-bfb2037acb09 admin admin] PATH_INFO: `/v3/projects/f5459c3fcf6c44c894ac7de9630580e7/users/cdb856967127456580e0ee3a4ac19363/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:37.670584 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1065496-3fdb-465b-beae-bfb2037acb09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5459c3fcf6c44c894ac7de9630580e7, user_id=cdb856967127456580e0ee3a4ac19363, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:37.673237 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1065496-3fdb-465b-beae-bfb2037acb09 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:37.774920 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1296/2586] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:22:37 2022] PUT /identity/v3/projects/f5459c3fcf6c44c894ac7de9630580e7/users/cdb856967127456580e0ee3a4ac19363/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:22:37.786884 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f67a43-cb73-46b3-a8e1-045d13d987f8 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:37.787172 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f67a43-cb73-46b3-a8e1-045d13d987f8 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:37.787450 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f67a43-cb73-46b3-a8e1-045d13d987f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:37.814597 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-86f67a43-cb73-46b3-a8e1-045d13d987f8 None None] MFA Rules not processed for user `cdb856967127456580e0ee3a4ac19363`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:22:37.815835 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-86f67a43-cb73-46b3-a8e1-045d13d987f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:37.858481 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:22:37.882137 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1291/2587] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:22:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:22:37.886796 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1065496-3fdb-465b-beae-bfb2037acb09 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:37.949877 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1065496-3fdb-465b-beae-bfb2037acb09 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:37.955123 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de9c3f-0b0a-49d4-86fb-bcec51aac3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:37.955726 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de9c3f-0b0a-49d4-86fb-bcec51aac3e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:37.956010 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de9c3f-0b0a-49d4-86fb-bcec51aac3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:37.956319 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de9c3f-0b0a-49d4-86fb-bcec51aac3e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:37.956943 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62de9c3f-0b0a-49d4-86fb-bcec51aac3e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:37.958831 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62de9c3f-0b0a-49d4-86fb-bcec51aac3e7 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:38.050440 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1297/2588] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:22:37 2022] POST /identity/v3/projects => generated 369 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:22:38.056121 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f67a43-cb73-46b3-a8e1-045d13d987f8 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:38.066315 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f67a43-cb73-46b3-a8e1-045d13d987f8 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:38.121288 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda7e36-41b8-4675-88bf-106bee46bbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:38.121918 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda7e36-41b8-4675-88bf-106bee46bbf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:38.122674 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda7e36-41b8-4675-88bf-106bee46bbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:38.122945 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda7e36-41b8-4675-88bf-106bee46bbf9 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:38.123634 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda7e36-41b8-4675-88bf-106bee46bbf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:38.125591 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda7e36-41b8-4675-88bf-106bee46bbf9 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:38.186338 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1292/2589] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:22:38 2022] POST /identity/v3/users => generated 291 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:22:38.190463 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de9c3f-0b0a-49d4-86fb-bcec51aac3e7 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:38.201304 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de9c3f-0b0a-49d4-86fb-bcec51aac3e7 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:38.205989 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3aa82b-cc23-41ab-aa94-ca8f00a0bab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:38.206564 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3aa82b-cc23-41ab-aa94-ca8f00a0bab3 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:38.206845 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3aa82b-cc23-41ab-aa94-ca8f00a0bab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:38.207119 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3aa82b-cc23-41ab-aa94-ca8f00a0bab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:38.207759 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3aa82b-cc23-41ab-aa94-ca8f00a0bab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:38.209385 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3aa82b-cc23-41ab-aa94-ca8f00a0bab3 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:38.219898 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1298/2590] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:22:38.224038 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda7e36-41b8-4675-88bf-106bee46bbf9 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:38.234028 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda7e36-41b8-4675-88bf-106bee46bbf9 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:38.238661 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb7af7-b721-4f22-bb07-3d7311b0760b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:38.239309 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb7af7-b721-4f22-bb07-3d7311b0760b admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:38.239588 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb7af7-b721-4f22-bb07-3d7311b0760b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:38.239862 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb7af7-b721-4f22-bb07-3d7311b0760b admin admin] PATH_INFO: `/v3/projects/0bf4e1719a0a4b6bb9d9ec85c8fd6554/users/ca75632a610f4b1881b82824cac61a10/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:38.254664 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb7af7-b721-4f22-bb07-3d7311b0760b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bf4e1719a0a4b6bb9d9ec85c8fd6554, user_id=ca75632a610f4b1881b82824cac61a10, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:38.257363 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb7af7-b721-4f22-bb07-3d7311b0760b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:38.323052 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1293/2591] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:22:38 2022] PUT /identity/v3/projects/0bf4e1719a0a4b6bb9d9ec85c8fd6554/users/ca75632a610f4b1881b82824cac61a10/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:22:38.327215 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3aa82b-cc23-41ab-aa94-ca8f00a0bab3 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:38.337382 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3aa82b-cc23-41ab-aa94-ca8f00a0bab3 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:38.393504 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f6c3d-0d79-44b3-9f15-f2c3a7c935f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:38.394110 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f6c3d-0d79-44b3-9f15-f2c3a7c935f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:38.394392 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f6c3d-0d79-44b3-9f15-f2c3a7c935f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:38.394776 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f6c3d-0d79-44b3-9f15-f2c3a7c935f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:38.395417 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22f6c3d-0d79-44b3-9f15-f2c3a7c935f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:38.397044 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22f6c3d-0d79-44b3-9f15-f2c3a7c935f9 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:38.399052 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:22:38.406934 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1299/2592] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:22:38.411153 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb7af7-b721-4f22-bb07-3d7311b0760b admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:38.422022 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb7af7-b721-4f22-bb07-3d7311b0760b admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:38.426651 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130af33-d959-44f4-947e-b7d9966c3bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:38.427297 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130af33-d959-44f4-947e-b7d9966c3bae admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:38.427575 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130af33-d959-44f4-947e-b7d9966c3bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:38.427849 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130af33-d959-44f4-947e-b7d9966c3bae admin admin] PATH_INFO: `/v3/projects/0bf4e1719a0a4b6bb9d9ec85c8fd6554/users/ca75632a610f4b1881b82824cac61a10/roles/d6876897d7c548b7900d4e01cb45a007` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:38.429785 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130af33-d959-44f4-947e-b7d9966c3bae admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bf4e1719a0a4b6bb9d9ec85c8fd6554, user_id=ca75632a610f4b1881b82824cac61a10, role_id=d6876897d7c548b7900d4e01cb45a007)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:38.432562 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130af33-d959-44f4-947e-b7d9966c3bae admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:38.443945 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1294/2593] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:22:38 2022] PUT /identity/v3/projects/0bf4e1719a0a4b6bb9d9ec85c8fd6554/users/ca75632a610f4b1881b82824cac61a10/roles/d6876897d7c548b7900d4e01cb45a007 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:22:38.454314 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483adddc-0aa3-4af0-8dfb-356058a1a019 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:38.454865 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483adddc-0aa3-4af0-8dfb-356058a1a019 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:38.455415 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483adddc-0aa3-4af0-8dfb-356058a1a019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:38.484297 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-483adddc-0aa3-4af0-8dfb-356058a1a019 None None] MFA Rules not processed for user `ca75632a610f4b1881b82824cac61a10`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:22:38.485501 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-483adddc-0aa3-4af0-8dfb-356058a1a019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:38.551608 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1300/2594] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:22:38 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:22:38.563375 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130af33-d959-44f4-947e-b7d9966c3bae admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:38.565080 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5130af33-d959-44f4-947e-b7d9966c3bae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:38.629960 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130af33-d959-44f4-947e-b7d9966c3bae admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:38.633529 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213923f6-8a97-4e82-b9f6-a73968f87e13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:38.634127 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213923f6-8a97-4e82-b9f6-a73968f87e13 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:38.634405 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213923f6-8a97-4e82-b9f6-a73968f87e13 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:38.634673 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213923f6-8a97-4e82-b9f6-a73968f87e13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:38.643545 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213923f6-8a97-4e82-b9f6-a73968f87e13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:38.645037 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213923f6-8a97-4e82-b9f6-a73968f87e13 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:38.654834 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1295/2595] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:22:38 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:22:38.761101 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483adddc-0aa3-4af0-8dfb-356058a1a019 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:38.762632 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-483adddc-0aa3-4af0-8dfb-356058a1a019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:38.774498 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483adddc-0aa3-4af0-8dfb-356058a1a019 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:38.778939 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545e52d-43d3-4be8-be82-969b815afaa8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:38.779593 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545e52d-43d3-4be8-be82-969b815afaa8 service cinder] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:38.779869 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545e52d-43d3-4be8-be82-969b815afaa8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:38.780165 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545e52d-43d3-4be8-be82-969b815afaa8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:38.835479 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545e52d-43d3-4be8-be82-969b815afaa8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:38.837037 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545e52d-43d3-4be8-be82-969b815afaa8 service cinder] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:38.846306 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1301/2596] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:22:38 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:22:43.692081 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213923f6-8a97-4e82-b9f6-a73968f87e13 service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:43.730317 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:22:43.753925 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213923f6-8a97-4e82-b9f6-a73968f87e13 service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:43.758511 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510ca7d-d59a-4e7b-bcbf-b39ad9cd5de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:43.759127 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510ca7d-d59a-4e7b-bcbf-b39ad9cd5de4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:43.759403 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510ca7d-d59a-4e7b-bcbf-b39ad9cd5de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:43.759685 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510ca7d-d59a-4e7b-bcbf-b39ad9cd5de4 admin admin] PATH_INFO: `/v3/users/cdb856967127456580e0ee3a4ac19363` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:43.760872 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510ca7d-d59a-4e7b-bcbf-b39ad9cd5de4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdb856967127456580e0ee3a4ac19363)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:43.763194 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510ca7d-d59a-4e7b-bcbf-b39ad9cd5de4 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:43.936864 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b510ca7d-d59a-4e7b-bcbf-b39ad9cd5de4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdb856967127456580e0ee3a4ac19363'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:44.002980 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b510ca7d-d59a-4e7b-bcbf-b39ad9cd5de4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdb856967127456580e0ee3a4ac19363'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:44.015439 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b510ca7d-d59a-4e7b-bcbf-b39ad9cd5de4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdb856967127456580e0ee3a4ac19363'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:44.022565 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b510ca7d-d59a-4e7b-bcbf-b39ad9cd5de4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdb856967127456580e0ee3a4ac19363'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:44.023206 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b510ca7d-d59a-4e7b-bcbf-b39ad9cd5de4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdb856967127456580e0ee3a4ac19363'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:44.029601 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1296/2597] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:22:43 2022] DELETE /identity/v3/users/cdb856967127456580e0ee3a4ac19363 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:22:44.034100 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c8081-ca8f-41b2-b39c-5005c3b2961b None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:44.034590 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c8081-ca8f-41b2-b39c-5005c3b2961b None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:44.034701 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c8081-ca8f-41b2-b39c-5005c3b2961b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:44.054004 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-924c8081-ca8f-41b2-b39c-5005c3b2961b None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:22:44.055188 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-924c8081-ca8f-41b2-b39c-5005c3b2961b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:44.112916 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1302/2598] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:22:44.126935 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510ca7d-d59a-4e7b-bcbf-b39ad9cd5de4 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:44.128395 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b510ca7d-d59a-4e7b-bcbf-b39ad9cd5de4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:44.184332 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510ca7d-d59a-4e7b-bcbf-b39ad9cd5de4 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:44.187948 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f62ed1-9f70-494d-987e-8b3067d05eb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:44.188575 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f62ed1-9f70-494d-987e-8b3067d05eb4 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:44.188859 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f62ed1-9f70-494d-987e-8b3067d05eb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:44.189131 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f62ed1-9f70-494d-987e-8b3067d05eb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:44.197849 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f62ed1-9f70-494d-987e-8b3067d05eb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:44.199260 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f62ed1-9f70-494d-987e-8b3067d05eb4 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:44.208398 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1297/2599] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:22:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:22:44.580580 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c8081-ca8f-41b2-b39c-5005c3b2961b None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:44.582183 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-924c8081-ca8f-41b2-b39c-5005c3b2961b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:44.596389 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c8081-ca8f-41b2-b39c-5005c3b2961b None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:44.601889 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea1fd4f-1da4-494e-a103-3baa68ac6d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:44.602720 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1fd4f-1da4-494e-a103-3baa68ac6d7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:44.603158 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1fd4f-1da4-494e-a103-3baa68ac6d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:44.603460 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1fd4f-1da4-494e-a103-3baa68ac6d7b admin admin] PATH_INFO: `/v3/projects/f5459c3fcf6c44c894ac7de9630580e7` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:44.604611 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea1fd4f-1da4-494e-a103-3baa68ac6d7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5459c3fcf6c44c894ac7de9630580e7)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:44.606596 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea1fd4f-1da4-494e-a103-3baa68ac6d7b admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:44.627315 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=100 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:22:44.723882 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-aea1fd4f-1da4-494e-a103-3baa68ac6d7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5459c3fcf6c44c894ac7de9630580e7', 'request_id': 'req-aea1fd4f-1da4-494e-a103-3baa68ac6d7b'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:44.791886 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-aea1fd4f-1da4-494e-a103-3baa68ac6d7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5459c3fcf6c44c894ac7de9630580e7', 'request_id': 'req-aea1fd4f-1da4-494e-a103-3baa68ac6d7b'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:44.798625 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-aea1fd4f-1da4-494e-a103-3baa68ac6d7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5459c3fcf6c44c894ac7de9630580e7', 'request_id': 'req-aea1fd4f-1da4-494e-a103-3baa68ac6d7b'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:44.809175 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-aea1fd4f-1da4-494e-a103-3baa68ac6d7b admin admin] The token cache is being invalidate because project f5459c3fcf6c44c894ac7de9630580e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:22:44.809971 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-aea1fd4f-1da4-494e-a103-3baa68ac6d7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:44.810602 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-aea1fd4f-1da4-494e-a103-3baa68ac6d7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:44.812148 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1303/2600] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:22:44 2022] DELETE /identity/v3/projects/f5459c3fcf6c44c894ac7de9630580e7 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:22:44.821543 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f62ed1-9f70-494d-987e-8b3067d05eb4 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:44.832238 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f62ed1-9f70-494d-987e-8b3067d05eb4 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:44.882295 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:22:44.888894 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef08b7c-fe8e-442a-be31-36e0c0944fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:44.889562 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef08b7c-fe8e-442a-be31-36e0c0944fdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:44.889843 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef08b7c-fe8e-442a-be31-36e0c0944fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:44.890119 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef08b7c-fe8e-442a-be31-36e0c0944fdb admin admin] PATH_INFO: `/v3/users/ca75632a610f4b1881b82824cac61a10` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:44.891256 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef08b7c-fe8e-442a-be31-36e0c0944fdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca75632a610f4b1881b82824cac61a10)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:44.897942 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef08b7c-fe8e-442a-be31-36e0c0944fdb admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:45.074837 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7ef08b7c-fe8e-442a-be31-36e0c0944fdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca75632a610f4b1881b82824cac61a10'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:45.134881 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7ef08b7c-fe8e-442a-be31-36e0c0944fdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca75632a610f4b1881b82824cac61a10'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:45.147137 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7ef08b7c-fe8e-442a-be31-36e0c0944fdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca75632a610f4b1881b82824cac61a10'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:45.154004 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7ef08b7c-fe8e-442a-be31-36e0c0944fdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca75632a610f4b1881b82824cac61a10'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:45.154632 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7ef08b7c-fe8e-442a-be31-36e0c0944fdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca75632a610f4b1881b82824cac61a10'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:45.160648 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1298/2601] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:22:44 2022] DELETE /identity/v3/users/ca75632a610f4b1881b82824cac61a10 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:22:45.514051 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea1fd4f-1da4-494e-a103-3baa68ac6d7b admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:45.515489 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-aea1fd4f-1da4-494e-a103-3baa68ac6d7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:45.529174 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea1fd4f-1da4-494e-a103-3baa68ac6d7b admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:45.586995 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f4007-c8eb-4672-af27-4ca30acd1df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:45.587635 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f4007-c8eb-4672-af27-4ca30acd1df9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:45.587947 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f4007-c8eb-4672-af27-4ca30acd1df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:45.588247 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f4007-c8eb-4672-af27-4ca30acd1df9 admin admin] PATH_INFO: `/v3/projects/0bf4e1719a0a4b6bb9d9ec85c8fd6554` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:45.589486 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f4007-c8eb-4672-af27-4ca30acd1df9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bf4e1719a0a4b6bb9d9ec85c8fd6554)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:45.591428 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f4007-c8eb-4672-af27-4ca30acd1df9 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:45.687511 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-a61f4007-c8eb-4672-af27-4ca30acd1df9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bf4e1719a0a4b6bb9d9ec85c8fd6554', 'request_id': 'req-a61f4007-c8eb-4672-af27-4ca30acd1df9'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:45.767047 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-a61f4007-c8eb-4672-af27-4ca30acd1df9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bf4e1719a0a4b6bb9d9ec85c8fd6554', 'request_id': 'req-a61f4007-c8eb-4672-af27-4ca30acd1df9'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:45.773605 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-a61f4007-c8eb-4672-af27-4ca30acd1df9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bf4e1719a0a4b6bb9d9ec85c8fd6554', 'request_id': 'req-a61f4007-c8eb-4672-af27-4ca30acd1df9'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:45.784759 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-a61f4007-c8eb-4672-af27-4ca30acd1df9 admin admin] The token cache is being invalidate because project 0bf4e1719a0a4b6bb9d9ec85c8fd6554 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81622) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:22:45.785049 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-a61f4007-c8eb-4672-af27-4ca30acd1df9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:45.785681 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-a61f4007-c8eb-4672-af27-4ca30acd1df9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:22:45.787207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1304/2602] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:22:45 2022] DELETE /identity/v3/projects/0bf4e1719a0a4b6bb9d9ec85c8fd6554 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:22:45.792348 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5a48f-bab4-4d1a-b06c-15954ff3ffed None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:45.792645 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5a48f-bab4-4d1a-b06c-15954ff3ffed None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:45.792927 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5a48f-bab4-4d1a-b06c-15954ff3ffed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:45.812319 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-b6b5a48f-bab4-4d1a-b06c-15954ff3ffed None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:22:45.813541 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b6b5a48f-bab4-4d1a-b06c-15954ff3ffed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:45.872182 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1299/2603] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:22:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:22:45.880131 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40918538-f416-415e-9a74-c42e7c24d9b8 None None] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:45.880479 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40918538-f416-415e-9a74-c42e7c24d9b8 None None] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:45.880835 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40918538-f416-415e-9a74-c42e7c24d9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:45.900847 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.auth.core [None req-40918538-f416-415e-9a74-c42e7c24d9b8 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81622) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:22:45.902037 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-40918538-f416-415e-9a74-c42e7c24d9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:45.910488 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1305/2604] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:22:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:22:45.914564 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b5a48f-bab4-4d1a-b06c-15954ff3ffed None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:45.924348 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b5a48f-bab4-4d1a-b06c-15954ff3ffed None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:45.928988 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34df2a5-5c0f-448e-ae1b-62282a2046bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:45.929596 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34df2a5-5c0f-448e-ae1b-62282a2046bd admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:45.929885 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34df2a5-5c0f-448e-ae1b-62282a2046bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:45.930177 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34df2a5-5c0f-448e-ae1b-62282a2046bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:45.930807 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34df2a5-5c0f-448e-ae1b-62282a2046bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:22:45.931111 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34df2a5-5c0f-448e-ae1b-62282a2046bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:45.932750 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34df2a5-5c0f-448e-ae1b-62282a2046bd admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:45.944762 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1300/2605] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 26 11:22:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:22:45.948935 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40918538-f416-415e-9a74-c42e7c24d9b8 None None] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:45.958940 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40918538-f416-415e-9a74-c42e7c24d9b8 None None] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:45.973449 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1f1fb-e348-4e15-9dea-5a6c84ebfc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:45.973449 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1f1fb-e348-4e15-9dea-5a6c84ebfc85 admin admin] REQUEST_METHOD: `POST` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:45.973449 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1f1fb-e348-4e15-9dea-5a6c84ebfc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:45.973449 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1f1fb-e348-4e15-9dea-5a6c84ebfc85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:45.973874 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a1f1fb-e348-4e15-9dea-5a6c84ebfc85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:45.973874 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a1f1fb-e348-4e15-9dea-5a6c84ebfc85 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:46.071942 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1306/2606] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 26 11:22:45 2022] POST /identity/v3/projects => generated 371 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:22:46.076812 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34df2a5-5c0f-448e-ae1b-62282a2046bd admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:46.086750 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34df2a5-5c0f-448e-ae1b-62282a2046bd admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:46.143066 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b31dcf-0b6d-4351-bdeb-b5d0913dc6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:46.143667 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b31dcf-0b6d-4351-bdeb-b5d0913dc6a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:46.143946 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b31dcf-0b6d-4351-bdeb-b5d0913dc6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:46.144263 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b31dcf-0b6d-4351-bdeb-b5d0913dc6a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:46.144870 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b31dcf-0b6d-4351-bdeb-b5d0913dc6a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:46.146759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b31dcf-0b6d-4351-bdeb-b5d0913dc6a4 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:46.156455 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:22:46.242158 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1301/2607] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 26 11:22:46 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:22:46.246231 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1f1fb-e348-4e15-9dea-5a6c84ebfc85 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:46.257282 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1f1fb-e348-4e15-9dea-5a6c84ebfc85 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:46.262034 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5b323-537b-432b-a74c-a77a24b4dad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:46.262631 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5b323-537b-432b-a74c-a77a24b4dad1 admin admin] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:46.262910 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5b323-537b-432b-a74c-a77a24b4dad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:46.263184 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5b323-537b-432b-a74c-a77a24b4dad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:46.264475 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5b323-537b-432b-a74c-a77a24b4dad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:46.266081 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5b323-537b-432b-a74c-a77a24b4dad1 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:46.267335 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:22:46.276560 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1307/2608] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:22:46.280979 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b31dcf-0b6d-4351-bdeb-b5d0913dc6a4 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:46.291033 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b31dcf-0b6d-4351-bdeb-b5d0913dc6a4 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:46.296045 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32676de5-77f0-49ff-8e38-311df9bf911c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:46.296670 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32676de5-77f0-49ff-8e38-311df9bf911c admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:46.296949 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32676de5-77f0-49ff-8e38-311df9bf911c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:46.297220 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32676de5-77f0-49ff-8e38-311df9bf911c admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:46.297857 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32676de5-77f0-49ff-8e38-311df9bf911c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:46.299492 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32676de5-77f0-49ff-8e38-311df9bf911c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:46.309858 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1302/2609] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 26 11:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:22:46.314414 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5b323-537b-432b-a74c-a77a24b4dad1 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:46.324484 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5b323-537b-432b-a74c-a77a24b4dad1 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:46.330244 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7ef94-b288-4b14-8f48-20abc97cd094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:46.334322 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7ef94-b288-4b14-8f48-20abc97cd094 admin admin] REQUEST_METHOD: `PUT` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:46.334322 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7ef94-b288-4b14-8f48-20abc97cd094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:46.334322 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7ef94-b288-4b14-8f48-20abc97cd094 admin admin] PATH_INFO: `/v3/projects/83c77950c86e49dc84e3b32c43ee2a01/users/fbd114486294403cafe13748509715b8/roles/5d5a8bcef7c8455c9bb6b49e113e74c7` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:46.346288 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb7ef94-b288-4b14-8f48-20abc97cd094 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83c77950c86e49dc84e3b32c43ee2a01, user_id=fbd114486294403cafe13748509715b8, role_id=5d5a8bcef7c8455c9bb6b49e113e74c7)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:46.349000 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb7ef94-b288-4b14-8f48-20abc97cd094 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:46.414175 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1308/2610] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 26 11:22:46 2022] PUT /identity/v3/projects/83c77950c86e49dc84e3b32c43ee2a01/users/fbd114486294403cafe13748509715b8/roles/5d5a8bcef7c8455c9bb6b49e113e74c7 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:22:46.419297 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096b7cc-bbbb-4ea3-8f18-1df16bb16235 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:46.419584 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096b7cc-bbbb-4ea3-8f18-1df16bb16235 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:46.420746 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096b7cc-bbbb-4ea3-8f18-1df16bb16235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:46.439384 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-d096b7cc-bbbb-4ea3-8f18-1df16bb16235 None None] MFA Rules not processed for user `90057424199c4a248fcb33009a849d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:22:46.440609 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d096b7cc-bbbb-4ea3-8f18-1df16bb16235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:46.499169 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1303/2611] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:22:46.508506 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7ef94-b288-4b14-8f48-20abc97cd094 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:46.510251 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-fbb7ef94-b288-4b14-8f48-20abc97cd094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:46.566704 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7ef94-b288-4b14-8f48-20abc97cd094 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:46.570337 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca2964-7ef5-429f-8cce-210016f2d093 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:46.570940 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca2964-7ef5-429f-8cce-210016f2d093 service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:46.571220 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca2964-7ef5-429f-8cce-210016f2d093 service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:46.571496 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca2964-7ef5-429f-8cce-210016f2d093 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:46.580878 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca2964-7ef5-429f-8cce-210016f2d093 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:46.582290 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca2964-7ef5-429f-8cce-210016f2d093 service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:46.591690 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1309/2612] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:22:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:22:47.696397 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67452ef-b01c-4cca-838b-f1b159d80114 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:47.696933 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67452ef-b01c-4cca-838b-f1b159d80114 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:47.697099 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67452ef-b01c-4cca-838b-f1b159d80114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:47.727804 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-e67452ef-b01c-4cca-838b-f1b159d80114 None None] MFA Rules not processed for user `fbd114486294403cafe13748509715b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:22:47.729152 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e67452ef-b01c-4cca-838b-f1b159d80114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:47.794300 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1304/2613] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:22:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:22:47.805540 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca2964-7ef5-429f-8cce-210016f2d093 service neutron] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:47.806949 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-d9ca2964-7ef5-429f-8cce-210016f2d093 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:47.863990 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca2964-7ef5-429f-8cce-210016f2d093 service neutron] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:47.867531 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7709eac-d059-4e3e-8164-9cab1553022b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06f827607194b6dbd196a8fbf717b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:47.868159 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7709eac-d059-4e3e-8164-9cab1553022b service cinder] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:47.868438 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7709eac-d059-4e3e-8164-9cab1553022b service cinder] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:47.868710 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7709eac-d059-4e3e-8164-9cab1553022b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:47.876960 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7709eac-d059-4e3e-8164-9cab1553022b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:47.881571 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7709eac-d059-4e3e-8164-9cab1553022b service cinder] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:47.887012 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1310/2614] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:22:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:22:49.662382 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164fb11-c6eb-4c78-b808-3d8652a7b912 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:49.662865 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164fb11-c6eb-4c78-b808-3d8652a7b912 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:49.662964 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164fb11-c6eb-4c78-b808-3d8652a7b912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:49.681322 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-3164fb11-c6eb-4c78-b808-3d8652a7b912 None None] MFA Rules not processed for user `fbd114486294403cafe13748509715b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:22:49.682506 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3164fb11-c6eb-4c78-b808-3d8652a7b912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:49.689412 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1305/2615] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:22:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:22:49.917900 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7709eac-d059-4e3e-8164-9cab1553022b service cinder] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:49.919288 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-b7709eac-d059-4e3e-8164-9cab1553022b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:49.931104 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7709eac-d059-4e3e-8164-9cab1553022b service cinder] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:49.934770 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5493d-dda4-41e0-ab29-e32e18d37569 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:49.935357 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5493d-dda4-41e0-ab29-e32e18d37569 service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:49.936188 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5493d-dda4-41e0-ab29-e32e18d37569 service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:49.936467 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5493d-dda4-41e0-ab29-e32e18d37569 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:49.938448 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-cbf5493d-dda4-41e0-ab29-e32e18d37569 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:49.947727 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf5493d-dda4-41e0-ab29-e32e18d37569 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:49.949243 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf5493d-dda4-41e0-ab29-e32e18d37569 service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:49.957858 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1311/2616] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:22:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:22:50.363890 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164fb11-c6eb-4c78-b808-3d8652a7b912 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:22:50.365383 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3164fb11-c6eb-4c78-b808-3d8652a7b912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:50.436887 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164fb11-c6eb-4c78-b808-3d8652a7b912 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:22:50.441936 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813a2e6-b6f3-48ae-9cf0-957a7ebb91bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4f9a2bba0e748b6a98fa7dea2482ddf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:22:50.442569 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813a2e6-b6f3-48ae-9cf0-957a7ebb91bd service placement] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:22:50.442849 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813a2e6-b6f3-48ae-9cf0-957a7ebb91bd service placement] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:22:50.443140 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813a2e6-b6f3-48ae-9cf0-957a7ebb91bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:22:50.444903 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0813a2e6-b6f3-48ae-9cf0-957a7ebb91bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:22:50.453861 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:22:50.456220 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813a2e6-b6f3-48ae-9cf0-957a7ebb91bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:22:50.457779 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813a2e6-b6f3-48ae-9cf0-957a7ebb91bd service placement] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:22:50.467569 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1306/2617] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:22:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:22:59.954219 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=70,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:23:00.297601 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5493d-dda4-41e0-ab29-e32e18d37569 service neutron] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:23:00.299417 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-cbf5493d-dda4-41e0-ab29-e32e18d37569 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:23:00.374136 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5493d-dda4-41e0-ab29-e32e18d37569 service neutron] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:23:00.379925 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa37012-6d56-413e-90b7-e88b84ec1ca1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a852a777cb6a4863bebdb949cc71ea65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:23:00.380574 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa37012-6d56-413e-90b7-e88b84ec1ca1 service nova] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:23:00.380863 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa37012-6d56-413e-90b7-e88b84ec1ca1 service nova] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:23:00.381143 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa37012-6d56-413e-90b7-e88b84ec1ca1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:23:00.382919 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-caa37012-6d56-413e-90b7-e88b84ec1ca1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:23:00.395003 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa37012-6d56-413e-90b7-e88b84ec1ca1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:23:00.400887 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa37012-6d56-413e-90b7-e88b84ec1ca1 service nova] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:23:00.408346 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1312/2618] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:23:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:23:00.520988 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:23:08.027393 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ce099-fe04-4139-a436-5c61ee4790c1 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:23:08.027989 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ce099-fe04-4139-a436-5c61ee4790c1 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:23:08.027989 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ce099-fe04-4139-a436-5c61ee4790c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:23:08.047106 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-039ce099-fe04-4139-a436-5c61ee4790c1 None None] MFA Rules not processed for user `fbd114486294403cafe13748509715b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:23:08.048350 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-039ce099-fe04-4139-a436-5c61ee4790c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:23:08.055330 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1307/2619] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 26 11:23:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:23:08.282432 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa37012-6d56-413e-90b7-e88b84ec1ca1 service nova] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:23:08.291876 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa37012-6d56-413e-90b7-e88b84ec1ca1 service nova] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:23:08.295965 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a53e6-f265-4b28-a725-df886757fb6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522b4232cb4d430988d76a1cdb281e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:23:08.296596 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a53e6-f265-4b28-a725-df886757fb6e service neutron] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:23:08.296877 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a53e6-f265-4b28-a725-df886757fb6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:23:08.297150 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a53e6-f265-4b28-a725-df886757fb6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:23:08.298856 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-f71a53e6-f265-4b28-a725-df886757fb6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:23:08.308241 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a53e6-f265-4b28-a725-df886757fb6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:23:08.309687 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a53e6-f265-4b28-a725-df886757fb6e service neutron] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:23:08.318162 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1313/2620] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:23:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:23:18.042352 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:23:18.314641 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=40 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:23:27.236613 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5ae80-ea8a-4a1a-aec6-c27a6d58db77 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:23:27.237043 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5ae80-ea8a-4a1a-aec6-c27a6d58db77 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:23:27.237185 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5ae80-ea8a-4a1a-aec6-c27a6d58db77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:23:27.285248 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-c0d5ae80-ea8a-4a1a-aec6-c27a6d58db77 None None] MFA Rules not processed for user `3c90765757a34c6291c9980a7d5d5c79`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:23:27.286455 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c0d5ae80-ea8a-4a1a-aec6-c27a6d58db77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:23:27.357084 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1308/2621] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Oct 26 11:23:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:23:27.487004 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a53e6-f265-4b28-a725-df886757fb6e service neutron] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:23:27.488487 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-f71a53e6-f265-4b28-a725-df886757fb6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:23:27.578863 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a53e6-f265-4b28-a725-df886757fb6e service neutron] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:23:27.583874 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c0a85-bd66-4b9c-bb1f-91486b1b519f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21b84cc38a848de8d19a41e1eb04a58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:23:27.584510 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c0a85-bd66-4b9c-bb1f-91486b1b519f service swift] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:23:27.584789 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c0a85-bd66-4b9c-bb1f-91486b1b519f service swift] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:23:27.585061 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c0a85-bd66-4b9c-bb1f-91486b1b519f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:23:27.593399 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c0a85-bd66-4b9c-bb1f-91486b1b519f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:23:27.594988 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c0a85-bd66-4b9c-bb1f-91486b1b519f service swift] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:23:27.602927 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1314/2622] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Oct 26 11:23:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 26 11:23:37.354038 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=40 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:23:37.599717 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=41 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:23:44.883697 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a73b2-bcdd-4a50-b7bb-8a25f9218bf1 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:23:44.884225 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a73b2-bcdd-4a50-b7bb-8a25f9218bf1 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:23:44.884328 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a73b2-bcdd-4a50-b7bb-8a25f9218bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:23:44.904732 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-5d9a73b2-bcdd-4a50-b7bb-8a25f9218bf1 None None] MFA Rules not processed for user `3c90765757a34c6291c9980a7d5d5c79`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:23:44.906451 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5d9a73b2-bcdd-4a50-b7bb-8a25f9218bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:23:44.913572 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1309/2623] 10.222.0.45 () {58 vars in 967 bytes} [Wed Oct 26 11:23:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:23:44.926206 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c0a85-bd66-4b9c-bb1f-91486b1b519f service swift] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:23:44.936569 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c0a85-bd66-4b9c-bb1f-91486b1b519f service swift] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:23:44.942820 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95803da2-e7bd-4f69-bc71-ca59d731a5d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21b84cc38a848de8d19a41e1eb04a58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:23:44.942820 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95803da2-e7bd-4f69-bc71-ca59d731a5d7 service swift] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:23:44.942820 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95803da2-e7bd-4f69-bc71-ca59d731a5d7 service swift] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:23:44.943200 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95803da2-e7bd-4f69-bc71-ca59d731a5d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:23:44.951120 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95803da2-e7bd-4f69-bc71-ca59d731a5d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:23:44.953202 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95803da2-e7bd-4f69-bc71-ca59d731a5d7 service swift] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:23:44.961072 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1315/2624] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Oct 26 11:23:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 26 11:23:47.684788 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a73b2-bcdd-4a50-b7bb-8a25f9218bf1 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:23:47.696988 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a73b2-bcdd-4a50-b7bb-8a25f9218bf1 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:23:47.701887 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb635eef-1fbf-46af-96c3-5726bcc40e70 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4f9a2bba0e748b6a98fa7dea2482ddf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:23:47.702482 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb635eef-1fbf-46af-96c3-5726bcc40e70 service placement] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:23:47.702760 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb635eef-1fbf-46af-96c3-5726bcc40e70 service placement] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:23:47.703030 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb635eef-1fbf-46af-96c3-5726bcc40e70 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:23:47.704749 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-bb635eef-1fbf-46af-96c3-5726bcc40e70 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:23:47.716247 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb635eef-1fbf-46af-96c3-5726bcc40e70 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:23:47.718340 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb635eef-1fbf-46af-96c3-5726bcc40e70 service placement] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:23:47.728911 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1310/2625] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:23:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:23:47.802747 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95803da2-e7bd-4f69-bc71-ca59d731a5d7 service swift] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:23:47.815175 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95803da2-e7bd-4f69-bc71-ca59d731a5d7 service swift] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:23:47.819901 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c863ecc-3a4f-41f5-9030-fe9656f23a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:23:47.820574 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c863ecc-3a4f-41f5-9030-fe9656f23a21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:23:47.820860 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c863ecc-3a4f-41f5-9030-fe9656f23a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:23:47.821328 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c863ecc-3a4f-41f5-9030-fe9656f23a21 admin admin] PATH_INFO: `/v3/users/fbd114486294403cafe13748509715b8` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:23:47.822963 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c863ecc-3a4f-41f5-9030-fe9656f23a21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbd114486294403cafe13748509715b8)` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:23:47.824930 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c863ecc-3a4f-41f5-9030-fe9656f23a21 admin admin] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:23:48.021004 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-3c863ecc-3a4f-41f5-9030-fe9656f23a21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbd114486294403cafe13748509715b8'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:23:48.087222 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-3c863ecc-3a4f-41f5-9030-fe9656f23a21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbd114486294403cafe13748509715b8'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:23:48.099710 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-3c863ecc-3a4f-41f5-9030-fe9656f23a21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbd114486294403cafe13748509715b8'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:23:48.100376 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-3c863ecc-3a4f-41f5-9030-fe9656f23a21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbd114486294403cafe13748509715b8'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:23:48.107257 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.notifications [None req-3c863ecc-3a4f-41f5-9030-fe9656f23a21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbd114486294403cafe13748509715b8'} {{(pid=81622) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:23:48.113903 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1316/2626] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 26 11:23:47 2022] DELETE /identity/v3/users/fbd114486294403cafe13748509715b8 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:23:48.369354 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb635eef-1fbf-46af-96c3-5726bcc40e70 service placement] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:23:48.381437 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb635eef-1fbf-46af-96c3-5726bcc40e70 service placement] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:23:48.439123 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809704f0-3884-4292-9104-32e70f773a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90057424199c4a248fcb33009a849d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a9b4bb2dba420f8a4e538ebab67142', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:23:48.439759 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809704f0-3884-4292-9104-32e70f773a54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:23:48.440044 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809704f0-3884-4292-9104-32e70f773a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:23:48.440364 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809704f0-3884-4292-9104-32e70f773a54 admin admin] PATH_INFO: `/v3/projects/83c77950c86e49dc84e3b32c43ee2a01` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:23:48.441489 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809704f0-3884-4292-9104-32e70f773a54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83c77950c86e49dc84e3b32c43ee2a01)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:23:48.443607 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809704f0-3884-4292-9104-32e70f773a54 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:23:48.544828 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-809704f0-3884-4292-9104-32e70f773a54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83c77950c86e49dc84e3b32c43ee2a01', 'request_id': 'req-809704f0-3884-4292-9104-32e70f773a54'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:23:48.551658 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-809704f0-3884-4292-9104-32e70f773a54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83c77950c86e49dc84e3b32c43ee2a01', 'request_id': 'req-809704f0-3884-4292-9104-32e70f773a54'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:23:48.601960 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-809704f0-3884-4292-9104-32e70f773a54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83c77950c86e49dc84e3b32c43ee2a01', 'request_id': 'req-809704f0-3884-4292-9104-32e70f773a54'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:23:48.613333 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-809704f0-3884-4292-9104-32e70f773a54 admin admin] The token cache is being invalidate because project 83c77950c86e49dc84e3b32c43ee2a01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:23:48.615115 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-809704f0-3884-4292-9104-32e70f773a54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:23:48.615115 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-809704f0-3884-4292-9104-32e70f773a54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:23:48.615668 dv-cinder-862679-1-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1311/2627] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 26 11:23:48 2022] DELETE /identity/v3/projects/83c77950c86e49dc84e3b32c43ee2a01 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:23:50.580787 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c863ecc-3a4f-41f5-9030-fe9656f23a21 admin admin] Authenticating user token {{(pid=81622) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:23:50.582336 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-3c863ecc-3a4f-41f5-9030-fe9656f23a21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:23:50.650768 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c863ecc-3a4f-41f5-9030-fe9656f23a21 admin admin] Validating token access rules against request {{(pid=81622) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:23:50.703961 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:23:50.710502 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180655e6-375d-41f1-ae44-f10e6fce6760 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4f9a2bba0e748b6a98fa7dea2482ddf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8f0f02a607a49e0b88c75019795b726', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81622) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:23:50.711104 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180655e6-375d-41f1-ae44-f10e6fce6760 service placement] REQUEST_METHOD: `GET` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:23:50.714079 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180655e6-375d-41f1-ae44-f10e6fce6760 service placement] SCRIPT_NAME: `/identity` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:23:50.714079 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180655e6-375d-41f1-ae44-f10e6fce6760 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81622) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:23:50.714079 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.fernet_utils [None req-180655e6-375d-41f1-ae44-f10e6fce6760 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81622) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:23:50.725207 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180655e6-375d-41f1-ae44-f10e6fce6760 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:23:50.726838 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180655e6-375d-41f1-ae44-f10e6fce6760 service placement] RBAC: Authorization granted {{(pid=81622) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:23:50.737666 dv-cinder-862679-1-smb devstack@keystone.service[81622]: [pid: 81622|app: 0|req: 1317/2628] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 26 11:23:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:23:58.610221 dv-cinder-862679-1-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=60,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:24:00.790234 dv-cinder-862679-1-smb devstack@keystone.service[81622]: DEBUG dbcounter [-] [81622] Writing DB stats keystone:SELECT=4 {{(pid=81622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}